---
license: apache-2.0
---
Quantized this https://huggingface.co/senseable/WestLake-7B-v2 using the config.json and tokenizer_config.json parameters from this: https://huggingface.co/NurtureAI/OpenHermes-2.5-Mistral-7B-16k