---
language:
- en
- zh
library_name: transformers
tags:
- autoawq
---


## Model Details

This is 01-ai/Yi-6B quantized and serialized with AutoAWQ in 4-bit. 

Details here:

[Yi: Fine-tune and Run One the Best Bilingual LLMs on Your Computer](https://kaitchup.substack.com/p/yi-fine-tune-and-run-one-the-best)


- **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
- **Language(s) (NLP):** English
- **License:** [yi-license](https://huggingface.co/01-ai/Yi-6B/blob/main/LICENSE) https://huggingface.co/01-ai/Yi-6B/blob/main/LICENSE