---
license: apache-2.0
---


This is an EXL2 quantization of [PY007/TinyLlama-1.1B-Chat-v0.3](https://huggingface.co/PY007/TinyLlama-1.1B-Chat-v0.3)

[3.0bpw](https://huggingface.co/SinanAkkoyun/TinyLlama-1.1B-Chat-v0.3-exl2/tree/3.0bpw)

Check out the awesome [Exllama V2 repo](https://github.com/turboderp/exllamav2)