README.md

---
license: llama3
---

Quantized with these parameters:

--bits 4 

--group_size 128 

--desc_act 1 

--damp 0.1  

--seqlen 16384 

--num_samples 512

Quantization Dataset: Erotiquant XL