Senku-70B-GPTQ-4bit / README.md
bigquant's picture
Update README.md
753967e verified
|
raw
history blame
269 Bytes
---
library_name: transformers
tags:
- GPTQ
- Miqu
- Senku
---
A quantized version of [Shinoji Research's Senku 70B Full](https://huggingface.co/ShinojiResearch/Senku-70B-Full). Quantized through GPTQ:
Quantization settings:
```
4bits-128g-desc_act_True-damp_0.01
```