library_name: transformers | |
tags: | |
- GPTQ | |
- Miqu | |
- Senku | |
A quantized version of [Shinoji Research's Senku 70B Full](https://huggingface.co/ShinojiResearch/Senku-70B-Full). Quantized through GPTQ: | |
Quantization settings: | |
``` | |
4bits-128g-desc_act_True-damp_0.01 | |
``` |