tags: | |
- gptq | |
language: | |
- en | |
base_model: Sao10K/L3-8B-Stheno-v3.2 | |
Original Model: https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2 | |
Quantized with AutoGPTQ 128g wikitext2, using the script from https://aphrodite.pygmalion.chat/pages/quantization/quantization-methods.html#gptq |