Senku-70B-exl2-6bpw / README.md
Panchovix's picture
Update README.md
7c1b75b verified
|
raw
history blame
491 Bytes
metadata
license: other
license_name: other
license_link: LICENSE

exl2 quantization of Senku-70B-Full at 6bpw, to be used with exllamav2.

Original model card:

Finetune of miqu-70b-sf dequant of miqudev's leak of Mistral-70B (allegedly an early mistral medium). My diffs are available under CC-0, this is a merge with the leaked model, you can use the other repository to save bandwidth.

EQ-Bench: 84.89

Will run more benches later.