Add quants
#2
by
bartowski
- opened
README.md
CHANGED
|
@@ -35,7 +35,9 @@ The `Locutusque/Hyperion-3.0-Mistral-7B-alpha` model was fine-tuned on 200,000 e
|
|
| 35 |
|
| 36 |
## Quants
|
| 37 |
|
| 38 |
-
|
|
|
|
|
|
|
| 39 |
|
| 40 |
## Evaluation Results
|
| 41 |
Zero-shot AGIEval
|
|
|
|
| 35 |
|
| 36 |
## Quants
|
| 37 |
|
| 38 |
+
ExLlamaV2: https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-alpha-exl2
|
| 39 |
+
|
| 40 |
+
GGUF: https://huggingface.co/bartowski/Hyperion-3.0-Mistral-7B-alpha-GGUF
|
| 41 |
|
| 42 |
## Evaluation Results
|
| 43 |
Zero-shot AGIEval
|