ISTA-DASLab
/

Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

Model card Files Files and versions Community

SpiridonSunRotator commited on Aug 16, 2024

Commit

4449028

·

verified ·

1 Parent(s): 51ccd37

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -20,7 +20,7 @@ Results:
 | Model      | Quantization | MMLU (5-shot) | ArcC| ArcE| Hellaswag | PiQA | Winogrande | Model size, Gb |
 |------|------|-------|------|------|------|------|------|------|
 |mistralai/Mistral-Nemo-Instruct-2407| None | 0.6819 | 0.5606 | 0.8241 | 0.6332 | 0.8090	| 0.7498 | 24.5 |
-|  | 1x16g8 | 0.6071 | 0.5017 | 0.7942 | 0.5930 | 0.7987	| 0.7356 | 5.4 |
 **Note**

 | Model      | Quantization | MMLU (5-shot) | ArcC| ArcE| Hellaswag | PiQA | Winogrande | Model size, Gb |
 |------|------|-------|------|------|------|------|------|------|
 |mistralai/Mistral-Nemo-Instruct-2407| None | 0.6819 | 0.5606 | 0.8241 | 0.6332 | 0.8090	| 0.7498 | 24.5 |
+|  | 1x16g8 | 0.6071 | 0.5017 | 0.7942 | 0.5930 | 0.7987	| 0.7356 | 5.8 |
 **Note**