mobiuslabsgmbh
/

Mixtral-8x7B-Instruct-v0.1-hf-attn-4bit-moe-3bit-metaoffload-HQQ

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

mobicham commited on Feb 29

Commit

4cd0001

•

1 Parent(s): 2f7303b

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -22,12 +22,12 @@ Contrary to the <a href="https://huggingface.co/mobiuslabsgmbh/Mixtral-8x7B-Inst
 |-------------------|------------------|------------------|
 | Runtime VRAM      | 94 GB            | <b> 22.3 GB</b>     |
 | ARC (25-shot)     | 70.22            |    69.62        |
-| Hellaswag (10-shot)|     87.63       |            |
 | MMLU (5-shot)      |      71.16      |     69.46     |
 | TruthfulQA-MC2    | 64.58            |  62.63     |
 | Winogrande (5-shot)| 81.37           |  81.06       |
 | GSM8K (5-shot)|      60.73      |         57.77   |
-| Average|   72.62         |           |
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:

 |-------------------|------------------|------------------|
 | Runtime VRAM      | 94 GB            | <b> 22.3 GB</b>     |
 | ARC (25-shot)     | 70.22            |    69.62        |
+| Hellaswag (10-shot)|     87.63       |    86.05    |
 | MMLU (5-shot)      |      71.16      |     69.46     |
 | TruthfulQA-MC2    | 64.58            |  62.63     |
 | Winogrande (5-shot)| 81.37           |  81.06       |
 | GSM8K (5-shot)|      60.73      |         57.77   |
+| Average|   72.62         |     71.10      |
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows: