sethuiyer
/

CodeCalc-Mistral-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sethuiyer commited on Feb 20

Commit

4f7aba3

•

1 Parent(s): 23c3850

Update README.md

Files changed (1) hide show

README.md +8 -1

README.md CHANGED Viewed

@@ -146,4 +146,11 @@ models:
 parameters:
   int8_mask: true
-```

 parameters:
   int8_mask: true
+```
+### Evaluation
+| T  | Model                                       | Average | ARC  | HellaSwag | MMLU  | TruthfulQA | Winogrande | GSM8K |
+|----|---------------------------------------------|---------|------|-----------|-------|------------|------------|-------|
+| 🔍  | sethuiyer/CodeCalc-Mistral-7B               | 66.33   | 61.95| 83.64     | 62.78 | 47.79      | 78.3       | 63.53 |
+| 📉  | uukuguy/speechless-code-mistral-7b-v1.0     | 63.6    | 61.18| 83.77     | 63.4  | 47.9       | 78.37      | 47.01 |