mlabonne commited on
Commit
a5d1b1f
1 Parent(s): 0d7d449

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -14,6 +14,19 @@ Beagle14-7B is a merge of the following models using [LazyMergekit](https://cola
14
  * [fblgit/UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)
15
  * [argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp)
16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
  ## 🧩 Configuration
18
 
19
  ```yaml
 
14
  * [fblgit/UNA-TheBeagle-7b-v1](https://huggingface.co/fblgit/UNA-TheBeagle-7b-v1)
15
  * [argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp)
16
 
17
+ ## 🏆 Evaluation
18
+
19
+ The evaluation was performed using [LLM AutoEval](https://github.com/mlabonne/llm-autoeval) on Nous suite.
20
+
21
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
22
+ |----------------------------------------------------------|------:|------:|---------:|-------:|------:|
23
+ |[**Beagle14-7B**](https://huggingface.co/mlabonne/Beagle14-7B)| **44.38**| **76.53**| **69.44**| **47.25**| **59.4**|
24
+ |[OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)| 42.75| 72.99| 52.99| 40.94| 52.42|
25
+ |[NeuralHermes-2.5-Mistral-7B](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B)| 43.67| 73.24| 55.37| 41.76| 53.51|
26
+ |[Nous-Hermes-2-SOLAR-10.7B](https://huggingface.co/NousResearch/Nous-Hermes-2-SOLAR-10.7B)| 47.79| 74.69| 55.92| 44.84| 55.81|
27
+ |[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) | 44.66| 76.24| 64.15| 45.64| 57.67|
28
+ |[CatMarcoro14-7B-slerp](https://huggingface.co/occultml/CatMarcoro14-7B-slerp)| 45.21| 75.91| 63.81| 47.31| 58.06|
29
+
30
  ## 🧩 Configuration
31
 
32
  ```yaml