mlabonne commited on
Commit
634a933
1 Parent(s): 783a621

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -29,6 +29,23 @@ The code to train this model is available on [Google Colab](https://colab.resear
29
 
30
  GGUF versions of this model are available here: [mlabonne/NeuralHermes-2.5-Mistral-7B-GGUF](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-GGUF).
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## Usage
33
 
34
  You can run this model using [LM Studio](https://lmstudio.ai/) or any other frontend.
 
29
 
30
  GGUF versions of this model are available here: [mlabonne/NeuralHermes-2.5-Mistral-7B-GGUF](https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-GGUF).
31
 
32
+ ## Results
33
+
34
+ Teknium (author of OpenHermes-2.5-Mistral-7B) benchmarked the model ([see his tweet](https://twitter.com/Teknium1/status/1729955709377503660)).
35
+
36
+ Results are improved on every benchmark: **AGIEval** (from 43.07% to 43.62%), **GPT4All** (from 73.12% to 73.25%), and **TruthfulQA**.
37
+
38
+ ### AGIEval
39
+ ![](https://i.imgur.com/7an3B1f.png)
40
+
41
+ ### GPT4All:
42
+ ![](https://i.imgur.com/TLxZFi9.png)
43
+
44
+ ### TruthfulQA
45
+ ![](https://i.imgur.com/V380MqD.png)
46
+
47
+ You can check the Weights & Biases project [here](https://wandb.ai/mlabonne/NeuralHermes-2-5-Mistral-7B/overview?workspace=user-mlabonne).
48
+
49
  ## Usage
50
 
51
  You can run this model using [LM Studio](https://lmstudio.ai/) or any other frontend.