Triangle104 commited on
Commit
4cba8f3
1 Parent(s): 47f7d61

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md CHANGED
@@ -109,6 +109,29 @@ model-index:
109
  This model was converted to GGUF format from [`nbeerbower/Gemma2-Gutenberg-Doppel-9B`](https://huggingface.co/nbeerbower/Gemma2-Gutenberg-Doppel-9B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
110
  Refer to the [original model card](https://huggingface.co/nbeerbower/Gemma2-Gutenberg-Doppel-9B) for more details on the model.
111
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
112
  ## Use with llama.cpp
113
  Install llama.cpp through brew (works on Mac and Linux)
114
 
 
109
  This model was converted to GGUF format from [`nbeerbower/Gemma2-Gutenberg-Doppel-9B`](https://huggingface.co/nbeerbower/Gemma2-Gutenberg-Doppel-9B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
110
  Refer to the [original model card](https://huggingface.co/nbeerbower/Gemma2-Gutenberg-Doppel-9B) for more details on the model.
111
 
112
+ ---
113
+ Model details:
114
+ -
115
+ Gemma2-Gutenberg-Doppel-9B
116
+
117
+ UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 finetuned on jondurbin/gutenberg-dpo-v0.1 and nbeerbower/gutenberg2-dpo.
118
+ Method
119
+
120
+ ORPO finetuned using 2x A40 for 3 epochs.
121
+ Open LLM Leaderboard Evaluation Results
122
+
123
+ Detailed results can be found here
124
+ Metric Value
125
+ Avg. 29.82
126
+ IFEval (0-Shot) 71.71
127
+ BBH (3-Shot) 41.08
128
+ MATH Lvl 5 (4-Shot) 3.47
129
+ GPQA (0-shot) 10.63
130
+ MuSR (0-shot) 17.30
131
+ MMLU-PRO (5-shot) 34.75
132
+
133
+ ---
134
+
135
  ## Use with llama.cpp
136
  Install llama.cpp through brew (works on Mac and Linux)
137