apple
/

DCLM-7B-8k

vaishaal commited on Jul 26

Commit

d3dfe56

•

1 Parent(s): 6258b79

Update README.md

Files changed (1) hide show

README.md CHANGED Viewed

@@ -144,18 +144,18 @@ Below are comparisions of this model with other models in the 7B regime.
 | Model         | Params | Tokens | Open dataset? | CORE     | MMLU     | EXTENDED |
 |---------------|--------|--------|---------------|----------|----------|----------|
 | **Open weights, closed datasets** |        |        |               |          |          |          |
-| Llama2        | 7B     | 2T     | ✗             | 49.2     | 45.8     | 34.1     |
-| DeepSeek      | 7B     | 2T     | ✗             | 50.7     | 48.5     | 35.3     |
-| Mistral-0.3   | 7B     | ?      | ✗             | 57.0     | 62.7     | 45.1     |
-| QWEN-2        | 7B     | ?      | ✗             | 57.5     | **71.9** | 50.5     |
-| Llama3        | 8B     | 15T    | ✗             | 57.6     | 66.2     | 46.3     |
-| Gemma         | 8B     | 6T     | ✗             | 57.8     | 64.3     | 44.6     |
-| Phi-3         | 7B     | ?      | ✗             | **61.0** | 69.9     | **57.9** |
 | **Open weights, open datasets** |        |        |               |          |          |          |
-| Falcon        | 7B     | 1T     | ✓             | 44.1     | 27.4     | 25.1     |
-| OLMo-1.7      | 7B     | 2.1T   | ✓             | 47.0     | 54.0     | 34.2     |
-| MAP-Neo       | 7B     | 4.5T   | ✓             | **50.2** | **57.1** | **40.4** |
-| **DCLM-7B-8k** | 7B     | 2.5T   | ✓             | **57.1** | **63.7** | **45.4** |

 | Model         | Params | Tokens | Open dataset? | CORE     | MMLU     | EXTENDED |
 |---------------|--------|--------|---------------|----------|----------|----------|
 | **Open weights, closed datasets** |        |        |               |          |          |          |
+| Llama2        | 7B     | 2T     | ❌             | 49.2     | 45.8     | 34.1     |
+| DeepSeek      | 7B     | 2T     | ❌             | 50.7     | 48.5     | 35.3     |
+| Mistral-0.3   | 7B     | ?      | ❌             | 57.0     | 62.7     | 45.1     |
+| QWEN-2        | 7B     | ?      | ❌             | 57.5     | **71.9** | 50.5     |
+| Llama3        | 8B     | 15T    | ❌             | 57.6     | 66.2     | 46.3     |
+| Gemma         | 8B     | 6T     | ❌             | 57.8     | 64.3     | 44.6     |
+| Phi-3         | 7B     | ?      | ❌             | **61.0** | 69.9     | **57.9** |
 | **Open weights, open datasets** |        |        |               |          |          |          |
+| Falcon        | 7B     | 1T     |  ✅             | 44.1     | 27.4     | 25.1     |
+| OLMo-1.7      | 7B     | 2.1T   |  ✅             | 47.0     | 54.0     | 34.2     |
+| MAP-Neo       | 7B     | 4.5T   |  ✅             | **50.2** | **57.1** | **40.4** |
+| **DCLM-7B-8k** | 7B     | 2.5T   |  ✅             | **57.1** | **63.7** | **45.4** |