nicholasKluge
commited on
Commit
•
3c1a3c3
1
Parent(s):
a98924b
Update README.md
Browse files
README.md
CHANGED
@@ -5,19 +5,16 @@ tags: []
|
|
5 |
|
6 |
# Mula 4x160m
|
7 |
|
8 |
-
|
9 |
-
|
10 |
-
|
|
11 |
-
|
12 |
-
|
|
13 |
-
|
|
14 |
-
|
|
15 |
-
|
|
16 |
-
|
|
17 |
-
|
|
18 |
-
| 350000 | 2.46 | 11.75 | 0.041 |
|
19 |
-
| 400000 | 2.46 | 11.72 | 0.040 |
|
20 |
-
|
21 |
|
22 |
| | **ARC** | **HellaSwag** | **MMLU** | **TruthfulQA** | **Average** |
|
23 |
|------------------|-----------|---------------|-----------|----------------|-------------|
|
|
|
5 |
|
6 |
# Mula 4x160m
|
7 |
|
8 |
+
| Step | Evaluation Loss | Perplexity |
|
9 |
+
|--------|-----------------|------------|
|
10 |
+
| 50000 | 3.03 | 20.73 |
|
11 |
+
| 100000 | 2.84 | 17.14 |
|
12 |
+
| 150000 | 2.73 | 15.35 |
|
13 |
+
| 200000 | 2.64 | 14.05 |
|
14 |
+
| 250000 | 2.56 | 12.95 |
|
15 |
+
| 300000 | 2.49 | 12.14 |
|
16 |
+
| 350000 | 2.46 | 11.75 |
|
17 |
+
| 400000 | 2.46 | 11.72 |
|
|
|
|
|
|
|
18 |
|
19 |
| | **ARC** | **HellaSwag** | **MMLU** | **TruthfulQA** | **Average** |
|
20 |
|------------------|-----------|---------------|-----------|----------------|-------------|
|