Commit
•
a105db6
1
Parent(s):
0fb3426
Update README.md
Browse files
README.md
CHANGED
@@ -20,3 +20,20 @@ base_model: unsloth/llama-3-8b-bnb-4bit
|
|
20 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
21 |
|
22 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
20 |
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
21 |
|
22 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
23 |
+
|
24 |
+
|
25 |
+
|
26 |
+
# Results
|
27 |
+
|
28 |
+
| Step | Training Loss |
|
29 |
+
|------|---------------|
|
30 |
+
| 5 | 1.748100 |
|
31 |
+
| 10 | 1.584900 |
|
32 |
+
| 15 | 1.406200 |
|
33 |
+
| 20 | 1.274800 |
|
34 |
+
| 25 | 0.983400 |
|
35 |
+
| 30 | 0.939900 |
|
36 |
+
| 35 | 1.156100 |
|
37 |
+
| 40 | 0.883000 |
|
38 |
+
| 45 | 0.813900 |
|
39 |
+
| 50 | 0.721000 |
|