Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ We encountered two major loss spikes while [training K2](https://huggingface.co/
|
|
| 8 |
|
| 9 |
We are releasing these checkpoints so others can study this interesting phenomena in large model training.
|
| 10 |
|
| 11 |
-
<img src="
|
| 12 |
|
| 13 |
# Purpose
|
| 14 |
Loss spikes are still a relatively unknown phenomena. By making these spikes and associated training details available, we hope others use these artifacts to further the worlds knowledge on this topic.
|
|
|
|
| 8 |
|
| 9 |
We are releasing these checkpoints so others can study this interesting phenomena in large model training.
|
| 10 |
|
| 11 |
+
<img src="loss_spike.png" alt="k2 loss spikes"/>
|
| 12 |
|
| 13 |
# Purpose
|
| 14 |
Loss spikes are still a relatively unknown phenomena. By making these spikes and associated training details available, we hope others use these artifacts to further the worlds knowledge on this topic.
|