Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ Below we
|
|
26 |
## Test Perplexity
|
27 |
<img src="figures/tllama_test.png" width="900"/>
|
28 |
|
29 |
-
## Distance in Steps
|
30 |
<img src="figures/tllama_test_distance.png" width="900"/>
|
31 |
The distance |x1-x2| with same function value f1(x1)=f2(x2) grows with more steps. On convergence, it starts to rapidly increase (perhaps exponentially).
|
32 |
|
|
|
26 |
## Test Perplexity
|
27 |
<img src="figures/tllama_test.png" width="900"/>
|
28 |
|
29 |
+
## Distance in Steps For the Same Loss from Fine-Tuning vs Training from Scratch
|
30 |
<img src="figures/tllama_test_distance.png" width="900"/>
|
31 |
The distance |x1-x2| with same function value f1(x1)=f2(x2) grows with more steps. On convergence, it starts to rapidly increase (perhaps exponentially).
|
32 |
|