Update README.md
Browse files
README.md
CHANGED
@@ -93,7 +93,10 @@ model.generate_meta(
|
|
93 |
## Model Details
|
94 |
|
95 |
- Model Size : 2.1 B
|
96 |
-
- Checkpoint : 2000 k steps
|
|
|
|
|
|
|
97 |
|
98 |
## Checkpoint Result
|
99 |
|
|
|
93 |
## Model Details
|
94 |
|
95 |
- Model Size : 2.1 B
|
96 |
+
- Checkpoint : 2000 k steps (bs=1)
|
97 |
+
- Adapters : r=4, alpha=8
|
98 |
+
- lr = 1e-4
|
99 |
+
|
100 |
|
101 |
## Checkpoint Result
|
102 |
|