Commit
•
8fe3881
1
Parent(s):
9790910
Update README.md
Browse files
README.md
CHANGED
|
@@ -44,7 +44,7 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
| 44 |
## Training Details
|
| 45 |
|
| 46 |
- Trained for one epoch on SlimOrca-Dedup
|
| 47 |
-
- Learning rate:
|
| 48 |
- Cosine learning rate decay
|
| 49 |
- Optimizer: AdamW
|
| 50 |
- Batch size: 256
|
|
|
|
| 44 |
## Training Details
|
| 45 |
|
| 46 |
- Trained for one epoch on SlimOrca-Dedup
|
| 47 |
+
- Learning rate: 2e-5
|
| 48 |
- Cosine learning rate decay
|
| 49 |
- Optimizer: AdamW
|
| 50 |
- Batch size: 256
|