kartikmosaicml
commited on
Commit
•
1db8429
1
Parent(s):
1e3082b
Fixing typo in the readme
Browse files
README.md
CHANGED
@@ -173,7 +173,7 @@ StreamingDataset obviates the need to download the whole dataset before starting
|
|
173 |
|
174 |
### Data Mix
|
175 |
|
176 |
-
The model was trained for 1T tokens
|
177 |
|
178 |
| Data Source | Number of Tokens in Source | Proportion | Effective Number of Tokens | Epochs |
|
179 |
|-------------|----------------------------|------------|----------------------------|--------|
|
|
|
173 |
|
174 |
### Data Mix
|
175 |
|
176 |
+
The model was trained for 1T tokens on the following data mix:
|
177 |
|
178 |
| Data Source | Number of Tokens in Source | Proportion | Effective Number of Tokens | Epochs |
|
179 |
|-------------|----------------------------|------------|----------------------------|--------|
|