Muennighoff
commited on
Commit
•
78a8ec4
1
Parent(s):
0ed61f2
Update README.md
Browse files
README.md
CHANGED
@@ -846,7 +846,7 @@ print(tokenizer.decode(outputs[0]))
|
|
846 |
|
847 |
- **Architecture:** Same as [bloom-1b1](https://huggingface.co/bigscience/bloom-1b1), also refer to the `config.json` file
|
848 |
- **Finetuning steps:** 250
|
849 |
-
- **Finetuning tokens:**
|
850 |
- **Finetuning layout:** 1x pipeline parallel, 1x tensor parallel, 1x data parallel
|
851 |
- **Precision:** float16
|
852 |
|
|
|
846 |
|
847 |
- **Architecture:** Same as [bloom-1b1](https://huggingface.co/bigscience/bloom-1b1), also refer to the `config.json` file
|
848 |
- **Finetuning steps:** 250
|
849 |
+
- **Finetuning tokens:** 502 million
|
850 |
- **Finetuning layout:** 1x pipeline parallel, 1x tensor parallel, 1x data parallel
|
851 |
- **Precision:** float16
|
852 |
|