Upload ./README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -54,7 +54,7 @@ ProgressGym-HistLlama3-70B-C017-pretrain is one of the **36 historical language
|
|
54 |
|
55 |
... where training results can be found in `all_results.json`, `trainer_log.jsonl`, and `training_loss.png` of the pretrain model.
|
56 |
|
57 |
-
Note that the training data volume for the continued pretraining stage is capped at
|
58 |
|
59 |
## Links
|
60 |
|
@@ -62,6 +62,7 @@ Note that the training data volume for the continued pretraining stage is capped
|
|
62 |
- **[Leaderboard & Interactive Playground]** [PKU-Alignment/ProgressGym-LeaderBoard](https://huggingface.co/spaces/PKU-Alignment/ProgressGym-LeaderBoard)
|
63 |
- **[Huggingface Data & Model Collection]** [PKU-Alignment/ProgressGym](https://huggingface.co/collections/PKU-Alignment/progressgym-666735fcf3e4efa276226eaa)
|
64 |
- **[Github Codebase]** [PKU-Alignment/ProgressGym](https://github.com/PKU-Alignment/ProgressGym)
|
|
|
65 |
- **[PyPI Package]** *(coming soon - [stay tuned](https://forms.gle/1TWFLL4ZCLeYTD5N6)!)*
|
66 |
|
67 |
## Citation
|
|
|
54 |
|
55 |
... where training results can be found in `all_results.json`, `trainer_log.jsonl`, and `training_loss.png` of the pretrain model.
|
56 |
|
57 |
+
Note that the training data volume for the continued pretraining stage is capped at 3GB. When the corresponding century's corpus exceeds this volume, the training data is randomly sampled to fit the volume.
|
58 |
|
59 |
## Links
|
60 |
|
|
|
62 |
- **[Leaderboard & Interactive Playground]** [PKU-Alignment/ProgressGym-LeaderBoard](https://huggingface.co/spaces/PKU-Alignment/ProgressGym-LeaderBoard)
|
63 |
- **[Huggingface Data & Model Collection]** [PKU-Alignment/ProgressGym](https://huggingface.co/collections/PKU-Alignment/progressgym-666735fcf3e4efa276226eaa)
|
64 |
- **[Github Codebase]** [PKU-Alignment/ProgressGym](https://github.com/PKU-Alignment/ProgressGym)
|
65 |
+
- **[Documentation]** [ProgressGym Documentation](https://pku-alignment.github.io/ProgressGym/)
|
66 |
- **[PyPI Package]** *(coming soon - [stay tuned](https://forms.gle/1TWFLL4ZCLeYTD5N6)!)*
|
67 |
|
68 |
## Citation
|