Update README.md
Browse files
README.md
CHANGED
@@ -70,5 +70,19 @@ The training dataset PhoneLM used is comprised of a filtered mixture of open-sou
|
|
70 |
| Qwen 1.5-500M | 49.2 | 55.7 | 69.5 | 82.5 | 49.5 | 52.3 | 29.4 | 55.44 |
|
71 |
| Cerebras-GPT-590M | 32.3 | 49.8 | 62.8 | 68.2 | 59.2 | 41.2 | 23.5 | 48.14 |
|
72 |
|
73 |
-
##
|
74 |
-
* This repository is released under the [Apache-2.0](https://huggingface.co/mllmTeam/PhoneLM-0.5B/blob/main/README.md) License.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
70 |
| Qwen 1.5-500M | 49.2 | 55.7 | 69.5 | 82.5 | 49.5 | 52.3 | 29.4 | 55.44 |
|
71 |
| Cerebras-GPT-590M | 32.3 | 49.8 | 62.8 | 68.2 | 59.2 | 41.2 | 23.5 | 48.14 |
|
72 |
|
73 |
+
## License
|
74 |
+
* This repository is released under the [Apache-2.0](https://huggingface.co/mllmTeam/PhoneLM-0.5B/blob/main/README.md) License.
|
75 |
+
|
76 |
+
|
77 |
+
## Citation
|
78 |
+
```
|
79 |
+
@misc{yi2024phonelmanefficientcapablesmall,
|
80 |
+
title={PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training},
|
81 |
+
author={Rongjie Yi and Xiang Li and Weikai Xie and Zhenyan Lu and Chenghua Wang and Ao Zhou and Shangguang Wang and Xiwen Zhang and Mengwei Xu},
|
82 |
+
year={2024},
|
83 |
+
eprint={2411.05046},
|
84 |
+
archivePrefix={arXiv},
|
85 |
+
primaryClass={cs.CL},
|
86 |
+
url={https://arxiv.org/abs/2411.05046},
|
87 |
+
}
|
88 |
+
```
|