AndrewZeng
commited on
Commit
•
6f95e4f
1
Parent(s):
88f760d
Update README.md
Browse files
README.md
CHANGED
@@ -81,4 +81,19 @@ The following hyperparameters were used during fine tuning:
|
|
81 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
82 |
- lr_scheduler_type: linear
|
83 |
- lr_scheduler_warmup_ratio: 0.1
|
84 |
-
- num_epochs: 3.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
81 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
82 |
- lr_scheduler_type: linear
|
83 |
- lr_scheduler_warmup_ratio: 0.1
|
84 |
+
- num_epochs: 3.0
|
85 |
+
|
86 |
+
|
87 |
+
## Citation
|
88 |
+
If you find the content of this project helpful, please cite our paper as follows:
|
89 |
+
|
90 |
+
```
|
91 |
+
@misc{liu2023what,
|
92 |
+
title={What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning},
|
93 |
+
author={Wei Liu and Weihao Zeng and Keqing He and Yong Jiang and Junxian He},
|
94 |
+
year={2023},
|
95 |
+
eprint={2312.15685},
|
96 |
+
archivePrefix={arXiv},
|
97 |
+
primaryClass={cs.CL}
|
98 |
+
}
|
99 |
+
```
|