voidism commited on
Commit
f80f6e2
·
1 Parent(s): e452aff

add readme

Browse files
Files changed (2) hide show
  1. README.md +36 -0
  2. all_results.json +0 -9
README.md CHANGED
@@ -1,3 +1,39 @@
1
  ---
2
  license: llama3.1
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: llama3.1
3
  ---
4
+
5
+ # SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models
6
+
7
+ [![License: MIT](https://img.shields.io/badge/License-MIT-g.svg)](https://opensource.org/licenses/MIT)
8
+ [![Arxiv](https://img.shields.io/badge/arXiv-2502.09604-B21A1B)](https://arxiv.org/abs/2502.09604)
9
+ [![Hugging Face Transformers](https://img.shields.io/badge/%F0%9F%A4%97-Transformers-blue)](https://github.com/huggingface/transformers)
10
+ [![Tweet](https://img.shields.io/twitter/url/http/shields.io.svg?style=social)](https://twitter.com/YungSungChuang/)
11
+ [![GitHub Stars](https://img.shields.io/github/stars/voidism/SelfCite?style=social)](https://github.com/voidism/SelfCite/stargazers)
12
+
13
+ Paper: https://arxiv.org/abs/2502.09604
14
+ Authors: [Yung-Sung Chuang](https://people.csail.mit.edu/yungsung/)$^\dagger$, [Benjamin Cohen-Wang](https://bencw99.github.io/)$^\dagger$, [Shannon Zejiang Shen](https://www.szj.io/)$^\dagger$, [Zhaofeng Wu](https://zhaofengwu.github.io/)$^\dagger$, [Hu Xu](https://howardhsu.github.io/)$^\ddagger$, [Xi Victoria Lin](https://victorialin.org/)$^\ddagger$, [James Glass](https://people.csail.mit.edu/jrg/)$^\dagger$, [Shang-Wen Li](https://swdanielli.github.io/)$^\ddagger$, [Wen-tau Yih](https://scottyih.org/)$^\ddagger$
15
+ $^\dagger$ Massachusetts Institute of Technology, $^\ddagger$ Meta AI
16
+
17
+ ![main-fig](SelfCite.png)
18
+
19
+ This model is the SimPO fine-tuned model from LongCite-8B.
20
+ Please refer to our GitHub repository for usage and more details: https://github.com/voidism/SelfCite
21
+
22
+ ## Citation
23
+ Please cite our paper as well as LongCite if they are helpful to your work!
24
+
25
+ ```bibtex
26
+ @inproceedings{chuang2025selfcite,
27
+ title={SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models},
28
+ author={Yung-Sung Chuang and Benjamin Cohen-Wang and Shannon Zejiang Shen and Zhaofeng Wu and Hu Xu and Xi Victoria Lin and James Glass and Shang-Wen Li and Wen-tau Yih},
29
+ journal={arXiv preprint arXiv:2502.09604},
30
+ year={2025}
31
+ }
32
+
33
+ @article{zhang2024longcite,
34
+ title = {LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA}
35
+ author={Jiajie Zhang and Yushi Bai and Xin Lv and Wanjun Gu and Danqing Liu and Minhao Zou and Shulin Cao and Lei Hou and Yuxiao Dong and Ling Feng and Juanzi Li},
36
+ journal={arXiv preprint arXiv:2409.02897},
37
+ year={2024}
38
+ }
39
+ ```
all_results.json DELETED
@@ -1,9 +0,0 @@
1
- {
2
- "epoch": 1.0,
3
- "total_flos": 0.0,
4
- "train_loss": 1.8338732454511855,
5
- "train_runtime": 6099.2148,
6
- "train_samples": 2013,
7
- "train_samples_per_second": 0.33,
8
- "train_steps_per_second": 0.041
9
- }