ltg
/

davda54 commited on
Commit
484b155
·
verified ·
1 Parent(s): 88a9ba5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -9
README.md CHANGED
@@ -4,18 +4,33 @@ language:
4
  - en
5
  ---
6
 
 
 
7
  Submission to the BabyLM challenge 2024 trained on [Baby-cosmo-fine-100M](https://huggingface.co/datasets/ltg/babylm-2024-baby-cosmo-fine-100m).
8
 
9
  The training scripts are published here: https://github.com/ltgoslo/gpt-bert
10
 
11
- ```latex
12
- @misc{charpentier2024gptbertboth,
13
- title={GPT or BERT: why not both?},
14
- author={Lucas Georges Gabriel Charpentier and David Samuel},
15
- year={2024},
16
- eprint={2410.24159},
17
- archivePrefix={arXiv},
18
- primaryClass={cs.CL},
19
- url={https://arxiv.org/abs/2410.24159},
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  }
21
  ```
 
4
  - en
5
  ---
6
 
7
+ # GPT-BERT (BabyLM 100M)
8
+
9
  Submission to the BabyLM challenge 2024 trained on [Baby-cosmo-fine-100M](https://huggingface.co/datasets/ltg/babylm-2024-baby-cosmo-fine-100m).
10
 
11
  The training scripts are published here: https://github.com/ltgoslo/gpt-bert
12
 
13
+ ```bibtex
14
+ @inproceedings{charpentier-samuel-2024-bert,
15
+ title = "{BERT} or {GPT}: why not both?",
16
+ author = "Charpentier, Lucas Georges Gabriel and
17
+ Samuel, David",
18
+ editor = "Hu, Michael Y. and
19
+ Mueller, Aaron and
20
+ Ross, Candace and
21
+ Williams, Adina and
22
+ Linzen, Tal and
23
+ Zhuang, Chengxu and
24
+ Choshen, Leshem and
25
+ Cotterell, Ryan and
26
+ Warstadt, Alex and
27
+ Wilcox, Ethan Gotlieb",
28
+ booktitle = "The 2nd BabyLM Challenge at the 28th Conference on Computational Natural Language Learning",
29
+ month = nov,
30
+ year = "2024",
31
+ address = "Miami, FL, USA",
32
+ publisher = "Association for Computational Linguistics",
33
+ url = "https://aclanthology.org/2024.conll-babylm.24/",
34
+ pages = "262--283",
35
  }
36
  ```