yuzc19 commited on
Commit
b56ea75
1 Parent(s): 508211e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - loganengstrom/dsdm-candidate-c4
4
+ ---
5
+
6
+
7
+ *Pythia-410M models pre-trained by MATES.*
8
+
9
+ The main branch contains the final model checkpoint.
10
+
11
+ Paper: [MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models](https://arxiv.org/pdf/2406.06046)
12
+
13
+ Official codebase: https://github.com/cxcscmu/MATES