Update README.md

README.md

@@ -8,9 +8,9 @@ language:
 
 This model is pretrained Based model. 
 
-As a quality reference, we include a pretrained Mamba model provided here: https://huggingface.co/hazyresearch/mamba-1b-50b 
+As a quality reference, we include a pretrained Mamba model provided here: https://huggingface.co/hazyresearch/mamba-1b-50b and a pretrained attention (Llama architecture) model provided here: https://huggingface.co/hazyresearch/attn-1b-50bn
 
-Both checkpoints are pretrained on **50Bn tokens** of the Pile in the exact same data order using next token prediction. 
+All three checkpoints are pretrained on **50Bn tokens** of the Pile in the exact same data order using next token prediction. 
 
 A WandB report for training is here: https://api.wandb.ai/links/hazy-research/ggo9rst2