Update README.md

README.md

@@ -11,7 +11,7 @@ pipeline_tag: text-generation
 
 # **Doge 20M**
 
-![architecture](https://cdn-uploads.huggingface.co/production/uploads/673ab3647afcea17eb4378fd/BBPbIRiw1KxdgYp_5CABf.png)
+![architecture](Doge.png)
 
 Doge is an ongoing research project where we aim to train a series of small language models to further explore whether the Transformer framework allows for more complex feedforward network structures, enabling the model to have fewer cache states and larger knowledge capacity.
 
@@ -36,6 +36,8 @@ In addition, Doge uses Dynamic Mask Attention as sequence transformation and can
 
 We build the Doge by doing Per-Training on [Smollm-Corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus).
 
+> NOTE: If you want to continue pre-training this model, you can find the unconverged checkpoint [here](https://huggingface.co/JingzeShi/Doge-20M-checkpoint-7000).
+
 > NOTE: These models has not been fine-tuned for instruction, the instruction model is [here](https://huggingface.co/JingzeShi/Doge-20M-Instruct).
 
 > TODO: The larger model is under training and will be uploaded soon.