nicholasKluge
/

TeenyTinyLlama-160m

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

nicholasKluge commited on Dec 22, 2023

Commit

f4161a7

•

1 Parent(s): a39955a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -70,7 +70,7 @@ Teeny-tiny-llama has been trained by leveraging scaling laws to determine the op
 - **Size:** 162 million parameters
 - **Dataset:** [Portuguese-Corpus-v3](https://huggingface.co/datasets/nicholasKluge/portuguese-corpus-v3)
 - **Language:** Portuguese
-- **Number of steps:** 457969
 - **Batch size:** 4
 - **Optimizer:** `torch.optim.AdamW` (warmup_ratio = 0.01, learning_rate = 6e-4, epsilon = 1e-8)
 - **GPU:** 1 NVIDIA A100-SXM4-40GB

 - **Size:** 162 million parameters
 - **Dataset:** [Portuguese-Corpus-v3](https://huggingface.co/datasets/nicholasKluge/portuguese-corpus-v3)
 - **Language:** Portuguese
+- **Number of steps:** 457,969
 - **Batch size:** 4
 - **Optimizer:** `torch.optim.AdamW` (warmup_ratio = 0.01, learning_rate = 6e-4, epsilon = 1e-8)
 - **GPU:** 1 NVIDIA A100-SXM4-40GB