tiiuae
/

Falcon3-7B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

wdevazelhes commited on 2 days ago

Commit

28519b8

•

1 Parent(s): 7541925

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese)
   - Uses SwiGLU and RMSNorm
   - 32K context length
   - 131K vocab size
-- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 2048 H100 GPU chips
 - Postrained on 1.2 million samples of STEM, conversations, code, safety and function call data
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)

   - Uses SwiGLU and RMSNorm
   - 32K context length
   - 131K vocab size
+- Pretrained on 14 Teratokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
 - Postrained on 1.2 million samples of STEM, conversations, code, safety and function call data
 - Supports EN, FR, ES, PT
 - Developed by [Technology Innovation Institute](https://www.tii.ae)