Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
allenai
/
OLMoE-1B-7B-0924
like
107
Follow
Ai2
1,401
Text Generation
Transformers
Safetensors
allenai/OLMoE-mix-0924
English
olmoe
Mixture of Experts
olmo
Carbon Emissions
Inference Endpoints
arxiv:
2409.02060
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
83792c6
OLMoE-1B-7B-0924
Commit History
Fix load balancing coefficient
83792c6
verified
awettig
commited on
Aug 30
Update README.md
4e1dee5
verified
soldni
commited on
Aug 28
Upload olmoe-logo.png
4c5204e
verified
soldni
commited on
Aug 28
Update README.md
fba02cf
verified
Muennighoff
commited on
Aug 16
Update README.md
423c0f8
verified
Muennighoff
commited on
Aug 13
Update README.md
ed327d8
verified
Muennighoff
commited on
Aug 13
Update README.md
8f8468c
verified
Muennighoff
commited on
Aug 13
Clarify branches
e775da2
verified
Muennighoff
commited on
Aug 13
Move anneal branch to main
f8770d2
Muennighoff
commited on
Aug 13
Update README.md
1ae71b7
verified
Muennighoff
commited on
Aug 9
Create README.md
66db7e7
verified
Muennighoff
commited on
Aug 9
Delete model-00006-of-00006.safetensors
004807c
verified
Muennighoff
commited on
Jul 25
Delete model-00005-of-00006.safetensors
b433fdd
verified
Muennighoff
commited on
Jul 25
Update generation_config.json
a42569a
verified
Muennighoff
commited on
Jul 24
Update config.json
628fa0e
verified
Muennighoff
commited on
Jul 24
Delete README.md
3b6be3f
verified
Muennighoff
commited on
Jul 24
fp32 -> bf16; step1200000
feed7e7
Muennighoff
commited on
Jul 24
Update config.json
ad1b9ae
verified
Muennighoff
commited on
Jul 24
Add step1200000
175203d
Muennighoff
commited on
Jul 24
initial commit
bc6b430
verified
Muennighoff
commited on
Jul 20