Hymba: A Hybrid-head Architecture for Small Language Models
Paper
•
2411.13676
•
Published
•
40
•
3
Pavlo Molchanov PRO
pmolchanov
AI & ML interests
Efficiency in Multi-Modal LLMs
Recent Activity
upvoted
a
collection
1 day ago
Cosmos
liked
a model
2 days ago
nvidia/Cosmos-1.0-Autoregressive-4B
new activity
25 days ago
nvidia/Hymba-1.5B-Base:Update LMFlow support
Organizations
pmolchanov's activity
Update LMFlow support
#6 opened about 1 month ago
by
shizhediao2
Update LMFlow support
#10 opened about 1 month ago
by
shizhediao2
Add Hymba-1.5B to the leaderboard
3
#1030 opened about 1 month ago
by
pmolchanov
when will the Hymba-125M-Instruct be released? thanks
1
#6 opened about 1 month ago
by
nemonameless
How good would this be for RAG?
2
#2 opened about 2 months ago
by
Unomagan
How well this model can inference on cpu only devices?
2
#5 opened about 1 month ago
by
mhdaw
A collection of observations in the code
2
#1 opened about 2 months ago
by
AntonV
Add base model metadata
#7 opened about 1 month ago
by
davanstrien
Add link to paper, update tags
#3 opened about 1 month ago
by
nielsr
Update README.md
1
#4 opened about 1 month ago
by
mishig
commented
a
paper
about 2 months ago
commented
a
paper
3 months ago
License?
1
#2 opened 4 months ago
by
pmolchanov
Mistral-NeMo-Minitron-8B-Chat
5
#5 opened 5 months ago
by
rasyosef
Awesome model, instruct version as well possibly?
3
#2 opened 5 months ago
by
OPPEYRADY
Context Length
1
#4 opened 5 months ago
by
Sao10K
commented
a
paper
5 months ago
Where is Minitron-4B-Instruct?
1
#2 opened 6 months ago
by
mgoin
Import error
5
#1 opened 8 months ago
by
halidziya1