Hugging Face's logo
Betageri's picture
2

Betageri

Srirakshith
ยท

AI & ML interests

None yet

Recent Activity

new activity 14 days ago
mistralai/Mistral-Small-24B-Instruct-2501:Anybody got it to run a quantized version with vLLM
new activity about 2 months ago
unsloth/Mistral-Small-24B-Instruct-2501-bnb-4bit:Size mismatch error when loading Mistral-Small
View all activity

Organizations

Fiddler AI's profile picture Hugging Face Discord Community's profile picture

Srirakshith's activity

New activity in mistralai/Mistral-Small-24B-Instruct-2501 14 days ago

Anybody got it to run a quantized version with vLLM

5
#24 opened about 1 month ago by
alecauduro
New activity in unsloth/Mistral-Small-24B-Instruct-2501-bnb-4bit about 2 months ago

Size mismatch error when loading Mistral-Small
#1 opened about 2 months ago by
Srirakshith