Hugging Face's logo

TomGrc
/
FusionNet_34Bx2_MoE

Text Generation
Transformers
Safetensors
English
mixtral
Mixture of Experts
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
3

Can you make a fusionnet 34b moe model, 24gb of video memory is too much of a strain to run a 34BX2 model

#1
by xldistance - opened
Discussion
xldistance

Thanks for sharing

TomGrc
 Owner

I will consider that.

TomGrc changed discussion status to closed

Sign up or log in to comment