Hugging Face's logo

mlx-community
/
WizardLM2-8x22B-4bit-mlx

Text Generation
Transformers
Safetensors
mixtral
Inference Endpoints
text-generation-inference
Model card Files Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card
Downloads last month
4
Safetensors
Model size
22.1B params
Tensor type
FP16
·
U32
·
Inference API
Text Generation
Examples
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Collection including mlx-community/WizardLM2-8x22B-4bit-mlx