Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints
text-generation-inference
Model card Files Community
15
New discussion

That wizardlm 8x22b is very advanced.!

18
#8 opened 7 months ago by mirek190

Help regarding best quantization for below PC specification.

6
#15 opened 7 months ago by bikkikumarsha

AWQ and GPTQ plz

6
#11 opened 7 months ago by Parkerlambert123