Hugging Face's logo

MaziyarPanahi
/
Qwen1.5-8x7b-v0.1-GGUF

Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
axolotl
Generated from Trainer
Mixture of Experts
qwen
text-generation-inference
conversational
dataset:Crystalcareai/MoD-150k
Inference Endpoints
Model card Files Community
6
New discussion

How do you convert the MOE composed of qwen1.5 models into gguf?

16
#6 opened 8 months ago by DisOOM