Hugging Face's logo

solidrust
/
bagel-7b-v0.5-AWQ

Text Generation
Transformers
Safetensors
PyTorch
41 datasets
mistral
finetuned
quantized
4-bit precision
AWQ
instruct
conversational
Inference Endpoints
text-generation-inference
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
awq
Model card Files Community
bagel-7b-v0.5-AWQ / quant_config.json

Commit History

adding quant config
2d76893

Shaun Prince commited on