Hugging Face's logo

casperhansen
/
mistral-7b-instruct-awq-gemv

Text Generation
Transformers
Safetensors
mistral
conversational
Inference Endpoints
text-generation-inference
4-bit precision
awq
Model card Files Community
Edit model card
README.md exists but content is empty. Use the Edit model card button to edit it.
Downloads last month
12
Safetensors
Model size
1.2B params
Tensor type
I32
·
FP16
·
Inference API
Text Generation
Examples
Input a message to start chatting with casperhansen/mistral-7b-instruct-awq-gemv.
This model can be loaded on Inference API (serverless).