Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
NurtureAI/openchat_3.5-16k
arxiv:2309.11235
arxiv:2303.08774
arxiv:2212.10560
Inference Endpoints
conversational
openchat_3.5-16k-Mistral-7B-Instruct-v0.1-GGUF
/
openchat_3.5-16k-Mistral-7B-Instruct-v0.1.Q4_K_S.gguf