Hugging Face's logo

fakezeta
/
openchat-3.5-0106-openvino-int4

Text Generation
Transformers
OpenVINO
mistral
openchat
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

OpenVINO INT4 converted model from https://huggingface.co/openchat/openchat-3.5-0106/

Downloads last month
0
Inference API
Text Generation
Examples
Input a message to start chatting with fakezeta/openchat-3.5-0106-openvino-int4.
This model can be loaded on Inference API (serverless).

Collection including fakezeta/openchat-3.5-0106-openvino-int4