Hugging Face's logo

LoneStriker
/
Crunchy-onion-3.5bpw-h6-exl2

Text Generation
Transformers
Safetensors
mixtral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

Crunchy-onion

This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).

The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.

Works best with ChatML Instruct

Downloads last month
2
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Datasets used to train LoneStriker/Crunchy-onion-3.5bpw-h6-exl2