LeroyDyer/Mixtral_AI_MiniTron_Chat AWQ

Model Summary

these little one are easy to train for task !!! ::

They already have some training (not great) But they can take more and more

(and being MISTRAL they can takes lora modules!)

Rememeber to add training on to the lora you merge withit : ie load the lora and train a few cycle on the same data that was applied in the p=lora (ie 20 Steps ) and

See it it took hold then merge IT!

  • Developed by: LeroyDyer
  • License: apache-2.0
  • Finetuned from model : LeroyDyer/Mixtral_AI_MiniTron
Downloads last month
85
Safetensors
Model size
729M params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.