Hugging Face's logo

akaistormherald
/
ToxicMist-v0.2-7B-DPO

Text Generation
Transformers
Safetensors
English
mistral
text-generation-inference
unsloth
trl
dpo
conversational
Inference Endpoints
Model card Files Community
Edit model card

Uploaded model

  • Developed by: akaistormherald
  • License: apache-2.0
  • Finetuned from model : unsloth/zephyr-sft-bnb-4bit

Mistral7b + SFT + 4bit DPO training with unalignment/toxic-dpo-v0.2 == ToxicMist? ☣🌫

Downloads last month
15
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for akaistormherald/ToxicMist-v0.2-7B-DPO

Base model

unsloth/zephyr-sft-bnb-4bit
Finetuned
(66)
this model

Dataset used to train akaistormherald/ToxicMist-v0.2-7B-DPO