huihui-ai/Megrez-3B-Instruct-abliterated

This is an uncensored version of Infinigence/Megrez-3B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/megrez-abliterated directly

ollama run huihui_ai/megrez-abliterated
Downloads last month
27
Safetensors
Model size
2.92B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for huihui-ai/Megrez-3B-Instruct-abliterated

Finetuned
(2)
this model
Quantizations
2 models