Hugging Face's logo

RLHF-And-Friends
/
Llama-3.2-3B-Instruct-BnB-4bit

Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
conversational
Model card Files Community

Uploaded model

  • Developed by: RLHF-And-Friends
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3.2-3b-instruct-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
8
GGUF
Model size
3.21B params
Architecture
llama

4-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Collection including RLHF-And-Friends/Llama-3.2-3B-Instruct-BnB-4bit