Hugging Face's logo

wiweka24
/
llama3-psychiatrist-v1.3B-4bit

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
unsloth
trl
sft
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community
Edit model card

Uploaded model

  • Developed by: wiweka24
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3-8b-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
11
Safetensors
Model size
4.65B params
Tensor type
FP16
·
F32
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for wiweka24/llama3-psychiatrist-v1.3B-4bit

Base model

meta-llama/Meta-Llama-3-8B
Quantized
unsloth/llama-3-8b-bnb-4bit
Quantized
(674)
this model

Collection including wiweka24/llama3-psychiatrist-v1.3B-4bit