Hugging Face's logo

leliuga
/
Meta-Llama-Guard-2-8B-bnb-4bit

Text Generation
Transformers
Safetensors
llama
llama-3
conversational
text-generation-inference
4-bit precision
Model card Files Community
Meta-Llama-Guard-2-8B-bnb-4bit / README.md
evaldas-leliuga's picture
evaldas-leliuga
Added model
606b3be verified
preview code
|
raw
history blame contribute delete
No virus
733 Bytes
metadata
base_model: meta-llama/Meta-Llama-Guard-2-8B
license: other
license_name: llama3
license_link: https://huggingface.co/meta-llama/Meta-Llama-Guard-2-8B/raw/main/LICENSE
inference: false
model_creator: Meta
model_name: Meta-Llama-Guard-2-8B
quantized_by: Leliuga
pipeline_tag: text-generation
tags:
  - llama
  - llama-3

Meta-Llama-Guard-2-8B - bnb 4bit

Description

This model is 4bit quantized version of Meta-Llama-Guard-2-8B using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.