bnb-4 bit
Collection
A 4-bit quantized version models designed for fine-tuning. Demo: https://colab.research.google.com/drive/19UpFUjtbJoLua-4DMb1JKKwJAcvMyMHb
•
21 items
•
Updated
Meta-Llama-3-8B - bnb 4bit
- Model creator: Meta
- Original model: Meta-Llama-3-8B
Description
This model is 4bit quantized version of Meta-Llama-3-8B using bitsandbytes. It's designed for fine-tuning! The PAD token is set as UNK.
- Downloads last month
- 17
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API has been turned off for this model.
Model tree for leliuga/Meta-Llama-3-8B-bnb-4bit
Base model
meta-llama/Meta-Llama-3-8B