Native bitsandbytes 4bit pre quantized models
![Unsloth AI's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
Unsloth AI
company
AI & ML interests
Hey! We're focusing on making AI more accessible to everyone!
Organization Card
About org cards
Unsloth makes fine-tuning of LLMs 2.2x faster and use 80% less VRAM!
Join our Discord server! 🦥 And our open source Github repo is here!
Unsloth support includes | Free Notebooks | Performance | Memory use |
---|---|---|---|
Llama-3 8b | ▶️ Start on Colab | 2x faster | 60% less |
Gemma 7b | ▶️ Start on Colab | 2.4x faster | 58% less |
Mistral 7b | ▶️ Start on Colab | 2.2x faster | 62% less |
Collections
2
-
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • Updated • 432k • 100 -
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation • Updated • 57.9k • 26 -
unsloth/mistral-7b-instruct-v0.3-bnb-4bit
Text Generation • Updated • 24k • 13 -
unsloth/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation • Updated • 86k • 13
models
84
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-1.5B-bnb-4bit
Text Generation
•
Updated
•
3.48k
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-72B-Instruct-bnb-4bit
Text Generation
•
Updated
•
533
•
4
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-0.5B-Instruct
Text Generation
•
Updated
•
775
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-0.5B-Instruct-bnb-4bit
Text Generation
•
Updated
•
2.44k
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-0.5B-bnb-4bit
Text Generation
•
Updated
•
3.1k
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-1.5B
Text Generation
•
Updated
•
4.36k
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-1.5B-Instruct
Text Generation
•
Updated
•
550
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-1.5B-Instruct-bnb-4bit
Text Generation
•
Updated
•
1.68k
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-7B
Text Generation
•
Updated
•
1.15k
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/E4lkPz1TZNLzIFr_dR273.png)
unsloth/Qwen2-7B-bnb-4bit
Text Generation
•
Updated
•
9.22k
•
2