Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
akumaburn
/
llama-3-8b-bnb-4bit-GGUF
like
4
Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
llama-3-8b-bnb-4bit-GGUF
1 contributor
History:
17 commits
akumaburn
(Trained with Unsloth)
e227d44
verified
10 months ago
.gitattributes
Safe
2.08 kB
(Trained with Unsloth)
10 months ago
README.md
Safe
659 Bytes
Update README.md
10 months ago
config.json
Safe
29 Bytes
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.F16.gguf
Safe
16.1 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q2_K.gguf
Safe
3.18 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q3_K_M.gguf
Safe
4.02 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q4_K_M.gguf
Safe
4.92 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q5_K_M.gguf
Safe
5.73 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q6_K.gguf
Safe
6.6 GB
LFS
(Trained with Unsloth)
10 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q8_0.gguf
Safe
8.54 GB
LFS
(Trained with Unsloth)
10 months ago
