Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
akumaburn
/
llama-3-8b-bnb-4bit-GGUF
like
4
Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
llama-3-8b-bnb-4bit-GGUF
1 contributor
History:
17 commits
akumaburn
(Trained with Unsloth)
e227d44
verified
9 months ago
.gitattributes
Safe
2.08 kB
(Trained with Unsloth)
9 months ago
README.md
Safe
659 Bytes
Update README.md
9 months ago
config.json
Safe
29 Bytes
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.F16.gguf
Safe
16.1 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q2_K.gguf
Safe
3.18 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q3_K_M.gguf
Safe
4.02 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q4_K_M.gguf
Safe
4.92 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q5_K_M.gguf
Safe
5.73 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q6_K.gguf
Safe
6.6 GB
LFS
(Trained with Unsloth)
9 months ago
llama-3-8b-bnb-4bit-GGUF-unsloth.Q8_0.gguf
Safe
8.54 GB
LFS
(Trained with Unsloth)
9 months ago
