Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ukung
/
Small-Llama3-6B-GGUF
like
0
GGUF
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Small-Llama3-6B-GGUF
1 contributor
History:
15 commits
ukung
Upload Small-Llama3-6B-q6_k.gguf with huggingface_hub
e6a672c
verified
6 months ago
.gitattributes
2.4 kB
Upload Small-Llama3-6B-q6_k.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q2_k.gguf
2.54 GB
LFS
Upload Small-Llama3-6B-q2_k.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q3_k_l.gguf
3.41 GB
LFS
Upload Small-Llama3-6B-q3_k_l.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q3_k_m.gguf
3.18 GB
LFS
Upload Small-Llama3-6B-q3_k_m.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q3_k_s.gguf
2.91 GB
LFS
Upload Small-Llama3-6B-q3_k_s.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q4_0.gguf
3.68 GB
LFS
Upload Small-Llama3-6B-q4_0.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q4_1.gguf
4.04 GB
LFS
Upload Small-Llama3-6B-q4_1.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q4_k_m.gguf
3.87 GB
LFS
Upload Small-Llama3-6B-q4_k_m.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q4_k_s.gguf
3.7 GB
LFS
Upload Small-Llama3-6B-q4_k_s.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q5_0.gguf
4.4 GB
LFS
Upload Small-Llama3-6B-q5_0.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q5_1.gguf
4.76 GB
LFS
Upload Small-Llama3-6B-q5_1.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q5_k_m.gguf
4.5 GB
LFS
Upload Small-Llama3-6B-q5_k_m.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q5_k_s.gguf
4.4 GB
LFS
Upload Small-Llama3-6B-q5_k_s.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q6_k.gguf
5.16 GB
LFS
Upload Small-Llama3-6B-q6_k.gguf with huggingface_hub
6 months ago
Small-Llama3-6B-q8_0.gguf
6.69 GB
LFS
Upload Small-Llama3-6B-q8_0.gguf with huggingface_hub
6 months ago