Hugging Face's logo

bartowski
/
Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation
GGUF
vllm
sparsity
Inference Endpoints
Model card Files Community
1
Sparse-Llama-3.1-8B-2of4-GGUF

Commit History

Upload Sparse-Llama-3.1-8B-2of4.imatrix with huggingface_hub
fbbf40a
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-f16.gguf with huggingface_hub
80a9144
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-IQ2_M.gguf with huggingface_hub
6b1940f
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q2_K.gguf with huggingface_hub
0cd9c20
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q2_K_L.gguf with huggingface_hub
41f59b7
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-IQ3_XS.gguf with huggingface_hub
0a18f5c
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q3_K_S.gguf with huggingface_hub
eb47615
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-IQ3_M.gguf with huggingface_hub
4cc1ccc
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q3_K_M.gguf with huggingface_hub
06ccc95
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q3_K_L.gguf with huggingface_hub
4c19909
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q3_K_XL.gguf with huggingface_hub
9ffae82
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-IQ4_XS.gguf with huggingface_hub
f4de716
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_0.gguf with huggingface_hub
b2e8122
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_0_4_4.gguf with huggingface_hub
8c48d65
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_0_4_8.gguf with huggingface_hub
1615e43
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_0_8_8.gguf with huggingface_hub
78d6d64
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_K_S.gguf with huggingface_hub
2895db6
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_K_M.gguf with huggingface_hub
a471744
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q4_K_L.gguf with huggingface_hub
4af2fc6
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q5_K_S.gguf with huggingface_hub
0c56970
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q5_K_M.gguf with huggingface_hub
73e5b86
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q5_K_L.gguf with huggingface_hub
fba8b89
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q6_K.gguf with huggingface_hub
98064dc
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q6_K_L.gguf with huggingface_hub
8dc8014
verified

bartowski commited on

Upload Sparse-Llama-3.1-8B-2of4-Q8_0.gguf with huggingface_hub
5592c22
verified

bartowski commited on

initial commit
6b0dfff
verified

bartowski commited on