ukung
/

Small-Llama3-6B-GGUF

Inference Endpoints

Model card Files Files and versions Community

Small-Llama3-6B-GGUF

Commit History

Upload Small-Llama3-6B-q6_k.gguf with huggingface_hub

e6a672c
verified

ukung commited on May 31

Upload Small-Llama3-6B-q5_k_m.gguf with huggingface_hub

1b64ec7
verified

ukung commited on May 31

Upload Small-Llama3-6B-q5_1.gguf with huggingface_hub

01541a3
verified

ukung commited on May 31

Upload Small-Llama3-6B-q3_k_m.gguf with huggingface_hub

d840da0
verified

ukung commited on May 31

Upload Small-Llama3-6B-q3_k_l.gguf with huggingface_hub

422e458
verified

ukung commited on May 31

Upload Small-Llama3-6B-q2_k.gguf with huggingface_hub

0315001
verified

ukung commited on May 31

Upload Small-Llama3-6B-q4_k_m.gguf with huggingface_hub

4a2c12e
verified

ukung commited on May 31

Upload Small-Llama3-6B-q4_1.gguf with huggingface_hub

a16aa20
verified

ukung commited on May 31

Upload Small-Llama3-6B-q5_k_s.gguf with huggingface_hub

4ff77cb
verified

ukung commited on May 31

Upload Small-Llama3-6B-q5_0.gguf with huggingface_hub

1a363bd
verified

ukung commited on May 31

Upload Small-Llama3-6B-q4_k_s.gguf with huggingface_hub

5e67d30
verified

ukung commited on May 31

Upload Small-Llama3-6B-q8_0.gguf with huggingface_hub

603b6ef
verified

ukung commited on May 31

Upload Small-Llama3-6B-q3_k_s.gguf with huggingface_hub

54bec1b
verified

ukung commited on May 31

Upload Small-Llama3-6B-q4_0.gguf with huggingface_hub

8500507
verified

ukung commited on May 31

initial commit

e579605
verified

ukung commited on May 31