xaskasdf
/

llama-3.1-8b-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-8b-instruct-gguf

1 contributor

History: 4 commits

xaskasdf's picture

Upload quantized models

51ccf50 verified 5 months ago

.gitattributes

2.33 kB

Upload quantized models 5 months ago
README.md

29 Bytes

initial commit 5 months ago
llama-3.1-8b-instruct-f16.gguf

16.1 GB
LFS

Upload converted model 5 months ago
llama-3.1-8b-instruct-iq1_m.gguf

2.85 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-iq2_xxs.gguf

3.09 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-q2_k.gguf

3.8 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-q3_k.gguf

4.64 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-q4_0.gguf

5.28 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-q4_k.gguf

5.54 GB
LFS

Upload heavily quantized models and importance matrix 5 months ago
llama-3.1-8b-instruct-q5_0.gguf

6.22 GB
LFS

Upload quantized models 5 months ago
llama-3.1-8b-instruct-q5_k.gguf

6.35 GB
LFS

Upload quantized models 5 months ago
llama-3.1-8b-instruct-q6_k.gguf

7.22 GB
LFS

Upload quantized models 5 months ago
llama-3.1-8b-instruct-q8_0.gguf

9.03 GB
LFS

Upload quantized models 5 months ago
llama-3.1-instruct.imatrix

4.99 MB
LFS

Upload heavily quantized models and importance matrix 5 months ago