xaskasdf
/

llama-3.1-8b-instruct-07-24-gguf

Inference Endpoints

Model card Files Files and versions Community

llama-3.1-8b-instruct-07-24-gguf

1 contributor

History: 3 commits

xaskasdf's picture

Uploaded imatrix/quantized weights

c7698ee verified 6 months ago

.gitattributes

2.13 kB

Uploaded imatrix/quantized weights 6 months ago
README.md

29 Bytes

initial commit 6 months ago
llama-3.1-8b-instruct-f16.gguf

16.1 GB
LFS

Sync converted/quantized weights 6 months ago
llama-3.1-8b-instruct-iq1_m.gguf

2.85 GB
LFS

Uploaded imatrix/quantized weights 6 months ago
llama-3.1-8b-instruct-iq2_xxs.gguf

3.09 GB
LFS

Uploaded imatrix/quantized weights 6 months ago
llama-3.1-8b-instruct-q2_k.gguf

3.8 GB
LFS

Sync converted/quantized weights 6 months ago
llama-3.1-8b-instruct-q2_k_s.gguf

3.61 GB
LFS

Uploaded imatrix/quantized weights 6 months ago
llama-3.1-8b-instruct-q4_k.gguf

5.54 GB
LFS

Sync converted/quantized weights 6 months ago
llama-3.1-8b-instruct-q6_k.gguf

7.22 GB
LFS

Sync converted/quantized weights 6 months ago
llama-3.1-8b-instruct-q8_0.gguf

9.03 GB
LFS

Sync converted/quantized weights 6 months ago
llama-3.1-instruct.imatrix

4.99 MB
LFS

Uploaded imatrix/quantized weights 6 months ago