ymcki
/

Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3_1-Nemotron-51B-Instruct-GGUF

1 contributor

History: 17 commits

ymcki's picture

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf

f9826b0 verified 9 days ago

.gitattributes

2.35 kB

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf 9 days ago
Llama-3_1-Nemotron-51B-Instruct.Q3_K_S.gguf

22.7 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q3_K_S.gguf 21 days ago
Llama-3_1-Nemotron-51B-Instruct.Q4_0.gguf

29.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q4_0.gguf 20 days ago
Llama-3_1-Nemotron-51B-Instruct.Q4_0_4_8.gguf

29.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q4_0_4_8.gguf 20 days ago
Llama-3_1-Nemotron-51B-Instruct.Q4_K_M.gguf

31 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q4_K_M.gguf 21 days ago
Llama-3_1-Nemotron-51B-Instruct.Q5_K_M.gguf

36.5 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q5_K_M.gguf 18 days ago
Llama-3_1-Nemotron-51B-Instruct.Q6_K.gguf

42.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.Q6_K.gguf 19 days ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_M.gguf

23.5 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_M.gguf 10 days ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_S.gguf

22.7 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_S.gguf 10 days ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_0_4_8.gguf

29.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_0_4_8.gguf 9 days ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf

31 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf 9 days ago
README.md

4.78 kB

Upload README.md 18 days ago