bartowski
/

Nemotron-Mini-4B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Nemotron-Mini-4B-Instruct-GGUF

1 contributor

History: 10 commits

bartowski's picture

Upload Nemotron-Mini-4B-Instruct-Q4_K_S.gguf with huggingface_hub

53722f9 verified 2 months ago

.gitattributes

2.18 kB

Upload Nemotron-Mini-4B-Instruct-Q4_K_S.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q4_K_L.gguf

3.28 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q4_K_L.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q4_K_M.gguf

2.7 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q4_K_M.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q4_K_S.gguf

2.58 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q4_K_S.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q5_K_L.gguf

3.55 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q5_K_L.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q5_K_M.gguf

3.06 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q5_K_M.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q5_K_S.gguf

2.99 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q5_K_S.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q6_K.gguf

3.45 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q6_K.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q6_K_L.gguf

3.83 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q6_K_L.gguf with huggingface_hub 2 months ago
Nemotron-Mini-4B-Instruct-Q8_0.gguf

4.46 GB
LFS

Upload Nemotron-Mini-4B-Instruct-Q8_0.gguf with huggingface_hub 2 months ago