Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Nemotron-Mini-4B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Use this model
2a1e0fe
Nemotron-Mini-4B-Instruct-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
445ed6a7c11d55df7599c751b7c94c27f5a5a5fcdf0ce457ca844c02a41c5797
2a1e0fe
verified
about 1 month ago
.gitattributes
2.19 kB
445ed6a7c11d55df7599c751b7c94c27f5a5a5fcdf0ce457ca844c02a41c5797
about 1 month ago
Nemotron-Mini-4B-Instruct-GGUF_imatrix.dat
3.15 MB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_M.gguf
1.41 GB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_S.gguf
1.37 GB
LFS
37695276bc25092722d6ea2ff275059c4ffbaf3b1f788d02b89347c320fcddce
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ2_XS.gguf
1.57 GB
LFS
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ3_XS.gguf
2.06 GB
LFS
53d7d3acbd3ba14815dceeebbfbb79ede82865d1d49173650c92dd61a0ce0a23
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ4_XS.gguf
2.46 GB
LFS
512b53fbcc8609b5d23a423afe029c03c528c079903692110ea5cfbeca0d1135
about 1 month ago
Nemotron-Mini-4B-Instruct.Q2_K.gguf
1.9 GB
LFS
445ed6a7c11d55df7599c751b7c94c27f5a5a5fcdf0ce457ca844c02a41c5797
about 1 month ago
Nemotron-Mini-4B-Instruct.Q3_K_L.gguf
2.45 GB
LFS
64c45d290a3ace069945a486543cc7b3c5f85358eb92ffc14e53799e6ea39583
about 1 month ago
Nemotron-Mini-4B-Instruct.Q3_K_M.gguf
2.3 GB
LFS
64c834ec4863091aaf5139289b9d73777edca2e8376c80fa781ccb45cc04e37d
about 1 month ago