Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Nemotron-Mini-4B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Use this model
6d8d285
Nemotron-Mini-4B-Instruct-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
49cfc2bd02c469400d0b58fab9f7723d6371e290fa50757c16ca87c05a6cf4e3
6d8d285
verified
about 1 month ago
.gitattributes
Safe
2.77 kB
49cfc2bd02c469400d0b58fab9f7723d6371e290fa50757c16ca87c05a6cf4e3
about 1 month ago
Nemotron-Mini-4B-Instruct-GGUF_imatrix.dat
3.15 MB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_M.gguf
Safe
1.41 GB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_S.gguf
Safe
1.37 GB
LFS
37695276bc25092722d6ea2ff275059c4ffbaf3b1f788d02b89347c320fcddce
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ2_XS.gguf
Safe
1.57 GB
LFS
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ3_XS.gguf
Safe
2.06 GB
LFS
53d7d3acbd3ba14815dceeebbfbb79ede82865d1d49173650c92dd61a0ce0a23
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ4_XS.gguf
Safe
2.46 GB
LFS
512b53fbcc8609b5d23a423afe029c03c528c079903692110ea5cfbeca0d1135
about 1 month ago
Nemotron-Mini-4B-Instruct.Q2_K.gguf
Safe
1.9 GB
LFS
445ed6a7c11d55df7599c751b7c94c27f5a5a5fcdf0ce457ca844c02a41c5797
about 1 month ago
Nemotron-Mini-4B-Instruct.Q3_K_L.gguf
Safe
2.45 GB
LFS
64c45d290a3ace069945a486543cc7b3c5f85358eb92ffc14e53799e6ea39583
about 1 month ago
Nemotron-Mini-4B-Instruct.Q3_K_M.gguf
Safe
2.3 GB
LFS
64c834ec4863091aaf5139289b9d73777edca2e8376c80fa781ccb45cc04e37d
about 1 month ago
Nemotron-Mini-4B-Instruct.Q3_K_S.gguf
Safe
2.12 GB
LFS
49cfc2bd02c469400d0b58fab9f7723d6371e290fa50757c16ca87c05a6cf4e3
about 1 month ago
Nemotron-Mini-4B-Instruct.Q4_K_M.gguf
Safe
2.7 GB
LFS
4462562151b84f12f619086465961488344b8bfbf47622f2a4a80f5aae8c7399
about 1 month ago
Nemotron-Mini-4B-Instruct.Q4_K_S.gguf
Safe
2.58 GB
LFS
8c362133a5ba4f641ecc9f01a6e5a8e2290ead9a26c9caab6f273ea59ad1fa29
about 1 month ago
Nemotron-Mini-4B-Instruct.Q5_K_M.gguf
Safe
3.06 GB
LFS
8abde736bf382707a03d84e182996c12f495b39c6b3ef5011a69bd8a7e55dd20
about 1 month ago
Nemotron-Mini-4B-Instruct.Q5_K_S.gguf
Safe
2.99 GB
LFS
1cbb08df3b859dc79e112763e1132932acea6c621194f3061c5259581fc3ae31
about 1 month ago
Nemotron-Mini-4B-Instruct.Q6_K.gguf
Safe
3.45 GB
LFS
d8b1b09a22d52b8981e3fed51b29151312e879e6b42823873f53892bad2b17a2
about 1 month ago
Nemotron-Mini-4B-Instruct.Q8_0.gguf
Safe
4.46 GB
LFS
72ef2170c6ce71d2a705fa2c9f3cdf0b019c527e348a2e3b454bfb1cc1c73d74
about 1 month ago
Nemotron-Mini-4B-Instruct.fp16.gguf
Safe
8.39 GB
LFS
0095ebdd58bceb4902eff9cbcfba5084d01ae4f34dfcdd129598029612ab5bbe
about 1 month ago
README.md
Safe
3.02 kB
49cfc2bd02c469400d0b58fab9f7723d6371e290fa50757c16ca87c05a6cf4e3
about 1 month ago