Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Nemotron-Mini-4B-Instruct-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Use this model
dc0bd6a
Nemotron-Mini-4B-Instruct-GGUF
1 contributor
History:
4 commits
MaziyarPanahi
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
dc0bd6a
verified
about 1 month ago
.gitattributes
1.82 kB
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
about 1 month ago
Nemotron-Mini-4B-Instruct-GGUF_imatrix.dat
3.15 MB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_M.gguf
1.41 GB
LFS
202ac6eee0b55ddc5b3de0d6f8539ae062d302ccc0ab61ae2b983e234ffe299b
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ1_S.gguf
1.37 GB
LFS
37695276bc25092722d6ea2ff275059c4ffbaf3b1f788d02b89347c320fcddce
about 1 month ago
Nemotron-Mini-4B-Instruct.IQ2_XS.gguf
1.57 GB
LFS
6b7b4ad3f3a28b897665ec9a0c8128f29b7c35786f8b63fde98b1e19d7727d22
about 1 month ago
