Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
gemma-2-2b-it-GGUF
like
6
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
0fc0f13
gemma-2-2b-it-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
48301450a17e467b02d12a71fdd811af6b6802e7c744bc444a427caf81bfab6c
0fc0f13
verified
4 months ago
.gitattributes
Safe
2.39 kB
48301450a17e467b02d12a71fdd811af6b6802e7c744bc444a427caf81bfab6c
4 months ago
README.md
Safe
2.9 kB
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
4 months ago
gemma-2-2b-it-GGUF_imatrix.dat
Safe
2.38 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
4 months ago
gemma-2-2b-it.IQ1_M.gguf
Safe
874 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
4 months ago
gemma-2-2b-it.IQ1_S.gguf
Safe
832 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
4 months ago
gemma-2-2b-it.IQ2_XS.gguf
Safe
1 GB
LFS
cb17e85d5ab528a85293a20eedcdcc76dcb576a100ef23d080ac257c6e23197e
4 months ago
gemma-2-2b-it.IQ3_XS.gguf
Safe
1.31 GB
LFS
00930c810dae5ee21d800001c8eb54d596e44b44c209ac4bd2555816d6563657
4 months ago
gemma-2-2b-it.IQ4_XS.gguf
Safe
1.57 GB
LFS
5c5d3d9826daea4f735396576486dcd2d3a51ccb9fee44374656729c87722a78
4 months ago
gemma-2-2b-it.Q2_K.gguf
Safe
1.23 GB
LFS
6f35c4732f45b9171ca358d94bcc86339be441d7e69b591b9976d9c45caaf2e6
4 months ago
gemma-2-2b-it.Q3_K_L.gguf
Safe
1.55 GB
LFS
a67683eece004931bf45bba27ca1e8fc6947029070155e9924bfaf1494fb09c8
4 months ago
gemma-2-2b-it.Q3_K_M.gguf
Safe
1.46 GB
LFS
1f894e5e2276fee462f3da54dd44ffc789bda5d8ca578813f57532d93a914af8
4 months ago
gemma-2-2b-it.Q3_K_S.gguf
Safe
1.36 GB
LFS
e2f6ddbd3ea40b62d4906898b7f98da97be238fe914f41255dc114e2dd19b66b
4 months ago
gemma-2-2b-it.Q4_K_M.gguf
Safe
1.71 GB
LFS
db4793720fc115fbd12b222a721bd8858f2bc82066ed0362ae230ee5e550222f
4 months ago
gemma-2-2b-it.Q4_K_S.gguf
Safe
1.64 GB
LFS
511e6e3ce16bfd58929a106dc5c332c3939c3e9c20f095510de0240496aa0ef0
4 months ago
gemma-2-2b-it.Q5_K_M.gguf
Safe
1.92 GB
LFS
4dcdbcba887dc20544b7d0302992b42bf8622ef0a52aba2b6722712e6b41a719
4 months ago
gemma-2-2b-it.Q6_K.gguf
Safe
2.15 GB
LFS
48301450a17e467b02d12a71fdd811af6b6802e7c744bc444a427caf81bfab6c
4 months ago