Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
bartowski
/
gemma-2-9b-it-GGUF
like
185
Text Generation
Transformers
GGUF
conversational
Inference Endpoints
License:
gemma
Model card
Files
Files and versions
Community
12
Train
Deploy
Use this model
08c1171
gemma-2-9b-it-GGUF
1 contributor
History:
3 commits
bartowski
Update README.md
08c1171
verified
4 months ago
.gitattributes
2.93 kB
Llamacpp quants
4 months ago
README.md
8.16 kB
Update README.md
4 months ago
gemma-2-9b-it-IQ2_M.gguf
3.43 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ2_S.gguf
3.21 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ2_XS.gguf
3.07 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ3_M.gguf
4.49 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ3_XS.gguf
4.15 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ3_XXS.gguf
3.8 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-IQ4_XS.gguf
5.18 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q2_K.gguf
3.81 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q3_K_L.gguf
5.13 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q3_K_M.gguf
4.76 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q3_K_S.gguf
4.34 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q4_K_L.gguf
6.84 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q4_K_M.gguf
5.76 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q4_K_S.gguf
5.48 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q5_K_L.gguf
7.73 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q5_K_M.gguf
6.65 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q5_K_S.gguf
6.48 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q6_K.gguf
7.59 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q6_K_L.gguf
8.67 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q8_0.gguf
9.83 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-Q8_0_L.gguf
10.7 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it-f32.gguf
37 GB
LFS
Llamacpp quants
4 months ago
gemma-2-9b-it.imatrix
6.12 MB
LFS
Llamacpp quants
4 months ago