Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
gemma-gemma-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
arxiv:2212.04089
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
39b0166
gemma-gemma-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
8071a4e3ea891d28665d4fb1d5ee2fec5e55513670298dce90d9ac43fac76084
39b0166
verified
5 months ago
.gitattributes
2 kB
8071a4e3ea891d28665d4fb1d5ee2fec5e55513670298dce90d9ac43fac76084
5 months ago
gemma-gemma.Q2_K.gguf
2.72 GB
LFS
ea66ff7306bd9c1bcdea3b6831764cc69ec238539df67997a288e9b94e8502a2
5 months ago
gemma-gemma.Q3_K_L.gguf
3.82 GB
LFS
22b3b5c48982d66467c138836745a58862086334d236034e90d25169202e5f58
5 months ago
gemma-gemma.Q3_K_M.gguf
3.52 GB
LFS
22dee436771024ff5ee7907acffe31ca1ee5a86fd852cc03fb349e0d1ff231fd
5 months ago
gemma-gemma.Q3_K_S.gguf
3.16 GB
LFS
f58c6e2ad4b6d53492b48919500d912c8f1078070ab5d12d90da734eb9d4275c
5 months ago
gemma-gemma.Q4_K_M.gguf
4.37 GB
LFS
71d85bf1b5f5cdfcb6e09791ea783cbc114578c792a875f756bfb60ae075a34b
5 months ago
gemma-gemma.Q4_K_S.gguf
4.14 GB
LFS
06c5c74ee0c02459466567ef8c98842ddc50772a5ef137d84e8abbfc71980a6a
5 months ago
gemma-gemma.Q5_K_M.gguf
5.13 GB
LFS
707cdcdcca28e20be0f070c629547e75661141567811382ade4c6ceb44c04875
5 months ago
gemma-gemma.Q5_K_S.gguf
5 GB
LFS
8071a4e3ea891d28665d4fb1d5ee2fec5e55513670298dce90d9ac43fac76084
5 months ago
