Hugging Face's logo

MaziyarPanahi
/
gemma-2b-it-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
conversational
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
4
MaziyarPanahi commited on
Commit
314df4c
•
1 Parent(s): 0ecfb29

Upload folder using huggingface_hub (#3)

Browse files

- 6ed108ed477dc7dc58531747bac9e5fbb9048e06671637f9a53f56366d6b1fb3 (39e4fe49b1ad0cbd62854892052a680e85860a47)
- 7ca60c7873b913ef05dada65fde666396f804e084483014efc2cf4563276e075 (74197477a9eeac3baa7cdb5d4ac5c75ca8141c15)
- 1535a1e03e57dd1a4f5f0ec636ff44776d0432b50b4a4108078b29d7fbd45e91 (2a951a6562d6bd23ac49cf22d9b484af521051fa)
- 45f6bedbb018b878413e29f728b5400fd2a4247d06077b618ae451450ebd3c94 (de5cb9af72752fea1cfd4670de7b85dc3c9e09ac)
- 03dcea4edd0c2f3dd78c8746b42acd568b46228e8e5962d5ea5fd0f1e2f349a6 (c973724e05c3605dd3f6c038ce87e230f5cf936e)
- 1884e07dd734acfdd53d59ab15ec8b61fd0d39575d6e26c3986a4e489dc33e0e (fd49777bed62657e3a4af01d11adf5abe032362a)
- 9acce84781e9fae585e69765496cdd4702f946fab435b9de5801a3da1a7e41b7 (77eef2ec980db30ece299daa124654b6a42a287f)
- 636f760acb6333a9b24b81aec784cd89d65c6a3e97aee6a13332c619deb75206 (bc91565f89955f68bf635ffde17441d0cb7d5621)
- e6eb04bb6446bd695bd4264037f07e61af330c2806c5e0910f5724b636ab7d3c (4ae81ddca91f8b6cdefda18b6949afd486fb983c)
- fbc21d59b17e6497ee17c8cb32f964c9e392d93366252ee62945f7f7a46526b6 (184c5f1a6cf3ca09208a4004ce498e4e8a44989d)
- 1135f87f6e5a1be5c43eba63c33cff4327eb1f87d64b3aff335cdeae650dc6b8 (e72c0fc18d2b3e51e823958e22c24c09d64084cd)

Files changed (11) hide show
  1. gemma-2b-it.Q2_K.gguf +2 -2
  2. gemma-2b-it.Q3_K_L.gguf +2 -2
  3. gemma-2b-it.Q3_K_M.gguf +2 -2
  4. gemma-2b-it.Q3_K_S.gguf +2 -2
  5. gemma-2b-it.Q4_K_M.gguf +2 -2
  6. gemma-2b-it.Q4_K_S.gguf +2 -2
  7. gemma-2b-it.Q5_K_M.gguf +2 -2
  8. gemma-2b-it.Q5_K_S.gguf +2 -2
  9. gemma-2b-it.Q6_K.gguf +2 -2
  10. gemma-2b-it.Q8_0.gguf +2 -2
  11. gemma-2b-it.fp16.gguf +2 -2
gemma-2b-it.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f5db4cabdd0497c2e8c37e2f8e423f7392fb2c3e39652ce8df65e8311cc8ae1b
3
- size 899965856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ec957ac58fecffb2a136e246bc9de8bbb3fcbc5dc9b485d01408e34f84e8d21
3
+ size 1157924608
gemma-2b-it.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01f5b22c477092a7d48c193231497ee27cf10668f62bf0e5a81672d9c342c2ad
3
- size 1260907424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ea7ce67a5731aa52fb2ec2972dd53780cad3721f7c2b5e03d33d6f6f52c7e87
3
+ size 1465591552
gemma-2b-it.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:711c687a3b1a7dea7cafbba7f7d404e3089289cc36d3f22f58499e6acbfd1d5a
3
- size 1179118496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e1cb9d8079e9c211ca36c134310a3b92de11a0ccca84965aca17cc3f957d696
3
+ size 1383802624
gemma-2b-it.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9925113b1253500232bd85521a934ec89982c1f356f28917b169f2a4c19553dd
3
- size 1083296672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4bd057e64f66680ce9b73208c082907070410770ccd91a9e8f69eb8da71c793
3
+ size 1287980800
gemma-2b-it.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:76efa7b10f0b259dc1520d9b10b229cf0c5ced0dc5a58d71070930478062ea09
3
- size 1495245728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f551e32944bb95f79ff69f45271cb4f885b75b4b933dd547c69ba013688133ff
3
+ size 1630263040
gemma-2b-it.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a5c68b20b240c3770a2a681975281672658de43e3ed8a4426172c70d68cd4970
3
- size 1424823200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6b8e4901b657f14e893eaa681e2ede8581ad0e05f8a573b83125947301e55fb
3
+ size 1559840512
gemma-2b-it.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d66429c2455e7aeac1b1053d11317fbc951e0f893d7ac62b89004251702e33e9
3
- size 1770202016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3d2627482003a7e1e39fe646b22c9088d467e0ccda6e24e5879de230927d406
3
+ size 1839650560
gemma-2b-it.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ddfd2d0485d7397fd41c980ce9ccc9e417bd2a1720da5557164df4ba29dc8230
3
- size 1729467296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47416039e356c7c26f0bf692daa07f42739510e976b56a3993e8d7b045e9673e
3
+ size 1798915840
gemma-2b-it.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96824073d85c708f042588af4f22c8fb3a9e1630f21f7e8bc63777b88bcf8620
3
- size 2062343072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51b280b8e5c90bc5aa4d602150a6d861aa122778ece3757d0ce28fb82ba457e0
3
+ size 2062124800
gemma-2b-it.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec68b50d23469882716782da8b680402246356c3f984e9a3b9bcc5bc15273140
3
- size 2669351840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dae8a0a75dda3553c06af737adfff0c003ed1b6393932964cce72bb4f0fd41f6
3
+ size 2669070080
gemma-2b-it.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e858f591abebb789508f8fa4f1982bb7c818d8f711050f24d6e27a66fd6794d0
3
- size 10031780704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c369d545eebb0dc8d54b6780459ca72c23370b2eff90893dffb4f807ed2ba58
3
+ size 5018535616