Hugging Face's logo

MarsupialAI
/
Gemmasutra-Mini-2B-v1_iMatrix_GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
MarsupialAI commited on
Commit
b0d4445
·
verified ·
1 Parent(s): 90358e0

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Gemmasutra-Mini-2B-v1_Q5km.gguf +3 -0
  3. Gemmasutra-Mini-2B-v1_Q6k.gguf +3 -0
  4. Gemmasutra-Mini-2B-v1_iQ2xxs.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,6 @@ Gemmasutra-Mini-2B-v1_Q3km.gguf filter=lfs diff=lfs merge=lfs -text
38
  Gemmasutra-Mini-2B-v1_Q4km.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemmasutra-Mini-2B-v1_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
40
  Gemmasutra-Mini-2B-v1_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
38
  Gemmasutra-Mini-2B-v1_Q4km.gguf filter=lfs diff=lfs merge=lfs -text
39
  Gemmasutra-Mini-2B-v1_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
40
  Gemmasutra-Mini-2B-v1_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Gemmasutra-Mini-2B-v1_iQ2xxs.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Gemmasutra-Mini-2B-v1_Q5km.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Gemmasutra-Mini-2B-v1_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1_Q5km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c636313cf14689d6198169d6c2cd05200e61b86883b27f7900803f4b4fb5457e
3
+ size 1923278432
Gemmasutra-Mini-2B-v1_Q6k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db64e7df4c9b984e96d5dd11632f199b3932f9c27d3763a0e31f89b05d5116f9
3
+ size 2151392864
Gemmasutra-Mini-2B-v1_iQ2xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6f1a4bedf7c4ce6cf26c94026bdc1d2f426441fd504fa3d5d71faa139a8c7f9
3
+ size 943193696