Hugging Face's logo

Lewdiculous
/
Bepis_9B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
1
Lewdiculous commited on
Commit
8f0d605
•
1 Parent(s): 4eeabc9

Add: IQ4

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. Bepis_9B-IQ4_NL-imat.gguf +3 -0
  3. Bepis_9B-IQ4_XS-imat.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,5 @@ Bepis_9B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Bepis_9B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Bepis_9B-IQ3_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Bepis_9B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
39
  Bepis_9B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Bepis_9B-IQ3_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Bepis_9B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Bepis_9B-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Bepis_9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
Bepis_9B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61bef5b3116fa4cee18b50acd98b820c4df3cfee74a9dbf18e5c03c7adfd7c17
3
+ size 5111621600
Bepis_9B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62d5ac258f930d1e871c1aa8234371c2a1207bdc15858a05804985adaab732e2
3
+ size 4840138720