Hugging Face's logo

Lewdiculous
/
Sinerva_7B-GGUF-IQ-Imatrix

Transformers
GGUF
4 datasets
English
quantized
roleplay
imatrix
mistral
Merge
Eval Results
Model card Files Community
1
Lewdiculous commited on
Commit
cb22ffd
•
1 Parent(s): b60f8d1

Upload 6 files

Browse files
Files changed (7) hide show
  1. .gitattributes +5 -0
  2. Sinerva_7B-IQ3_M-imat.gguf +3 -0
  3. Sinerva_7B-IQ3_S-imat.gguf +3 -0
  4. Sinerva_7B-IQ3_XXS-imat.gguf +3 -0
  5. Sinerva_7B-IQ4_XS-imat.gguf +3 -0
  6. imatrix-with-rp-format-data.txt +0 -0
  7. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Sinerva_7B-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Sinerva_7B-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Sinerva_7B-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Sinerva_7B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
Sinerva_7B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b27755953c71648ef48d0dcce80b036ebe3af55262e0234cc68958a442606827
3
+ size 3284891360
Sinerva_7B-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:786fe30cb14ce1c77bd1203a57084e4f4bef3501df014cf8f100fed4b864535c
3
+ size 3182393056
Sinerva_7B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2a6ade2c19b800a2ff41c9b897657541729f24c049a7d97e69b5ad5d901197e
3
+ size 2827343584
Sinerva_7B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19cc46a195c7da99d48ef7ca3adef1b683ac5727c980dc2662738a2863af83cf
3
+ size 3907688160
imatrix-with-rp-format-data.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c30ff97ef6236e12b464f1d4acb2f2d752755060df9cf708b7dc8579bfed18d6
3
+ size 4988126