Hugging Face's logo

Lewdiculous
/
L3-8B-Stheno-v3.3-32K-GGUF-IQ-Imatrix

Transformers
GGUF
English
roleplay
llama3
sillytavern
conversational
Model card Files Community
1
Lewdiculous commited on
Commit
cfae478
•
1 Parent(s): 323e4f6

quants

Browse files
Files changed (9) hide show
  1. .gitattributes +7 -0
  2. L3-8B-Stheno-v3.3-32K-IQ3_M-imat.gguf +3 -0
  3. L3-8B-Stheno-v3.3-32K-IQ3_S-imat.gguf +3 -0
  4. L3-8B-Stheno-v3.3-32K-IQ3_XXS-imat.gguf +3 -0
  5. L3-8B-Stheno-v3.3-32K-IQ4_XS-imat.gguf +3 -0
  6. L3-8B-Stheno-v3.3-32K-Q4_K_M-imat.gguf +3 -0
  7. L3-8B-Stheno-v3.3-32K-Q4_K_S-imat.gguf +3 -0
  8. imatrix-with-rp-ex.txt +0 -0
  9. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ L3-8B-Stheno-v3.3-32K-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ L3-8B-Stheno-v3.3-32K-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ L3-8B-Stheno-v3.3-32K-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ L3-8B-Stheno-v3.3-32K-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ L3-8B-Stheno-v3.3-32K-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ L3-8B-Stheno-v3.3-32K-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
L3-8B-Stheno-v3.3-32K-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a850161b7940d1ddc66e7d45f4a87759c84c2f0db2cfdfe8e5784e3c9a16abbb
3
+ size 3784823488
L3-8B-Stheno-v3.3-32K-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf19edc8997b59cf19c670d1545d6013c6bd17950ec9a1841cf556c8ef0db283
3
+ size 3682325184
L3-8B-Stheno-v3.3-32K-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d36a978319cec3bdcec72bb316b1b0374c023402ce334a3c2a11e7a691bff3
3
+ size 3274912448
L3-8B-Stheno-v3.3-32K-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbc7ec7c996bbe8846161333d03d15a48f0b97cac2a5928e21409c2bec4a0d06
3
+ size 4447662784
L3-8B-Stheno-v3.3-32K-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e4aa208fa08b74b55413fb1c9ce127542c8692342ae9dc464142ae6b06b50e7
3
+ size 4920734400
L3-8B-Stheno-v3.3-32K-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0046a0ff8c727dce5acf25d7e696f3321f2562150b953b7cb94d265fd68bacdf
3
+ size 4692669120
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d3fee9b68df644d4748d6a3cd9b4c4a0dc96747849edd72aca428f10bbcdf91
3
+ size 4988180