Hugging Face's logo

Lewdiculous
/
Poppy_Porpoise-v0.7-L3-8B-GGUF-IQ-Imatrix

GGUF
English
roleplay
llama3
sillytavern
Inference Endpoints
Model card Files Community
1
Lewdiculous commited on
Commit
4dc8e94
•
1 Parent(s): b2b755c

New quants!

Browse files
Files changed (13) hide show
  1. Poppy_Porpoise-v0.7-L3-8B-F16.gguf +3 -0
  2. Poppy_Porpoise-v0.7-L3-8B-IQ3_M-imat.gguf +3 -0
  3. Poppy_Porpoise-v0.7-L3-8B-IQ3_XXS-imat.gguf +3 -0
  4. Poppy_Porpoise-v0.7-L3-8B-IQ4_NL-imat.gguf +3 -0
  5. Poppy_Porpoise-v0.7-L3-8B-IQ4_XS-imat.gguf +3 -0
  6. Poppy_Porpoise-v0.7-L3-8B-Q4_K_M-imat.gguf +3 -0
  7. Poppy_Porpoise-v0.7-L3-8B-Q4_K_S-imat.gguf +3 -0
  8. Poppy_Porpoise-v0.7-L3-8B-Q5_K_M-imat.gguf +3 -0
  9. Poppy_Porpoise-v0.7-L3-8B-Q5_K_S-imat.gguf +3 -0
  10. Poppy_Porpoise-v0.7-L3-8B-Q6_K-imat.gguf +3 -0
  11. Poppy_Porpoise-v0.7-L3-8B-Q8_0-imat.gguf +3 -0
  12. imatrix-with-rp-ex.txt +0 -0
  13. imatrix.dat +3 -0
Poppy_Porpoise-v0.7-L3-8B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab33f0920d2e896ff1fad8c51b3e90dddfdef3a25b28b4add2460aaf32d6093a
3
+ size 16068890432
Poppy_Porpoise-v0.7-L3-8B-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d437e3749854e109ac8c6d31a0816cce768c5a7b3dbd21ece62377e252e5586
3
+ size 3784822944
Poppy_Porpoise-v0.7-L3-8B-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db5e01543c46509a3098b6965f9851f7d5b880af1a806372c5769d1eaf5643a3
3
+ size 3274911904
Poppy_Porpoise-v0.7-L3-8B-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4d11cedd9b2a3eeb944b9880db4d7f5ca0e28897fcce49e91e776ba2c933b78
3
+ size 4677988512
Poppy_Porpoise-v0.7-L3-8B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6e7805683879e6dc5b7812b6c522e61424f5a99973fa921ded2c9482790c7b7
3
+ size 4447662240
Poppy_Porpoise-v0.7-L3-8B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36b942f13fbf20715e8a2fb789cd84b5b470e7634cda270fd8808ee0484bad28
3
+ size 4920733856
Poppy_Porpoise-v0.7-L3-8B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e69a3c7e18927dcafc21df8c49311750578d4c1b6e7193f2aa056d9a9b9cb747
3
+ size 4692668576
Poppy_Porpoise-v0.7-L3-8B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba2684fb40c6db245980cf6b50d4f2ce7376b4696d00ba493c7164e32d37c4ae
3
+ size 5732987040
Poppy_Porpoise-v0.7-L3-8B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e61f313649ff650e964d166ee296344c679de91e74aebf1c204ad3174832fe6
3
+ size 5599293600
Poppy_Porpoise-v0.7-L3-8B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fa0615df4532c274fcdd99feadc533548efbf2b6cb5de80f332c45d1bf9245f
3
+ size 6596006048
Poppy_Porpoise-v0.7-L3-8B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c56886f4d5feccf56e5b7785ffbf2121422dcd4c671259f77468c2c40510ea5
3
+ size 8540770464
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f23fe88cf6142f4b1a03eeb356f14300923a444045a5c9b1e2950233f1b810b
3
+ size 4988187