Hugging Face's logo

latestissue
/
rwkv-6-finch-14b-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
latestissue commited on
Commit
f16e4d8
·
verified ·
1 Parent(s): a4beb54

Upload 9 files

Browse files
Files changed (9) hide show
  1. rwkv-6-finch-14b-IQ3_S.gguf +3 -0
  2. rwkv-6-finch-14b-IQ3_XXS.gguf +3 -0
  3. rwkv-6-finch-14b-IQ4_NL.gguf +3 -0
  4. rwkv-6-finch-14b-IQ4_XS.gguf +3 -0
  5. rwkv-6-finch-14b-Q2_K.gguf +3 -0
  6. rwkv-6-finch-14b-Q4_K.gguf +3 -0
  7. rwkv-6-finch-14b-Q4_K_S.gguf +3 -0
  8. rwkv-6-finch-14b-Q5_K.gguf +3 -0
  9. rwkv-6-finch-14b-Q5_K_S.gguf +3 -0
rwkv-6-finch-14b-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0d6ea2e40956cfd610236ac1c22d8b62b1799708d5ec966e1b82a88cfb1a53e
3
+ size 6741143904
rwkv-6-finch-14b-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:025cbda8e66103d5cd29b16e029c7be008f4bdde2c40db7784fc8a4090bada16
3
+ size 6080352608
rwkv-6-finch-14b-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f802b4d64a35245fa093793b9048c5352c3385deea904d4d6154b1e4d00c3fea
3
+ size 8548024672
rwkv-6-finch-14b-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22fb8b476ffbbb0ef0e062be3bc123b772f97808d6b7a09a4bddc73269f94e55
3
+ size 8122876256
rwkv-6-finch-14b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ff350d71e3937ffdb33c171b6bfe98642d5ac4fefd9d8a0b1dbaf2b2172b586
3
+ size 5359411552
rwkv-6-finch-14b-Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d09b20b911f43deb79c5d4d0896ced776c0469842b9bf3632d407fb46519714
3
+ size 8552022368
rwkv-6-finch-14b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afc546ca0d6c18a56827389b4ecc503f1c277a7a2be890f2f6be4706722a3226
3
+ size 8552022368
rwkv-6-finch-14b-Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85145a985c1c629af10d5b594c48bd94130b354ea38a868304ea2a96e63ae38d
3
+ size 10254614880
rwkv-6-finch-14b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7f0c8d5a59bb1d3578e1361fbc5ada7fb0bafa2c8851487e40f47f597f94be0
3
+ size 10254614880