Hugging Face's logo

latestissue
/
rwkv-6-world-7b-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
latestissue commited on
Commit
e4d3f6c
•
1 Parent(s): 0e23995

Upload 10 files

Browse files
Files changed (10) hide show
  1. rwkv-6-world-7b-bf16.gguf +3 -0
  2. rwkv-6-world-7b-f16.gguf +3 -0
  3. rwkv-6-world-7b-iq3_s.gguf +3 -0
  4. rwkv-6-world-7b-iq3_xxs.gguf +3 -0
  5. rwkv-6-world-7b-iq4_nl.gguf +3 -0
  6. rwkv-6-world-7b-iq4_xs.gguf +3 -0
  7. rwkv-6-world-7b-q2_k.gguf +3 -0
  8. rwkv-6-world-7b-q3_k.gguf +3 -0
  9. rwkv-6-world-7b-q3_k_l.gguf +3 -0
  10. rwkv-6-world-7b-q4_0_4_4.gguf +3 -0
rwkv-6-world-7b-bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b2c52fcdf4d524bc6fe9e83cff0a4b217f408cba7d2591bf4e42783d1a1f56e
3
+ size 15444915648
rwkv-6-world-7b-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:583726438cdd567a135350e56c11ec99a997cc45c7e9d07fe12d8f2cd9bfe3c9
3
+ size 15512024512
rwkv-6-world-7b-iq3_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3289f7cbaabf58b6213bacd6eed888a1a5827772e4f97e35314a1d2f02c387ac
3
+ size 3696539072
rwkv-6-world-7b-iq3_xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b245124cd97d69f13d9aebb9501c76090f8b72d25e6c53e8277cfbb26657d28
3
+ size 3332945344
rwkv-6-world-7b-iq4_nl.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc09e016311813361046bcc046a7d673efd4aac7773ab5ff16d70b7d8b2ab460
3
+ size 4661360064
rwkv-6-world-7b-iq4_xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eef95cdcc904eb2ea9640314b020fec1697d61d03a59fff19df0f723146cce0d
3
+ size 4434343360
rwkv-6-world-7b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f624c7808cb743a17dbe116a88053e04632332fb46f68ce7a38bc06326faaee6
3
+ size 2958734784
rwkv-6-world-7b-q3_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62bcdf3edf60ab35da8e610cb18b80e57681bf428394fe458af224cc8214cbbe
3
+ size 3696539072
rwkv-6-world-7b-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22510456640a266d285c3d685bc197a98832711f6c83a3ad29940946f15ea369
3
+ size 3696539072
rwkv-6-world-7b-q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f07394c113b3af5bcc61809236cc7688a7eb2497916060416b32614605e4c27
3
+ size 4661360064