Hugging Face's logo

KaleiNeely
/
fr-models

ONNX
Model card Files Community
KaleiNeely commited on
Commit
95f6a3d
•
1 Parent(s): 4152332

add rwkv-4 3b int4 model

Browse files

Signed-off-by: daquexian <daquexian566@gmail.com>

Files changed (3) hide show
  1. RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.bin +3 -0
  2. RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.config +9 -0
  3. RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.param +0 -0
RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68bd562923e42dd1f0a44bf48215bdb310583e77c7f282cd7ebd1df7f6e79815
3
+ size 2113558924
RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.config ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ version: 4
2
+ act_dtype: fp32
3
+ weight_dtype: int4
4
+ head_size: 0
5
+ n_layer: 32
6
+ n_embd: 2560
7
+ n_att: 2560
8
+ n_ffn: 0
9
+ ncnn_impl_version: 2
RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096/ncnn/int4/RWKV-4-World-CHNtuned-3B-v1-20230625-ctx4096-ncnn-int4.param ADDED
The diff for this file is too large to render. See raw diff