BlinkDL
/

rwkv-4-pile-7b

Text Generation

Model card Files Files and versions Community

BlinkDL commited on Mar 14, 2023

Commit

9024fcb

•

1 Parent(s): 2bb4c10

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ n_layer = 32
 n_embd = 4096
 RWKV-4-Pile-7B-20230109-ctx4096.pth : Fine-tuned to ctx_len 4096.
-* Likely better. Please test.
 RWKV-4-Pile-7B-20230xxx-ctx8192-testxxx : Fine-tuned to ctx_len 8192.
 * Slightly weaker than ctx4096 model when ctxlen < 3k.

 n_embd = 4096
 RWKV-4-Pile-7B-20230109-ctx4096.pth : Fine-tuned to ctx_len 4096.
+* Likely the best. Please test.
 RWKV-4-Pile-7B-20230xxx-ctx8192-testxxx : Fine-tuned to ctx_len 8192.
 * Slightly weaker than ctx4096 model when ctxlen < 3k.