Update README.md
Browse files
README.md
CHANGED
@@ -35,4 +35,4 @@ Final checkpoint: RWKV-4-Pile-3B-20221008-8023.pth : Trained on the Pile for 331
|
|
35 |
* Hellaswag acc_norm 59.63%
|
36 |
* ctx_len = 1024 n_layer = 32 n_embd = 2560
|
37 |
|
38 |
-
##
|
|
|
35 |
* Hellaswag acc_norm 59.63%
|
36 |
* ctx_len = 1024 n_layer = 32 n_embd = 2560
|
37 |
|
38 |
+
## Note: 4 / 4a / 4b models ARE NOT compatible. Use RWKV-4 unless you know what you are doing.
|