smashmaster
commited on
Commit
•
dbcf774
1
Parent(s):
4228012
Update README.md
Browse files
README.md
CHANGED
@@ -3,6 +3,8 @@ license: gpl-3.0
|
|
3 |
---
|
4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
5 |
|
6 |
-
*
|
7 |
|
8 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
|
|
|
|
|
|
3 |
---
|
4 |
Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
|
5 |
|
6 |
+
* RWKV v4neo based, 20 epoch: Loss of about 2.7ish
|
7 |
|
8 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
|
9 |
+
|
10 |
+
* WIP v6 pretrain.
|