Hugging Face's logo

smashmaster
/
RWKV-Piano-Experiments

Model card Files Community
1

Update README.md

#1
by smashmaster - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+6
-0
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -2,3 +2,9 @@
2
  license: gpl-3.0
3
  ---
4
  Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
 
 
 
 
 
 
 
2
  license: gpl-3.0
3
  ---
4
  Experiments on training 0.4B RWKV models around midi notation in a manner similar to [this already existing](https://huggingface.co/brianflakes/rwkv-midi-piano) midi model.
5
+
6
+ * RWKV v4neo based, 20 epoch: Loss of about 2.7ish
7
+
8
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6352287eef8786433ecdb736/zPg9n76e40lEl-HzF7TvF.png)
9
+
10
+ * WIP v6 pretrain.