John-Paul K.'s picture

John-Paul K.

johnpaulbin

AI & ML interests

None yet

Recent Activity

Organizations

Spaces-explorers's profile picture Training Transformers Together's profile picture Creative Sandbox for Education's profile picture Uberduck's profile picture Deep Class ORG's profile picture Vortex Interactive's profile picture

johnpaulbin's activity

reacted to BlinkDL's post with πŸ”₯ 4 days ago
view post
Post
1217
RWKV-7 "Goose" 0.4B trained w/ ctx4k automatically extrapolates to ctx32k+, and perfectly solves NIAH ctx16k 🀯 100% RNN and attention-free. Only trained on the Pile. No finetuning. Replicable training runs. tested by our community: https://github.com/Jellyfish042/LongMamba
liked a Space 18 days ago
updated a Space about 1 month ago