Perfect MoE's my write up, and help to you for making MoE's
#6 opened 6 months ago
by
rombodawg
![](https://cdn-avatars.huggingface.co/v1/production/uploads/642cc1c253e76b4c2286c58e/fGtQ_QeTjUgBhIT89dpUt.jpeg)
Quick Q: context size?
2
#2 opened 6 months ago
by
rboehme86
![](https://cdn-avatars.huggingface.co/v1/production/uploads/645600c94095c967f9a84ffc/uZeUPFFfJ69VugNUfRHY6.jpeg)
Training code?
1
#1 opened 6 months ago
by
asdaweqw12