Which merge methods did you try?
#6 opened 6 months ago
by
alanchan808
Hybrid approach?
#5 opened 6 months ago
by
BlueNipples
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64bb1109aaccfd28b023bcec/fumfSHv9pnW1rMvgQeibP.png)
How did you fill the MoE gates?
2
#4 opened 7 months ago
by
ttkciar
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1661973791156-noauth.jpeg)
Nice work!
7
#3 opened 7 months ago
by
BrainSlugs83
Idea for the future - combine this with traditional merging
1
#2 opened 7 months ago
by
Henk717
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1640356718818-61c47e9c71a107e9d80e33e3.jpeg)
It works!!!
7
#1 opened 7 months ago
by
HoangHa
![](https://cdn-avatars.huggingface.co/v1/production/uploads/630a5ef0e81e1dea2cedcec0/ATtyCvYoX4z7uxsm2sJU2.png)