Working on a x8 MoE of this...
https://huggingface.co/dillfrescott/silicon-maid-7b-x8-MoE
Files should be uploaded within the next hour or less!
Appears its having some tokenizer issues. Please stand by. I may have to reupload it if i can figure out whats going on
I fixed it. Going to delete the old repo and make a new one with the fix
https://huggingface.co/dillfrescott/silicon-maid-7b-x8-MoE-v2
New fix will be here
Whoa, impressive! I suspect it'll need some training to get up to speed but let me know how it flies 😄
It actually works very well. I dont know by how much or if its smarter than the original but it works!!!
It actually works very well. I dont know by how much or if its smarter than the original but it works!!!
Do you have any side-by-side comparisons of output?
I do not. Sorry. Id have to run those side-by-side tests sometime.