Can you make this model multilingual?
I want to report not an issue but a suggestion instead.
This model is just excellent. For a first time for 4 years, I can run something on my remote CPU server and see a decent quality with an incredible speed.
I see that the model possesses great translation capabilities. At least, it capable of translating from a random language to English. Unfortunately, there are numerous mistakes in translation. I don't expect to see a miracle. Yet, given the current capabilities of this excellent model, I see the next step in your fine-tunes is to add a multilingual support. In that case, it could be an exciting offline (local) translation tool available for running on CPU or shitty GPU.
You did a great job, and the multilingual capabilities would be a great option for your next release.
This is indeed an excellent model. My use case is for the Canadian market, and bilingualism is a must here. Transparently sourced + trained, coupled with multilingual capabilities would make olmoe a clear winner.