What is the difference between this leaderboard and the one in https://huggingface.co/spaces/sartifyllc/Swahili_LLM_Leaderboard?

#2
by zhiminy - opened

The name is the same...though

this is for swahili models !

Owner

Yes it is the same. But as we said early we are working to update the leaderboard. The team at sartify is working as we speak next month probably will come with new more swahili benchmark

this is for swahili models !

what is swahili model?

Owner

Can you share the model ID in HF

this is for swahili models !

what is swahili model?

model model trained in the swahili langauge !

As most models are eglish and for native speakers of other languages such as swahili or banbara etc hausa ,, xhorsa etc : there are no actul model trained in these languages ! ... hece we are trying to promote other languages such as the african languages groups !

as we as trul really poory represented as well as the data used for training models are not local informationn or even naligned with our hisorys in fact often they are omited from anny training :
I personally could not find the bible insode most models !
hennce i had to train it ! and whewn i begun it was very far from this data ! annd it was very hard to get a model to take the information in!
but now the bible is in !!!
even convertingn the model to swahili was not easy and i also left it because i had nobody also doing the same as me ! ( plus im using mistral model and not llama ! ... But i have trained the bible an dsome languages and hope they are indeed embedded but i do keep upfdating the models which i get space on a gpu with some african alpaca sets i have !

Sign up or log in to comment