widget:
- text: >-
My name is Mark and I live in London. I am a postgraduate student at Queen
Mary University.
language:
- en
license: mit
Multilingual Hate Speech Classifier for Social Media Content
A multilingual model for hate speech classification of social media content. The model is based on pre-trained multilingual representations from the XLM-T model (https://arxiv.org/abs/2104.12250) and was jointly fine-tuned on five languages, namely Arabic, Croatian, English, German and Slovenian. The test results on these five languages in terms of F1 score are as follows:
| Language | F1 |
|---|---|
| Arabic | 0.8704 |
| Croatian | 0.7226 |
| English | 0.7851 |
| German | 0.7826 |
| Slovenian | 0.7596 |
Tokenizer
During training the text was preprocessed using the original XLM-T tokenizer. The pretrained tokenizer files are included in this repository. We suggest the same tokenizer is used for inference.
Model output
The model classifies each input into one of two distinct classes:
- 0 - not-offensive
- 1 - offensive
##Acknowledgments
The [sub-granted project acronym] has indirectly received funding from the European Union’s Horizon 2020 research and innovation action programme, via the AI4Media Open Call #1 issued and executed under the AI4Media project (Grant Agreement no. 951911).