| # Fine-tuned XLM-R Model for slovak Sentiment Analysis | |
| This is a fine-tuned XLM-R model for sentiment analysis in slovak. | |
| ## Model Details | |
| - **Model Name**: XLM-R Sentiment Analysis | |
| - **Language**: slovak | |
| - **Fine-tuning Dataset**: DGurgurov/slovak_sa | |
| ## Training Details | |
| - **Epochs**: 20 | |
| - **Batch Size**: 32 (train), 64 (eval) | |
| - **Optimizer**: AdamW | |
| - **Learning Rate**: 5e-5 | |
| ## Performance Metrics | |
| - **Accuracy**: 0.96833 | |
| - **Macro F1**: 0.93172 | |
| - **Micro F1**: 0.96833 | |
| ## Usage | |
| To use this model, you can load it with the Hugging Face Transformers library: | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForSequenceClassification | |
| tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_slovak_sentiment") | |
| model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_slovak_sentiment") | |
| ``` | |
| ## License | |
| [MIT] | |