metadata
library_name: transformers
base_model: michellejieli/emotion_text_classifier
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: emotion_predictor_for_emotion_chat_bot
results: []
emotion_predictor_for_emotion_chat_bot
This model is a fine-tuned version of michellejieli/emotion_text_classifier on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 0.5314
- Accuracy: 0.8377
- F1-score: 0.8526
- Num Input Tokens Seen: 114874880
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: constant
- lr_scheduler_warmup_ratio: 0.03
- num_epochs: 5
- mixed_precision_training: Native AMP
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1-score | Input Tokens Seen |
|---|---|---|---|---|---|---|
| No log | 1.0 | 5610 | 0.5620 | 0.8215 | 0.8298 | 22974976 |
| 0.8517 | 2.0 | 11220 | 0.5038 | 0.8496 | 0.8722 | 45949952 |
| 0.8517 | 3.0 | 16830 | 0.5476 | 0.8308 | 0.8432 | 68924928 |
| 0.837 | 4.0 | 22440 | 0.5194 | 0.8549 | 0.8797 | 91899904 |
| 0.837 | 5.0 | 28050 | 0.5314 | 0.8377 | 0.8526 | 114874880 |
Framework versions
- Transformers 4.44.2
- Pytorch 2.4.0+cu121
- Datasets 3.0.0
- Tokenizers 0.19.1