--- license: apache-2.0 tags: - generated_from_trainer datasets: - emotion metrics: - accuracy - f1 model-index: - name: distilbert-base-uncased-finetuned-emotion results: - task: type: text-classification name: Text Classification dataset: name: emotion type: emotion args: default metrics: - type: accuracy value: 0.8885 name: Accuracy - type: f1 value: 0.8818845305609924 name: F1 - task: type: text-classification name: Text Classification dataset: name: emotion type: emotion config: default split: test metrics: - type: accuracy value: 0.892 name: Accuracy verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWVhMzFiY2MwZDI4MzdiODFjN2RhZjhmODI0Mzg0NWQ2NWZhNzhlYTM3OWJhZmQ4NzFiZGE3M2ZlY2RjMmJiOSIsInZlcnNpb24iOjF9.jbSW1cM0z_PfYbshDiwHFFUSJdQdf7jgNO2IOZg3aUrW-Mceo_xuSnE-kvAFpA6uDgRjAB_LVQiCoHITTUj8Bg - type: precision value: 0.8923475194643138 name: Precision Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmIwOTQyNmNlZjg3Nzc2MzlhODlhZjhmOGQxN2UxMzk1YjkwOGFkZjEyZWI3NjIwOTU4YzhmZWU0ZGE2NDZlYSIsInZlcnNpb24iOjF9.D5B7-ynkFzofI1uAJ-5LRA4kz2brI9rxQwSXgbiK2V0Sgtplsb6mI8qVAX2U1SsLNk4hxVArARiYNXReVwSOCw - type: precision value: 0.892 name: Precision Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMDQxZmE5N2NmNzU3MDc5NzQyYjdmZjMwNzI5ZTljN2FjOTY1ZTdlNTdjNzQyZWYwMWU0NmVjYjcxYjljZDViYiIsInZlcnNpb24iOjF9.KnY8MM6w-6NlK1rvtFqi3pxjnT1-EMu_GpXWQfDxj9djCrMtcL-V_XTScAtINJqm2sSvA84mZfKq9l4yBUUyBw - type: precision value: 0.894495118514709 name: Precision Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWM0NTcxMmZjMWE4OWNlOGI0YTUxM2I3ZWI3NjhkZmRiODEwMmEyYjc3ZmEwNjJhNzRhZjk2ODQyNTVlMGYwMCIsInZlcnNpb24iOjF9.ydHo8eHtjjKpoQgFlkg_0mUQJQitj_aM9Kk3-wVg8KQZFqVmIlKHMqZooCn-h9NWkDCWdt20tQwU1T7A9DuWCg - type: recall value: 0.768240931585822 name: Recall Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDcyZTJhYzYzMzgzNGZiZDIzYjFmMDY2YjAxMjkzMzEzMjZjZTUzZmQxYWM3YTg3NGYxY2E1ZDhmYjMwNjgzZCIsInZlcnNpb24iOjF9.0mgZPEfXHfbT1H3ysZ_IGgjxTsHJ86oFPevMXGK0es_-Y8ji8kAwf07CEjzHX0h74jK7TcbQjkDJAgje36NwCQ - type: recall value: 0.892 name: Recall Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzI2Mzk2NjAyYTc2MjRhMGNjODRiY2RmYmZkYTI5OWYyZGNkNGYyY2IzMzcxNWQ3NWQ0ZjNiNTE1NmVhOWU0NCIsInZlcnNpb24iOjF9.Z7Mhp-7UH6cJoDCz0Nhy66oKoB8Snf_2gyi0jW3p4Ioy84N8DCJ_hr7d9jyL4R97-l0FhiVSgsBODoAK5ShjDQ - type: recall value: 0.892 name: Recall Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDA3OWIwNWY2MTBjMTFkOThlOTIyNjU0MDljMTc5ZWIyMmZhYzQ4NjY3YjlmZjQ4ZDFmM2YwOTMyMjY3ZGFhMyIsInZlcnNpb24iOjF9.jD8s8JUzEKhypMUqTFqJ9BoiviKz9TQGJ_io1emmDOOgOg1I4E-NhEs61WvEmh0mzDX107SkT1xmqRryYqAkCw - type: f1 value: 0.7897026729904524 name: F1 Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTcwZTJkZDYyM2RmZjI1MTJmZmY5NDA1YzI0OWE5Y2Y0OTFlMmQwYzRiMWM1ODYzMjYxZDE1OTBlY2M5M2UxOSIsInZlcnNpb24iOjF9.G0cAm-rjG8t3w9iN4pt0_uFPo6D10BwS8Hr2cGg1D1HNUAr5CfoePflzVCfzQNBtnSiWXukKgSrSBjBc--YFDQ - type: f1 value: 0.892 name: F1 Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2JiN2ZlNDdjZDg1MDExZmY1YWFjZWEzNzdhYzY5NGM4YzcwNzVlMTA0MTFjMDE5ZjRlYzEyNThiN2Y3ZWQxZCIsInZlcnNpb24iOjF9.3dm3HY1jNlEeV35GkDWl5_YVqCJuWiRV3WZsxvmK7G5FuIbNK1rCY7wH89A_fswvgjK2VUJbsiyaADgiJb6PBw - type: f1 value: 0.8842367889371163 name: F1 Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGY1Mjc4YWFiZTRhN2YwZjg3NDE2MGI0MGEwMjNkNmFmZTEyYzUxZWY2YzZiN2E2YTM5MjZjNWQyOTUyY2ZkNyIsInZlcnNpb24iOjF9.Vo4GHfz8bwarnu1XhxK6Vwi5-AkYmbXGi4HiAsbcceNQ1Yw28wGcEbmwyy6drzFrAy0FinnxhE5JgVHSu4AbCw - type: loss value: 0.34626322984695435 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGFlY2RhZmVjNmYyZTM4OGEzYTk1NzY0ZTgwNmI4MTc3Yzc0MjI4ODQyNmQ5MjI0YTVhOWUzODE3Yjk4ZTQ0MyIsInZlcnNpb24iOjF9.IXY1qh3VA3PddbtJsU6DmBt8QcY7rjr-Mnunzh839semWGF4LLRSKHFWluS7QCHK0PYD-NiL7hz1Sxy4GBv8AA - task: type: text-classification name: Text Classification dataset: name: emotion type: emotion config: default split: validation metrics: - type: accuracy value: 0.8885 name: Accuracy verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDA4YjAzNGVkZGM4ZGFiNDdkOTJkZWRlNWI4NjQzZDI5Mjg2YzA2YWMwNzk3NGQyMWZiZDEzMGM0NmQ1ZDgwYiIsInZlcnNpb24iOjF9.NWtb2AaejmLY4FbHnatMoA_0PCZUG8LHAZF1_CbOjLo8t6fn_TVkrkRlGQ3UYCCgx1o1WDs-DZ5_ezQTtCyiDA - type: precision value: 0.8849064522901132 name: Precision Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNzkxZWI2Yjk0M2UwMzJlYTBjYmUxNmU2ZWQ4OGY1NmRmNzkwNjE0YWIyNDkzNDBkNjBhZWY0NWI4MDM0MDJmZiIsInZlcnNpb24iOjF9.KDvr_Jp8PFxYXsyD2MPJ9ojAi-RJ7_it_5Fsqa5G2Cz8Fh3-5dj7zwaQ4WoA5lCywwRPNuFiyTrBhpR4fvrqCw - type: precision value: 0.8885 name: Precision Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGM3MWNiMjRkZWMyMjUyYzhjNzQ3NGYzNzFlOTg5ZDBjMGM2OTFmMjc2MmVmNzkxYTNkYzQ4Y2Q5MWZhMjhmOCIsInZlcnNpb24iOjF9.3pO_CnJ0N2BrP7akQT-0bnWQs9SLt5uBczpSt2sgNLw5Is9owAc5_JN9VIKNlSwO5HwZ0PuUO61oHLvUvvTlDg - type: precision value: 0.8922726271705158 name: Precision Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2JlNGVlMjhlNjAwYTQ1ZGQ5NDdkYjgwNTYyOWFlOWY1MGVhOWM1YTdlMzE0ZTY5ZTRhYWQ4YTE3YzI3OTI3ZCIsInZlcnNpb24iOjF9.q7DlhONpdL282VbtYj6N6uIK2SJaZ_iVPMrZVxBDGZvAnWjtYkHpXn3XkwCMdk1Y5NY1kyjf12QVvbD4f2IdDA - type: recall value: 0.7854833401719518 name: Recall Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWZmOGQ2NTg2YzAzZDk1NDlhY2ZkOTQ4MmM1YmVjOWI2YThiZTY1YTI4YTM3YzAyOWVhMWY0MTdkMzM3NmRlOCIsInZlcnNpb24iOjF9.W8l1jKV0IQzxqa_QVft1TcLMrTD3SqKRshyUbXm9wnukB3rZ79GyxNNOEj9LuuwC6L4aAM7-HLjVUhqZNeALCA - type: recall value: 0.8885 name: Recall Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmUwNzBhNDU0MzhhYjA0ZWM2MDZlMjMxMGMzZjYyZDdhY2Q5NThmZjY3OTY1ZTQ5YjRkZWUxNTIyNDM1YWM4ZSIsInZlcnNpb24iOjF9.8cPiRUbGVZp8vQrorR1ZDRVkTV2oMvOO7A73Wy1IXpqxmSck-nHzl7ykHMe20bVDVvZI-9SdM3E49mSFFjbEDA - type: recall value: 0.8885 name: Recall Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTQyN2ZmYjI1Nzg4ZTNhYzY2ZmVhYmM1YjdlYjM3NGZkN2I5ZGQxMzFhNDBmYjk1ZWE1YWZlMDhmNWYwYjMyMiIsInZlcnNpb24iOjF9.f0CBrkSNlo4TUZHaAYVkEY-vlLzBRlgjkYxv0pECQAunL2j8KzmgWD62hT-I5GN2JwIM4Q-2jgsnhe8M0CurAg - type: f1 value: 0.8031492596189961 name: F1 Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDQ0MTc0ZDc3NzkwMDRmOWEzMjk3YzMyYzAxMjc1MjZjYWJlNTBiY2Y0MzU4MTZlMzE5NTIzYmFkODBmMDY1YyIsInZlcnNpb24iOjF9.d1RreO4g8vEMMNTDsubr-vYc1RY8a9ZZ9NkMrHO_IuJGKsINld2kV816ShF3yUaq1kpsfEBAZ9RAW377MCfoAA - type: f1 value: 0.8885 name: F1 Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMmRiZGU0MmYwOWNhNjAyYWJkNGVhZmVlZTcxOWU3ZjU0OTdhZTRiYjk0MGQ3NGEzNTI0NjY2YWQ0MWU2MjZlZCIsInZlcnNpb24iOjF9.-rSTxQZij1HzaqB_PwuWt4lNtkKYSnKVXAcu91MP-RXJ4Mp1tNcjXn2xWIqtgiswo0l67ocecRHmPT0mN_AXBw - type: f1 value: 0.8818845305609924 name: F1 Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjY5NjRlNzgzZWEzMTM2NDNhMjNjYTEzYWU2ZDM4ZWU0NjBjNWE2YTRhY2IwZTg4ZmI3MDE4MTE5YjRmNDMyZiIsInZlcnNpb24iOjF9.ZuoV1UrA2s13sIR4Vpgo55jEztl7AEUpv5h1V1XUrHppWAajyFGf5J6XkO5gdVGzgHloWqvE3dGj8xaCD3ynCw - type: loss value: 0.36373236775398254 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiN2Q4OTAwYjAwMTgyZmVjNGI5YTc3MGFhNTAwMmVkNWRjNDliNjg3MGZmZGU0ZWUxODhkMzdlNzlkZjc3ZWM0ZSIsInZlcnNpb24iOjF9.cPLKlukIu27h5-KSpp1u-TUH4HUlTlj2KxEh9SwNE_OzSMGRR3JbPtdl5uSP-9oSl3rKaLC-gmEI-5ytU3P2Bw --- # distilbert-base-uncased-finetuned-emotion This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the emotion dataset. It achieves the following results on the evaluation set: - Loss: 0.3663 - Accuracy: 0.8885 - F1: 0.8819 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 128 - eval_batch_size: 128 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 2 ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:| | No log | 1.0 | 125 | 0.5574 | 0.822 | 0.7956 | | 0.7483 | 2.0 | 250 | 0.3663 | 0.8885 | 0.8819 | ### Framework versions - Transformers 4.18.0 - Pytorch 1.10.1+cu111 - Datasets 2.1.0 - Tokenizers 0.12.1