--- license: apache-2.0 base_model: google/flan-t5-base tags: - generated_from_trainer model-index: - name: t5-dialogue-classification-5 results: [] --- # t5-dialogue-classification-5 This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.6676 - Classification Report: precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7200 100 macro avg 0.4525 0.4798 0.4357 100 weighted avg 0.6752 0.7200 0.6721 100 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 7 - eval_batch_size: 7 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 20 ### Training results | Training Loss | Epoch | Step | Validation Loss | Classification Report | |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| | No log | 1.0 | 172 | 0.5114 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6667 1.0000 0.8000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7778 0.9545 0.8571 22 GENHX 0.4595 0.8500 0.5965 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5714 0.5714 0.5714 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SYSTEMS 0.0000 0.0000 0.0000 0 accuracy 0.6000 100 macro avg 0.2780 0.3155 0.2742 100 weighted avg 0.4742 0.6000 0.5072 100 | | No log | 2.0 | 344 | 0.3955 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.2500 0.3333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.4878 1.0000 0.6557 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6400 100 macro avg 0.3384 0.3247 0.3033 100 weighted avg 0.5829 0.6400 0.5644 100 | | 0.3535 | 3.0 | 516 | 0.3595 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9000 0.8182 0.8571 22 GENHX 0.6061 1.0000 0.7547 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11 accuracy 0.6500 100 macro avg 0.3516 0.3948 0.3423 100 weighted avg 0.6250 0.6500 0.6038 100 | | 0.3535 | 4.0 | 688 | 0.3475 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.2500 1.0000 0.4000 1 FAM/SOCHX 0.8077 0.9545 0.8750 22 GENHX 0.8000 1.0000 0.8889 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11 accuracy 0.7000 100 macro avg 0.3352 0.3912 0.3216 100 weighted avg 0.6602 0.7000 0.6546 100 | | 0.3535 | 5.0 | 860 | 0.3449 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7692 1.0000 0.8696 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11 accuracy 0.7200 100 macro avg 0.4388 0.4074 0.4049 100 weighted avg 0.7092 0.7200 0.6952 100 | | 0.0876 | 6.0 | 1032 | 0.3894 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.5000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9091 0.9091 0.9091 22 GENHX 0.6552 0.9500 0.7755 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11 accuracy 0.7100 100 macro avg 0.4570 0.4306 0.4151 100 weighted avg 0.7151 0.7100 0.6854 100 | | 0.0876 | 7.0 | 1204 | 0.3929 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.6667 0.5000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8077 0.9545 0.8750 22 GENHX 0.7600 0.9500 0.8444 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7000 100 macro avg 0.4494 0.4479 0.4026 100 weighted avg 0.7067 0.7000 0.6714 100 | | 0.0876 | 8.0 | 1376 | 0.5449 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7500 0.9000 0.8182 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.3333 1.0000 0.5000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.7100 100 macro avg 0.5131 0.5480 0.4930 100 weighted avg 0.6879 0.7100 0.6640 100 | | 0.0355 | 9.0 | 1548 | 0.5615 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 1.0000 0.2500 0.4000 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11 accuracy 0.7000 100 macro avg 0.4973 0.4101 0.4172 100 weighted avg 0.7249 0.7000 0.6720 100 | | 0.0355 | 10.0 | 1720 | 0.5021 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.5000 0.2500 0.3333 4 Accutane 0.0000 0.0000 0.0000 0 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7308 0.9500 0.8261 20 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11 accuracy 0.7200 100 macro avg 0.5077 0.5053 0.4746 100 weighted avg 0.7107 0.7200 0.6863 100 | | 0.0355 | 11.0 | 1892 | 0.5690 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 1.0000 0.2500 0.4000 4 Accutane 0.0000 0.0000 0.0000 0 CC 1.0000 0.7500 0.8571 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9565 1.0000 0.9778 22 GENHX 0.6667 1.0000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11 accuracy 0.7500 100 macro avg 0.5172 0.4925 0.4642 100 weighted avg 0.7572 0.7500 0.7194 100 | | 0.012 | 12.0 | 2064 | 0.6739 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 1.0000 0.5000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.6061 1.0000 0.7547 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11 accuracy 0.7200 100 macro avg 0.4879 0.4899 0.4535 100 weighted avg 0.6955 0.7200 0.6769 100 | | 0.012 | 13.0 | 2236 | 0.6173 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7100 100 macro avg 0.4511 0.4726 0.4315 100 weighted avg 0.6751 0.7100 0.6670 100 | | 0.012 | 14.0 | 2408 | 0.6580 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7100 100 macro avg 0.4630 0.4953 0.4465 100 weighted avg 0.6784 0.7100 0.6667 100 | | 0.0086 | 15.0 | 2580 | 0.6118 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7400 100 macro avg 0.4681 0.5119 0.4571 100 weighted avg 0.6896 0.7400 0.6883 100 | | 0.0086 | 16.0 | 2752 | 0.6210 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.7500 0.7500 0.7500 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8750 0.9545 0.9130 22 GENHX 0.7143 1.0000 0.8333 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11 accuracy 0.7400 100 macro avg 0.4759 0.5095 0.4612 100 weighted avg 0.6975 0.7400 0.6946 100 | | 0.0086 | 17.0 | 2924 | 0.6166 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6667 0.5000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2000 1.0000 0.3333 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11 accuracy 0.7100 100 macro avg 0.4544 0.4695 0.4300 100 weighted avg 0.6789 0.7100 0.6709 100 | | 0.0025 | 18.0 | 3096 | 0.6372 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7200 100 macro avg 0.4562 0.4798 0.4382 100 weighted avg 0.6742 0.7200 0.6714 100 | | 0.0025 | 19.0 | 3268 | 0.6598 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6000 0.7500 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7200 100 macro avg 0.4562 0.4798 0.4382 100 weighted avg 0.6742 0.7200 0.6714 100 | | 0.0025 | 20.0 | 3440 | 0.6676 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.2500 1.0000 0.4000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8333 0.4545 0.5882 11 accuracy 0.7200 100 macro avg 0.4525 0.4798 0.4357 100 weighted avg 0.6752 0.7200 0.6721 100 | ### Framework versions - Transformers 4.38.2 - Pytorch 2.1.0+cu121 - Datasets 2.18.0 - Tokenizers 0.15.2