--- license: apache-2.0 base_model: google/flan-t5-base tags: - generated_from_trainer model-index: - name: t5-dialogue-classification-enriched-base results: [] --- # t5-dialogue-classification-enriched-base This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.9946 - Classification Report: precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.5714 0.3636 0.4444 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7550 200 macro avg 0.5124 0.5720 0.5187 200 weighted avg 0.7301 0.7550 0.7344 200 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 2 - eval_batch_size: 2 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 20 ### Training results | Training Loss | Epoch | Step | Validation Loss | Classification Report | |:-------------:|:-----:|:-----:|:---------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| | 0.612 | 1.0 | 601 | 0.3791 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2000 0.4545 0.2778 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8462 0.9778 0.9072 45 GENHX 0.7627 0.8491 0.8036 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 1.0000 0.8333 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.4706 0.5926 17 accuracy 0.7100 200 macro avg 0.2947 0.3263 0.3028 200 weighted avg 0.6422 0.7100 0.6648 200 | | 0.2185 | 2.0 | 1202 | 0.3511 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5000 0.4545 0.4762 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8627 0.9778 0.9167 45 GENHX 0.8679 0.8679 0.8679 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 1.0000 0.8333 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4800 0.8571 0.6154 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8125 0.7647 0.7879 17 well developed 0.0000 0.0000 0.0000 0 accuracy 0.7550 200 macro avg 0.3764 0.3923 0.3788 200 weighted avg 0.7067 0.7550 0.7240 200 | | 0.2103 | 3.0 | 1803 | 0.5588 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.3636 0.3810 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8800 0.9778 0.9263 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4444 0.8571 0.5854 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8182 0.5294 0.6429 17 accuracy 0.7350 200 macro avg 0.4199 0.4947 0.4393 200 weighted avg 0.6857 0.7350 0.7005 200 | | 0.1329 | 4.0 | 2404 | 0.5146 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.4615 0.5455 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8246 0.8868 0.8545 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 accuracy 0.7650 200 macro avg 0.4826 0.5108 0.4800 200 weighted avg 0.7292 0.7650 0.7370 200 | | 0.0896 | 5.0 | 3005 | 0.5567 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8246 0.8868 0.8545 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.2500 1.0000 0.4000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.7059 0.6857 17 accuracy 0.7650 200 macro avg 0.5221 0.5562 0.5219 200 weighted avg 0.7289 0.7650 0.7386 200 | | 0.058 | 6.0 | 3606 | 0.5499 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.6667 0.1818 0.2857 11 CC 0.7000 0.6364 0.6667 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.5000 0.2500 0.3333 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8846 0.8679 0.8762 53 GYNHX 0.5000 1.0000 0.6667 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7857 0.6111 14 PASTSURGICAL 0.7000 1.0000 0.8235 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7333 0.6471 0.6875 17 accuracy 0.7750 200 macro avg 0.5696 0.6309 0.5693 200 weighted avg 0.7733 0.7750 0.7590 200 | | 0.0343 | 7.0 | 4207 | 0.5794 | precision recall f1-score support 2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.1818 0.2667 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8545 0.8868 0.8704 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.8571 0.8000 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7000 0.8235 0.7568 17 accuracy 0.7950 200 macro avg 0.5424 0.5627 0.5194 200 weighted avg 0.7824 0.7950 0.7755 200 | | 0.0225 | 8.0 | 4808 | 0.5625 | precision recall f1-score support 2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.6667 0.3636 0.4706 11 CC 0.5833 0.6364 0.6087 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8519 0.8679 0.8598 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.5000 1.0000 0.6667 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7333 0.7857 0.7586 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17 accuracy 0.7950 200 macro avg 0.5247 0.6043 0.5454 200 weighted avg 0.7697 0.7950 0.7770 200 | | 0.0176 | 9.0 | 5409 | 0.7529 | precision recall f1-score support 2-GENHX 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.1818 0.2667 11 CC 0.7143 0.4545 0.5556 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8393 0.8868 0.8624 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8667 0.7647 0.8125 17 accuracy 0.7900 200 macro avg 0.5950 0.6083 0.5769 200 weighted avg 0.7846 0.7900 0.7742 200 | | 0.0099 | 10.0 | 6010 | 0.7371 | precision recall f1-score support 2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.7500 0.5455 0.6316 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8431 0.9556 0.8958 45 GENHX 0.8431 0.8113 0.8269 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5789 0.7857 0.6667 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.7059 0.6857 17 first 0.0000 0.0000 0.0000 0 accuracy 0.7600 200 macro avg 0.5064 0.5568 0.5161 200 weighted avg 0.7392 0.7600 0.7426 200 | | 0.0099 | 11.0 | 6611 | 0.7250 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.6000 0.2727 0.3750 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 1.0000 0.4000 0.5714 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6316 0.8571 0.7273 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17 accuracy 0.7800 200 macro avg 0.6316 0.6287 0.5904 200 weighted avg 0.7772 0.7800 0.7627 200 | | 0.002 | 12.0 | 7212 | 0.8297 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.7500 0.2727 0.4000 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.6667 0.5000 0.5714 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4783 0.7857 0.5946 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17 accuracy 0.7700 200 macro avg 0.6330 0.6318 0.6120 200 weighted avg 0.7682 0.7700 0.7551 200 | | 0.0028 | 13.0 | 7813 | 0.8485 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5714 0.3636 0.4444 11 CC 0.5000 0.3636 0.4211 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7705 0.8868 0.8246 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6316 0.8571 0.7273 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17 accuracy 0.7750 200 macro avg 0.5911 0.5863 0.5702 200 weighted avg 0.7579 0.7750 0.7568 200 | | 0.0046 | 14.0 | 8414 | 0.8037 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.3636 0.4211 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7797 0.8679 0.8214 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PARADIATIONS 0.0000 0.0000 0.0000 0 PASTMEDICALHX 0.6667 0.7143 0.6897 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.7059 0.7742 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7750 200 macro avg 0.5846 0.5779 0.5663 200 weighted avg 0.7679 0.7750 0.7648 200 | | 0.0018 | 15.0 | 9015 | 0.9396 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.7500 0.2727 0.4000 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.6667 0.5000 0.5714 4 EXAM 1.0000 0.4000 0.5714 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7700 200 macro avg 0.5675 0.5569 0.5395 200 weighted avg 0.7670 0.7700 0.7541 200 | | 0.0014 | 16.0 | 9616 | 0.9559 | precision recall f1-score support 2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8654 0.8491 0.8571 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5455 0.8571 0.6667 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17 accuracy 0.7650 200 macro avg 0.5513 0.5832 0.5543 200 weighted avg 0.7489 0.7650 0.7499 200 | | 0.0008 | 17.0 | 10217 | 0.9696 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.6000 0.2727 0.3750 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8364 0.8679 0.8519 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7857 0.6111 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.7059 0.7273 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7650 200 macro avg 0.5546 0.5807 0.5535 200 weighted avg 0.7473 0.7650 0.7476 200 | | 0.0002 | 18.0 | 10818 | 0.9922 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.6667 0.3636 0.4706 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7550 200 macro avg 0.5169 0.5720 0.5199 200 weighted avg 0.7354 0.7550 0.7359 200 | | 0.0001 | 19.0 | 11419 | 0.9879 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.6667 0.3636 0.4706 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7600 200 macro avg 0.5217 0.5763 0.5248 200 weighted avg 0.7409 0.7600 0.7415 200 | | 0.0001 | 20.0 | 12020 | 0.9946 | precision recall f1-score support ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.5714 0.3636 0.4444 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0 accuracy 0.7550 200 macro avg 0.5124 0.5720 0.5187 200 weighted avg 0.7301 0.7550 0.7344 200 | ### Framework versions - Transformers 4.35.2 - Pytorch 2.1.0+cu121 - Datasets 2.16.1 - Tokenizers 0.15.0