t5-dialogue-classification-5
This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:
Loss: 0.6560
Classification Report: precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.5005 0.5014 0.4859 100
weighted avg 0.7472 0.7600 0.7384 100
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
Training results
Training Loss | Epoch | Step | Validation Loss | Classification Report |
---|---|---|---|---|
No log | 1.0 | 172 | 0.4439 | precision recall f1-score support |
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.4082 1.0000 0.5797 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.5714 0.6154 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SYSTEMS 0.0000 0.0000 0.0000 0
accuracy 0.5900 100
macro avg 0.2578 0.2393 0.2169 100
weighted avg 0.4931 0.5900 0.4943 100 | | No log | 2.0 | 344 | 0.3352 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.4444 1.0000 0.6154 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11
accuracy 0.6500 100
macro avg 0.3591 0.3269 0.2937 100
weighted avg 0.6409 0.6500 0.5711 100 | | 0.3193 | 3.0 | 516 | 0.3951 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EK G 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7500 0.8571 0.8000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11
accuracy 0.6700 100
macro avg 0.3750 0.3447 0.3237 100
weighted avg 0.6539 0.6700 0.6160 100 | | 0.3193 | 4.0 | 688 | 0.3707 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.2727 0.7500 0.4000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3750 0.7500 0.5000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7400 100
macro avg 0.4559 0.4681 0.4274 100
weighted avg 0.7398 0.7400 0.7139 100 | | 0.3193 | 5.0 | 860 | 0.3895 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.5000 0.2500 0.3333 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.9000 0.9000 0.9000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.6667 0.8000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8750 0.6364 0.7368 11
accuracy 0.7500 100
macro avg 0.4887 0.4727 0.4564 100
weighted avg 0.7418 0.7500 0.7240 100 | | 0.0885 | 6.0 | 1032 | 0.4334 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9565 1.0000 0.9778 22 GENHX 0.8182 0.9000 0.8571 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11
accuracy 0.7300 100
macro avg 0.4841 0.4840 0.4430 100
weighted avg 0.7513 0.7300 0.7041 100 | | 0.0885 | 7.0 | 1204 | 0.4889 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3333 0.7500 0.4615 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8500 0.8500 0.8500 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.5000 1.0000 0.6667 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.6667 0.5714 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7300 100
macro avg 0.4496 0.5210 0.4548 100
weighted avg 0.7024 0.7300 0.6938 100 | | 0.0885 | 8.0 | 1376 | 0.5543 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 1.0000 0.2500 0.4000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.2500 1.0000 0.4000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.7200 0.9000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7000 1.0000 0.8235 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6000 0.7500 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7300 100
macro avg 0.4718 0.4639 0.4269 100
weighted avg 0.7195 0.7300 0.6934 100 | | 0.0361 | 9.0 | 1548 | 0.5914 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 1.0000 0.5000 0.6667 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8095 0.8500 0.8293 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.5000 1.0000 0.6667 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.3333 0.3333 0.3333 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7500 100
macro avg 0.4726 0.5239 0.4704 100
weighted avg 0.7265 0.7500 0.7198 100 | | 0.0361 | 10.0 | 1720 | 0.6607 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.5000 0.2500 0.3333 4 CC 0.3333 0.5000 0.4000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 0.5000 0.3333 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9565 1.0000 0.9778 22 GENHX 0.7037 0.9500 0.8085 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 0.7500 0.6000 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7500 100
macro avg 0.4821 0.4831 0.4693 100
weighted avg 0.7250 0.7500 0.7221 100 | | 0.0361 | 11.0 | 1892 | 0.6002 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.5000 0.2500 0.3333 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.7826 0.9000 0.8372 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7500 100
macro avg 0.4597 0.4889 0.4536 100
weighted avg 0.7275 0.7500 0.7217 100 | | 0.0134 | 12.0 | 2064 | 0.6110 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.5000 0.2500 0.3333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.7308 0.9500 0.8261 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7500 100
macro avg 0.4947 0.4789 0.4589 100
weighted avg 0.7360 0.7500 0.7194 100 | | 0.0134 | 13.0 | 2236 | 0.6458 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 1.0000 0.5000 0.6667 4 CC 0.5000 0.5000 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.3333 1.0000 0.5000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.7917 0.9500 0.8636 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.3333 1.0000 0.5000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.6667 1.0000 0.8000 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7700 100
macro avg 0.5238 0.5414 0.4942 100
weighted avg 0.7561 0.7700 0.7392 100 | | 0.0134 | 14.0 | 2408 | 0.6814 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.5000 0.2500 0.3333 4 CC 0.5000 0.5000 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.7917 0.9500 0.8636 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7000 1.0000 0.8235 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7400 100
macro avg 0.5031 0.4767 0.4671 100
weighted avg 0.7265 0.7400 0.7118 100 | | 0.0071 | 15.0 | 2580 | 0.6663 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8182 0.9000 0.8571 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.5115 0.5014 0.4830 100
weighted avg 0.7503 0.7600 0.7350 100 | | 0.0071 | 16.0 | 2752 | 0.6422 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.5000 0.7500 0.6000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8182 0.9000 0.8571 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.5129 0.5014 0.4851 100
weighted avg 0.7485 0.7600 0.7349 100 | | 0.0071 | 17.0 | 2924 | 0.6535 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.5000 0.5000 0.5000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 0.5000 0.4000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.5051 0.5014 0.4802 100
weighted avg 0.7513 0.7600 0.7361 100 | | 0.0035 | 18.0 | 3096 | 0.6340 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.4974 0.5014 0.4838 100
weighted avg 0.7484 0.7600 0.7386 100 | | 0.0035 | 19.0 | 3268 | 0.6542 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 1.0000 0.5000 0.6667 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.5000 1.0000 0.6667 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.4913 0.5014 0.4725 100
weighted avg 0.7614 0.7600 0.7413 100 | | 0.0035 | 20.0 | 3440 | 0.6560 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4
ASSESSMENT 0.6667 0.5000 0.5714 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 0.5000 0.5000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.8571 0.9000 0.8780 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8750 1.0000 0.9333 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.5455 0.6667 11
accuracy 0.7600 100
macro avg 0.5005 0.5014 0.4859 100
weighted avg 0.7472 0.7600 0.7384 100 |
Framework versions
- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
- Downloads last month
- 8
Model tree for sarahahtee/t5-dialogue-classification-5
Base model
google/flan-t5-base