t5-dialogue-classification-3

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.6484
Classification Report: precision recall f1-score support
```
ALLERGY     1.0000    0.9167    0.9565        12
```
ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1

IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17

 accuracy                         0.7550       200
macro avg     0.4525    0.5133    0.4657       200

weighted avg 0.7082 0.7550 0.7270 200

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 7
eval_batch_size: 7
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	172	0.3222	precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.1818 0.2500 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8302 0.9778 0.8980 45 GENHX 0.5844 0.8491 0.6923 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4000 0.7143 0.5128 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.3529 0.4615 17

 accuracy                         0.6750       200
macro avg     0.2795    0.2996    0.2807       200

weighted avg 0.5806 0.6750 0.6099 200 | | No log | 2.0 | 344 | 0.2356 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3333 0.5455 0.4138 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7377 0.8491 0.7895 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17

 accuracy                         0.7250       200
macro avg     0.3651    0.3903    0.3457       200

weighted avg 0.6828 0.7250 0.6883 200 | | 0.3714 | 3.0 | 516 | 0.2994 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.3636 0.3810 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.1818 0.4000 0.2500 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.7818 0.8113 0.7963 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17

 accuracy                         0.7350       200
macro avg     0.4158    0.4535    0.4296       200

weighted avg 0.6803 0.7350 0.7026 200 | | 0.3714 | 4.0 | 688 | 0.3036 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4167 0.4545 0.4348 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.2857 0.4000 0.3333 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.7667 0.8679 0.8142 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17

 accuracy                         0.7450       200
macro avg     0.4440    0.5014    0.4647       200

weighted avg 0.6850 0.7450 0.7093 200 | | 0.3714 | 5.0 | 860 | 0.3366 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3333 0.4545 0.3846 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8800 0.9778 0.9263 45 GENHX 0.8077 0.7925 0.8000 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 0.7143 0.8333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17

 accuracy                         0.7350       200
macro avg     0.4341    0.4939    0.4468       200

weighted avg 0.6878 0.7350 0.7055 200 | | 0.0843 | 6.0 | 1032 | 0.3852 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.5455 0.4615 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8723 0.7736 0.8200 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.2500 1.0000 0.4000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17

 accuracy                         0.7300       200
macro avg     0.4294    0.5530    0.4647       200

weighted avg 0.7036 0.7300 0.7105 200 | | 0.0843 | 7.0 | 1204 | 0.4632 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.7778 0.6364 0.7000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8696 0.7547 0.8081 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4286 0.8571 0.5714 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6842 0.7647 0.7222 17

 accuracy                         0.7250       200
macro avg     0.3631    0.4131    0.3790       200

weighted avg 0.7072 0.7250 0.7083 200 | | 0.0843 | 8.0 | 1376 | 0.4287 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5000 0.4545 0.4762 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.9130 0.9333 0.9231 45 GENHX 0.7759 0.8491 0.8108 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7450       200
macro avg     0.4272    0.5058    0.4489       200

weighted avg 0.7020 0.7450 0.7187 200 | | 0.0309 | 9.0 | 1548 | 0.4863 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3571 0.4545 0.4000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5500 0.7857 0.6471 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.7059 0.7742 17

 accuracy                         0.7400       200
macro avg     0.4384    0.5023    0.4565       200

weighted avg 0.7008 0.7400 0.7160 200 | | 0.0309 | 10.0 | 1720 | 0.5191 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4286 0.5455 0.4800 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8070 0.8679 0.8364 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7500       200
macro avg     0.4262    0.5077    0.4500       200

weighted avg 0.7047 0.7500 0.7235 200 | | 0.0309 | 11.0 | 1892 | 0.5932 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.3333 1.0000 0.5000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8491 0.8491 0.8491 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8235 0.8235 0.8235 17

 accuracy                         0.7700       200
macro avg     0.5264    0.5788    0.5170       200

weighted avg 0.7413 0.7700 0.7444 200 | | 0.011 | 12.0 | 2064 | 0.5587 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4615 0.5455 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8367 0.7736 0.8039 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.7059 0.6486 17

 accuracy                         0.7300       200
macro avg     0.4170    0.5066    0.4504       200

weighted avg 0.6866 0.7300 0.7034 200 | | 0.011 | 13.0 | 2236 | 0.5860 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8958 0.9556 0.9247 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5500 0.7857 0.6471 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7500       200
macro avg     0.4169    0.5079    0.4445       200

weighted avg 0.7011 0.7500 0.7209 200 | | 0.011 | 14.0 | 2408 | 0.6078 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.6000 0.5455 0.5714 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2000 1.0000 0.3333 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8113 0.8113 0.8113 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6667 0.8571 0.7500 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17

 accuracy                         0.7500       200
macro avg     0.4399    0.5141    0.4543       200

weighted avg 0.7207 0.7500 0.7276 200 | | 0.0053 | 15.0 | 2580 | 0.6240 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8571 0.9333 0.8936 45 GENHX 0.8036 0.8491 0.8257 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6875 0.7857 0.7333 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.7059 0.7273 17

 accuracy                         0.7450       200
macro avg     0.4177    0.5068    0.4419       200

weighted avg 0.6951 0.7450 0.7163 200 | | 0.0053 | 16.0 | 2752 | 0.6298 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.2500 0.0909 0.1333 11 CC 0.6000 0.5455 0.5714 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8302 0.8302 0.8302 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7450       200
macro avg     0.4313    0.5104    0.4508       200

weighted avg 0.7187 0.7450 0.7249 200 | | 0.0053 | 17.0 | 2924 | 0.6332 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5455 0.5455 0.5455 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8182 0.8491 0.8333 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5789 0.7857 0.6667 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7450       200
macro avg     0.4140    0.5068    0.4392       200

weighted avg 0.7022 0.7450 0.7191 200 | | 0.0029 | 18.0 | 3096 | 0.6371 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.4000 0.3636 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8302 0.8302 0.8302 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17

 accuracy                         0.7500       200
macro avg     0.4477    0.5124    0.4624       200

weighted avg 0.7117 0.7500 0.7260 200 | | 0.0029 | 19.0 | 3268 | 0.6497 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.8036 0.8491 0.8257 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17

 accuracy                         0.7550       200
macro avg     0.4518    0.5133    0.4650       200

weighted avg 0.7100 0.7550 0.7275 200 | | 0.0029 | 20.0 | 3440 | 0.6484 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17

 accuracy                         0.7550       200
macro avg     0.4525    0.5133    0.4657       200

weighted avg 0.7082 0.7550 0.7270 200 |

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu121
Datasets 2.16.1
Tokenizers 0.15.0

sarahahtee
/

t5-dialogue-classification-3

t5-dialogue-classification-3

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

Model tree for sarahahtee/t5-dialogue-classification-3

Evaluation results