metadata

license: apache-2.0
base_model: google/flan-t5-base
tags:
  - generated_from_trainer
model-index:
  - name: t5-dialogue-classification-enriched-base
    results: []

t5-dialogue-classification-enriched-base

This model is a fine-tuned version of google/flan-t5-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.9946
Classification Report: precision recall f1-score support
```
ALLERGY     1.0000    0.9167    0.9565        12
```
ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.5714 0.3636 0.4444 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1

IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7550       200
macro avg     0.5124    0.5720    0.5187       200

weighted avg 0.7301 0.7550 0.7344 200

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 2
eval_batch_size: 2
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
0.612	1.0	601	0.3791	precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2000 0.4545 0.2778 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8462 0.9778 0.9072 45 GENHX 0.7627 0.8491 0.8036 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 1.0000 0.8333 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.4706 0.5926 17

 accuracy                         0.7100       200
macro avg     0.2947    0.3263    0.3028       200

weighted avg 0.6422 0.7100 0.6648 200 | | 0.2185 | 2.0 | 1202 | 0.3511 | precision recall f1-score support

   ALLERGY     1.0000    0.9167    0.9565        12
ASSESSMENT     0.0000    0.0000    0.0000        11
        CC     0.5000    0.4545    0.4762        11
 DIAGNOSIS     0.0000    0.0000    0.0000         1

DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8627 0.9778 0.9167 45 GENHX 0.8679 0.8679 0.8679 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 1.0000 0.8333 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4800 0.8571 0.6154 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8125 0.7647 0.7879 17 well developed 0.0000 0.0000 0.0000 0

  accuracy                         0.7550       200
 macro avg     0.3764    0.3923    0.3788       200

weighted avg 0.7067 0.7550 0.7240 200 | | 0.2103 | 3.0 | 1803 | 0.5588 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.4000 0.3636 0.3810 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.4000 0.4000 0.4000 5 FAM/SOCHX 0.8800 0.9778 0.9263 45 GENHX 0.7895 0.8491 0.8182 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4444 0.8571 0.5854 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8182 0.5294 0.6429 17

 accuracy                         0.7350       200
macro avg     0.4199    0.4947    0.4393       200

weighted avg 0.6857 0.7350 0.7005 200 | | 0.1329 | 4.0 | 2404 | 0.5146 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.4615 0.5455 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8246 0.8868 0.8545 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5217 0.8571 0.6486 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17

 accuracy                         0.7650       200
macro avg     0.4826    0.5108    0.4800       200

weighted avg 0.7292 0.7650 0.7370 200 | | 0.0896 | 5.0 | 3005 | 0.5567 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8246 0.8868 0.8545 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.8571 0.7059 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.2500 1.0000 0.4000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.7059 0.6857 17

 accuracy                         0.7650       200
macro avg     0.5221    0.5562    0.5219       200

weighted avg 0.7289 0.7650 0.7386 200 | | 0.058 | 6.0 | 3606 | 0.5499 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.6667 0.1818 0.2857 11 CC 0.7000 0.6364 0.6667 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.5000 0.2500 0.3333 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8846 0.8679 0.8762 53 GYNHX 0.5000 1.0000 0.6667 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7857 0.6111 14 PASTSURGICAL 0.7000 1.0000 0.8235 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7333 0.6471 0.6875 17

 accuracy                         0.7750       200
macro avg     0.5696    0.6309    0.5693       200

weighted avg 0.7733 0.7750 0.7590 200 | | 0.0343 | 7.0 | 4207 | 0.5794 | precision recall f1-score support

2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.1818 0.2667 11 CC 0.6667 0.5455 0.6000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8545 0.8868 0.8704 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.8571 0.8000 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7000 0.8235 0.7568 17

 accuracy                         0.7950       200
macro avg     0.5424    0.5627    0.5194       200

weighted avg 0.7824 0.7950 0.7755 200 | | 0.0225 | 8.0 | 4808 | 0.5625 | precision recall f1-score support

2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.6667 0.3636 0.4706 11 CC 0.5833 0.6364 0.6087 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8519 0.8679 0.8598 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 0.5000 1.0000 0.6667 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7333 0.7857 0.7586 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7647 0.7647 0.7647 17

 accuracy                         0.7950       200
macro avg     0.5247    0.6043    0.5454       200

weighted avg 0.7697 0.7950 0.7770 200 | | 0.0176 | 9.0 | 5409 | 0.7529 | precision recall f1-score support

  2-GENHX     0.0000    0.0000    0.0000         0
  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.5000 0.1818 0.2667 11 CC 0.7143 0.4545 0.5556 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.8393 0.8868 0.8624 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5714 0.8571 0.6857 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8667 0.7647 0.8125 17

 accuracy                         0.7900       200
macro avg     0.5950    0.6083    0.5769       200

weighted avg 0.7846 0.7900 0.7742 200 | | 0.0099 | 10.0 | 6010 | 0.7371 | precision recall f1-score support

2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.7500 0.5455 0.6316 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.5000 1.0000 0.6667 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8431 0.9556 0.8958 45 GENHX 0.8431 0.8113 0.8269 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5789 0.7857 0.6667 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.7059 0.6857 17 first 0.0000 0.0000 0.0000 0

 accuracy                         0.7600       200
macro avg     0.5064    0.5568    0.5161       200

weighted avg 0.7392 0.7600 0.7426 200 | | 0.0099 | 11.0 | 6611 | 0.7250 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.6000 0.2727 0.3750 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.3333 1.0000 0.5000 1 EDCOURSE 1.0000 0.2500 0.4000 4 EXAM 1.0000 0.4000 0.5714 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6316 0.8571 0.7273 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7222 0.7647 0.7429 17

 accuracy                         0.7800       200
macro avg     0.6316    0.6287    0.5904       200

weighted avg 0.7772 0.7800 0.7627 200 | | 0.002 | 12.0 | 7212 | 0.8297 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.7500 0.2727 0.4000 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.6667 0.5000 0.5714 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4783 0.7857 0.5946 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17

 accuracy                         0.7700       200
macro avg     0.6330    0.6318    0.6120       200

weighted avg 0.7682 0.7700 0.7551 200 | | 0.0028 | 13.0 | 7813 | 0.8485 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.5714 0.3636 0.4444 11 CC 0.5000 0.3636 0.4211 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7705 0.8868 0.8246 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6316 0.8571 0.7273 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8462 0.6471 0.7333 17

 accuracy                         0.7750       200
macro avg     0.5911    0.5863    0.5702       200

weighted avg 0.7579 0.7750 0.7568 200 | | 0.0046 | 14.0 | 8414 | 0.8037 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.5000 0.3636 0.4211 11 CC 0.5556 0.4545 0.5000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 1.0000 0.5000 0.6667 4 EXAM 0.6667 0.4000 0.5000 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7797 0.8679 0.8214 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PARADIATIONS 0.0000 0.0000 0.0000 0 PASTMEDICALHX 0.6667 0.7143 0.6897 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8571 0.7059 0.7742 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7750       200
macro avg     0.5846    0.5779    0.5663       200

weighted avg 0.7679 0.7750 0.7648 200 | | 0.0018 | 15.0 | 9015 | 0.9396 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.7500 0.2727 0.4000 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.6667 0.5000 0.5714 4 EXAM 1.0000 0.4000 0.5714 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7700       200
macro avg     0.5675    0.5569    0.5395       200

weighted avg 0.7670 0.7700 0.7541 200 | | 0.0014 | 16.0 | 9616 | 0.9559 | precision recall f1-score support

2-year-old 0.0000 0.0000 0.0000 0 ALLERGY 1.0000 0.9167 0.9565 12 ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8654 0.8491 0.8571 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5455 0.8571 0.6667 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7059 0.7059 0.7059 17

 accuracy                         0.7650       200
macro avg     0.5513    0.5832    0.5543       200

weighted avg 0.7489 0.7650 0.7499 200 | | 0.0008 | 17.0 | 10217 | 0.9696 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.6000 0.2727 0.3750 11 CC 0.6250 0.4545 0.5263 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 1.0000 1.0000 1.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.8364 0.8679 0.8519 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7857 0.6111 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.7059 0.7273 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7650       200
macro avg     0.5546    0.5807    0.5535       200

weighted avg 0.7473 0.7650 0.7476 200 | | 0.0002 | 18.0 | 10818 | 0.9922 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.6667 0.3636 0.4706 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7550       200
macro avg     0.5169    0.5720    0.5199       200

weighted avg 0.7354 0.7550 0.7359 200 | | 0.0001 | 19.0 | 11419 | 0.9879 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.5000 0.2727 0.3529 11 CC 0.6667 0.3636 0.4706 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7600       200
macro avg     0.5217    0.5763    0.5248       200

weighted avg 0.7409 0.7600 0.7415 200 | | 0.0001 | 20.0 | 12020 | 0.9946 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.4000 0.1818 0.2500 11 CC 0.5714 0.3636 0.4444 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.7931 0.8679 0.8288 53 GYNHX 1.0000 1.0000 1.0000 1 IMAGING 1.0000 1.0000 1.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6111 0.7857 0.6875 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.3333 1.0000 0.5000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.7059 0.7500 17 first CC 0.0000 0.0000 0.0000 0

 accuracy                         0.7550       200
macro avg     0.5124    0.5720    0.5187       200

weighted avg 0.7301 0.7550 0.7344 200 |

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu121
Datasets 2.16.1
Tokenizers 0.15.0