Hugging Face's logo

veronica-girolimetti
/
t5-dialogue-classification-enriched-base

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
veronica-girolimetti commited on
Commit
091dadd
•
1 Parent(s): fcd34f9

End of training

Browse files
Files changed (3) hide show
  1. README.md +339 -353
  2. model.safetensors +1 -1
  3. runs/Jan15_18-28-45_3e571f4cc206/events.out.tfevents.1705343371.3e571f4cc206.3629.0 +2 -2
README.md CHANGED
@@ -15,34 +15,33 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.9946
19
  - Classification Report: precision recall f1-score support
20
 
21
  ALLERGY 1.0000 0.9167 0.9565 12
22
- ASSESSMENT 0.4000 0.1818 0.2500 11
23
- CC 0.5714 0.3636 0.4444 11
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
- DISPOSITION 0.2500 1.0000 0.4000 1
26
  EDCOURSE 0.0000 0.0000 0.0000 4
27
- EXAM 0.5000 0.4000 0.4444 5
28
- FAM/SOCHX 0.8750 0.9333 0.9032 45
29
  GENHX 0.7931 0.8679 0.8288 53
30
  GYNHX 1.0000 1.0000 1.0000 1
31
- IMAGING 1.0000 1.0000 1.0000 1
32
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
  MEDICATIONS 0.7692 1.0000 0.8696 10
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
- PASTMEDICALHX 0.6111 0.7857 0.6875 14
37
- PASTSURGICAL 0.8571 0.8571 0.8571 7
38
- PLAN 0.3333 1.0000 0.5000 1
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
  ROS 0.8000 0.7059 0.7500 17
41
- first CC 0.0000 0.0000 0.0000 0
42
 
43
- accuracy 0.7550 200
44
- macro avg 0.5124 0.5720 0.5187 200
45
- weighted avg 0.7301 0.7550 0.7344 200
46
 
47
 
48
  ## Model description
@@ -72,561 +71,548 @@ The following hyperparameters were used during training:
72
 
73
  ### Training results
74
 
75
- | Training Loss | Epoch | Step | Validation Loss | Classification Report |
76
- |:-------------:|:-----:|:-----:|:---------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
77
- | 0.612 | 1.0 | 601 | 0.3791 | precision recall f1-score support
78
 
79
  ALLERGY 1.0000 0.9167 0.9565 12
80
  ASSESSMENT 0.0000 0.0000 0.0000 11
81
- CC 0.2000 0.4545 0.2778 11
82
  DIAGNOSIS 0.0000 0.0000 0.0000 1
83
  DISPOSITION 0.0000 0.0000 0.0000 1
84
  EDCOURSE 0.0000 0.0000 0.0000 4
85
- EXAM 0.0000 0.0000 0.0000 5
86
- FAM/SOCHX 0.8462 0.9778 0.9072 45
87
- GENHX 0.7627 0.8491 0.8036 53
88
  GYNHX 0.0000 0.0000 0.0000 1
89
  IMAGING 0.0000 0.0000 0.0000 1
90
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
91
  LABS 0.0000 0.0000 0.0000 1
92
- MEDICATIONS 0.7143 1.0000 0.8333 10
93
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
94
- PASTMEDICALHX 0.5714 0.8571 0.6857 14
95
  PASTSURGICAL 1.0000 1.0000 1.0000 7
96
  PLAN 0.0000 0.0000 0.0000 1
97
  PROCEDURES 0.0000 0.0000 0.0000 1
98
- ROS 0.8000 0.4706 0.5926 17
99
-
100
- accuracy 0.7100 200
101
- macro avg 0.2947 0.3263 0.3028 200
102
- weighted avg 0.6422 0.7100 0.6648 200
103
- |
104
- | 0.2185 | 2.0 | 1202 | 0.3511 | precision recall f1-score support
105
-
106
- ALLERGY 1.0000 0.9167 0.9565 12
107
- ASSESSMENT 0.0000 0.0000 0.0000 11
108
- CC 0.5000 0.4545 0.4762 11
109
- DIAGNOSIS 0.0000 0.0000 0.0000 1
110
- DISPOSITION 0.0000 0.0000 0.0000 1
111
- EDCOURSE 0.0000 0.0000 0.0000 4
112
- EXAM 0.6667 0.4000 0.5000 5
113
- FAM/SOCHX 0.8627 0.9778 0.9167 45
114
- GENHX 0.8679 0.8679 0.8679 53
115
- GYNHX 0.0000 0.0000 0.0000 1
116
- IMAGING 0.0000 0.0000 0.0000 1
117
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
118
- LABS 0.0000 0.0000 0.0000 1
119
- MEDICATIONS 0.7143 1.0000 0.8333 10
120
- OTHER_HISTORY 0.0000 0.0000 0.0000 3
121
- PASTMEDICALHX 0.4800 0.8571 0.6154 14
122
- PASTSURGICAL 1.0000 1.0000 1.0000 7
123
- PLAN 0.0000 0.0000 0.0000 1
124
- PROCEDURES 0.0000 0.0000 0.0000 1
125
- ROS 0.8125 0.7647 0.7879 17
126
- well developed 0.0000 0.0000 0.0000 0
127
-
128
- accuracy 0.7550 200
129
- macro avg 0.3764 0.3923 0.3788 200
130
- weighted avg 0.7067 0.7550 0.7240 200
131
- |
132
- | 0.2103 | 3.0 | 1803 | 0.5588 | precision recall f1-score support
133
 
134
  ALLERGY 1.0000 0.9167 0.9565 12
135
  ASSESSMENT 0.0000 0.0000 0.0000 11
136
- CC 0.4000 0.3636 0.3810 11
137
  DIAGNOSIS 0.0000 0.0000 0.0000 1
138
- DISPOSITION 0.3333 1.0000 0.5000 1
139
- EDCOURSE 0.0000 0.0000 0.0000 4
140
- EXAM 0.4000 0.4000 0.4000 5
141
  FAM/SOCHX 0.8800 0.9778 0.9263 45
142
- GENHX 0.7895 0.8491 0.8182 53
143
  GYNHX 0.0000 0.0000 0.0000 1
144
  IMAGING 1.0000 1.0000 1.0000 1
145
- IMMUNIZATIONS 0.5000 1.0000 0.6667 1
146
  LABS 0.0000 0.0000 0.0000 1
147
- MEDICATIONS 0.8333 1.0000 0.9091 10
148
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
149
- PASTMEDICALHX 0.4444 0.8571 0.5854 14
150
  PASTSURGICAL 1.0000 1.0000 1.0000 7
151
- PLAN 0.0000 0.0000 0.0000 1
152
  PROCEDURES 0.0000 0.0000 0.0000 1
153
- ROS 0.8182 0.5294 0.6429 17
154
 
155
- accuracy 0.7350 200
156
- macro avg 0.4199 0.4947 0.4393 200
157
- weighted avg 0.6857 0.7350 0.7005 200
158
- |
159
- | 0.1329 | 4.0 | 2404 | 0.5146 | precision recall f1-score support
160
 
161
  ALLERGY 1.0000 0.9167 0.9565 12
162
- ASSESSMENT 0.3333 0.0909 0.1429 11
163
- CC 0.4615 0.5455 0.5000 11
164
  DIAGNOSIS 0.0000 0.0000 0.0000 1
165
  DISPOSITION 0.0000 0.0000 0.0000 1
166
  EDCOURSE 0.0000 0.0000 0.0000 4
167
- EXAM 0.6667 0.4000 0.5000 5
168
- FAM/SOCHX 0.8776 0.9556 0.9149 45
169
- GENHX 0.8246 0.8868 0.8545 53
170
- GYNHX 0.0000 0.0000 0.0000 1
171
  IMAGING 1.0000 1.0000 1.0000 1
172
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
173
  LABS 0.0000 0.0000 0.0000 1
174
- MEDICATIONS 0.8333 1.0000 0.9091 10
175
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
176
- PASTMEDICALHX 0.5217 0.8571 0.6486 14
177
- PASTSURGICAL 1.0000 0.8571 0.9231 7
178
  PLAN 0.3333 1.0000 0.5000 1
179
  PROCEDURES 0.0000 0.0000 0.0000 1
180
- ROS 0.8000 0.7059 0.7500 17
181
 
182
- accuracy 0.7650 200
183
- macro avg 0.4826 0.5108 0.4800 200
184
- weighted avg 0.7292 0.7650 0.7370 200
185
- |
186
- | 0.0896 | 5.0 | 3005 | 0.5567 | precision recall f1-score support
187
 
188
  ALLERGY 1.0000 0.9167 0.9565 12
189
- ASSESSMENT 0.3333 0.0909 0.1429 11
190
- CC 0.5556 0.4545 0.5000 11
191
  DIAGNOSIS 0.0000 0.0000 0.0000 1
192
- DISPOSITION 0.0000 0.0000 0.0000 1
193
  EDCOURSE 0.0000 0.0000 0.0000 4
194
- EXAM 0.5000 0.4000 0.4444 5
195
- FAM/SOCHX 0.8776 0.9556 0.9149 45
196
- GENHX 0.8246 0.8868 0.8545 53
197
- GYNHX 1.0000 1.0000 1.0000 1
198
- IMAGING 1.0000 1.0000 1.0000 1
199
  IMMUNIZATIONS 1.0000 1.0000 1.0000 1
200
  LABS 0.0000 0.0000 0.0000 1
201
- MEDICATIONS 0.8333 1.0000 0.9091 10
202
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
203
- PASTMEDICALHX 0.6000 0.8571 0.7059 14
204
  PASTSURGICAL 1.0000 0.8571 0.9231 7
205
- PLAN 0.2500 1.0000 0.4000 1
206
  PROCEDURES 0.0000 0.0000 0.0000 1
207
- ROS 0.6667 0.7059 0.6857 17
208
 
209
- accuracy 0.7650 200
210
- macro avg 0.5221 0.5562 0.5219 200
211
- weighted avg 0.7289 0.7650 0.7386 200
212
- |
213
- | 0.058 | 6.0 | 3606 | 0.5499 | precision recall f1-score support
214
 
215
  ALLERGY 1.0000 0.9167 0.9565 12
216
- ASSESSMENT 0.6667 0.1818 0.2857 11
217
- CC 0.7000 0.6364 0.6667 11
218
  DIAGNOSIS 0.0000 0.0000 0.0000 1
219
- DISPOSITION 0.5000 1.0000 0.6667 1
220
- EDCOURSE 0.5000 0.2500 0.3333 4
221
- EXAM 0.6667 0.4000 0.5000 5
222
- FAM/SOCHX 0.8750 0.9333 0.9032 45
223
- GENHX 0.8846 0.8679 0.8762 53
224
- GYNHX 0.5000 1.0000 0.6667 1
225
  IMAGING 1.0000 1.0000 1.0000 1
226
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
227
  LABS 0.0000 0.0000 0.0000 1
228
- MEDICATIONS 0.8333 1.0000 0.9091 10
229
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
230
- PASTMEDICALHX 0.5000 0.7857 0.6111 14
231
- PASTSURGICAL 0.7000 1.0000 0.8235 7
232
  PLAN 0.3333 1.0000 0.5000 1
233
  PROCEDURES 0.0000 0.0000 0.0000 1
234
- ROS 0.7333 0.6471 0.6875 17
235
 
236
- accuracy 0.7750 200
237
- macro avg 0.5696 0.6309 0.5693 200
238
- weighted avg 0.7733 0.7750 0.7590 200
239
- |
240
- | 0.0343 | 7.0 | 4207 | 0.5794 | precision recall f1-score support
241
 
242
- 2-year-old 0.0000 0.0000 0.0000 0
243
  ALLERGY 1.0000 0.9167 0.9565 12
244
- ASSESSMENT 0.5000 0.1818 0.2667 11
245
  CC 0.6667 0.5455 0.6000 11
246
  DIAGNOSIS 0.0000 0.0000 0.0000 1
247
- DISPOSITION 0.3333 1.0000 0.5000 1
248
- EDCOURSE 1.0000 0.2500 0.4000 4
249
- EXAM 0.6667 0.4000 0.5000 5
250
- FAM/SOCHX 0.8776 0.9556 0.9149 45
251
- GENHX 0.8545 0.8868 0.8704 53
252
- GYNHX 0.0000 0.0000 0.0000 1
253
  IMAGING 1.0000 1.0000 1.0000 1
254
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
255
  LABS 0.0000 0.0000 0.0000 1
256
- MEDICATIONS 0.8333 1.0000 0.9091 10
257
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
258
- PASTMEDICALHX 0.7500 0.8571 0.8000 14
259
- PASTSURGICAL 0.8750 1.0000 0.9333 7
260
  PLAN 0.3333 1.0000 0.5000 1
261
  PROCEDURES 0.0000 0.0000 0.0000 1
262
- ROS 0.7000 0.8235 0.7568 17
 
263
 
264
- accuracy 0.7950 200
265
- macro avg 0.5424 0.5627 0.5194 200
266
- weighted avg 0.7824 0.7950 0.7755 200
267
- |
268
- | 0.0225 | 8.0 | 4808 | 0.5625 | precision recall f1-score support
269
 
270
- 2-year-old 0.0000 0.0000 0.0000 0
271
  ALLERGY 1.0000 0.9167 0.9565 12
272
- ASSESSMENT 0.6667 0.3636 0.4706 11
273
- CC 0.5833 0.6364 0.6087 11
274
  DIAGNOSIS 0.0000 0.0000 0.0000 1
275
- DISPOSITION 0.5000 1.0000 0.6667 1
276
  EDCOURSE 0.0000 0.0000 0.0000 4
277
  EXAM 0.5000 0.4000 0.4444 5
278
  FAM/SOCHX 0.8776 0.9556 0.9149 45
279
- GENHX 0.8519 0.8679 0.8598 53
280
- GYNHX 1.0000 1.0000 1.0000 1
281
- IMAGING 0.5000 1.0000 0.6667 1
282
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
283
  LABS 0.0000 0.0000 0.0000 1
284
- MEDICATIONS 0.8333 1.0000 0.9091 10
285
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
286
- PASTMEDICALHX 0.7333 0.7857 0.7586 14
287
- PASTSURGICAL 0.8750 1.0000 0.9333 7
288
  PLAN 0.3333 1.0000 0.5000 1
289
  PROCEDURES 0.0000 0.0000 0.0000 1
290
- ROS 0.7647 0.7647 0.7647 17
291
 
292
- accuracy 0.7950 200
293
- macro avg 0.5247 0.6043 0.5454 200
294
- weighted avg 0.7697 0.7950 0.7770 200
295
  |
296
- | 0.0176 | 9.0 | 5409 | 0.7529 | precision recall f1-score support
297
 
298
- 2-GENHX 0.0000 0.0000 0.0000 0
299
  ALLERGY 1.0000 0.9167 0.9565 12
300
  ASSESSMENT 0.5000 0.1818 0.2667 11
301
- CC 0.7143 0.4545 0.5556 11
302
  DIAGNOSIS 0.0000 0.0000 0.0000 1
303
- DISPOSITION 0.5000 1.0000 0.6667 1
304
- EDCOURSE 1.0000 0.5000 0.6667 4
305
- EXAM 0.6667 0.4000 0.5000 5
306
- FAM/SOCHX 0.8776 0.9556 0.9149 45
307
- GENHX 0.8393 0.8868 0.8624 53
308
- GYNHX 1.0000 1.0000 1.0000 1
309
  IMAGING 1.0000 1.0000 1.0000 1
310
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
311
  LABS 0.0000 0.0000 0.0000 1
312
  MEDICATIONS 0.7692 1.0000 0.8696 10
313
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
314
- PASTMEDICALHX 0.5714 0.8571 0.6857 14
315
  PASTSURGICAL 0.8571 0.8571 0.8571 7
316
- PLAN 0.3333 1.0000 0.5000 1
317
  PROCEDURES 0.0000 0.0000 0.0000 1
318
- ROS 0.8667 0.7647 0.8125 17
319
 
320
- accuracy 0.7900 200
321
- macro avg 0.5950 0.6083 0.5769 200
322
- weighted avg 0.7846 0.7900 0.7742 200
323
  |
324
- | 0.0099 | 10.0 | 6010 | 0.7371 | precision recall f1-score support
325
 
326
- 2-year-old 0.0000 0.0000 0.0000 0
327
  ALLERGY 1.0000 0.9167 0.9565 12
328
- ASSESSMENT 0.5000 0.2727 0.3529 11
329
- CC 0.7500 0.5455 0.6316 11
330
  DIAGNOSIS 0.0000 0.0000 0.0000 1
331
- DISPOSITION 0.5000 1.0000 0.6667 1
332
  EDCOURSE 0.0000 0.0000 0.0000 4
333
- EXAM 0.5000 0.4000 0.4444 5
334
- FAM/SOCHX 0.8431 0.9556 0.8958 45
335
- GENHX 0.8431 0.8113 0.8269 53
336
  GYNHX 1.0000 1.0000 1.0000 1
337
  IMAGING 1.0000 1.0000 1.0000 1
338
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
339
  LABS 0.0000 0.0000 0.0000 1
340
- MEDICATIONS 0.7692 1.0000 0.8696 10
341
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
342
- PASTMEDICALHX 0.5789 0.7857 0.6667 14
343
- PASTSURGICAL 0.8571 0.8571 0.8571 7
344
- PLAN 0.3333 1.0000 0.5000 1
345
  PROCEDURES 0.0000 0.0000 0.0000 1
346
- ROS 0.6667 0.7059 0.6857 17
347
- first 0.0000 0.0000 0.0000 0
348
 
349
- accuracy 0.7600 200
350
- macro avg 0.5064 0.5568 0.5161 200
351
- weighted avg 0.7392 0.7600 0.7426 200
352
- |
353
- | 0.0099 | 11.0 | 6611 | 0.7250 | precision recall f1-score support
354
 
355
  ALLERGY 1.0000 0.9167 0.9565 12
356
- ASSESSMENT 0.6000 0.2727 0.3750 11
357
- CC 0.5556 0.4545 0.5000 11
358
  DIAGNOSIS 0.0000 0.0000 0.0000 1
359
- DISPOSITION 0.3333 1.0000 0.5000 1
360
- EDCOURSE 1.0000 0.2500 0.4000 4
361
- EXAM 1.0000 0.4000 0.5714 5
362
- FAM/SOCHX 0.8936 0.9333 0.9130 45
363
- GENHX 0.7931 0.8679 0.8288 53
364
  GYNHX 1.0000 1.0000 1.0000 1
365
  IMAGING 1.0000 1.0000 1.0000 1
366
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
367
  LABS 0.0000 0.0000 0.0000 1
368
  MEDICATIONS 0.7692 1.0000 0.8696 10
369
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
370
- PASTMEDICALHX 0.6316 0.8571 0.7273 14
371
- PASTSURGICAL 1.0000 0.8571 0.9231 7
372
  PLAN 0.3333 1.0000 0.5000 1
373
  PROCEDURES 0.0000 0.0000 0.0000 1
374
- ROS 0.7222 0.7647 0.7429 17
375
 
376
- accuracy 0.7800 200
377
- macro avg 0.6316 0.6287 0.5904 200
378
- weighted avg 0.7772 0.7800 0.7627 200
379
- |
380
- | 0.002 | 12.0 | 7212 | 0.8297 | precision recall f1-score support
381
 
382
  ALLERGY 1.0000 0.9167 0.9565 12
383
- ASSESSMENT 0.7500 0.2727 0.4000 11
384
- CC 0.6250 0.4545 0.5263 11
385
  DIAGNOSIS 0.0000 0.0000 0.0000 1
386
- DISPOSITION 1.0000 1.0000 1.0000 1
387
- EDCOURSE 0.6667 0.5000 0.5714 4
388
- EXAM 0.6667 0.4000 0.5000 5
389
- FAM/SOCHX 0.8750 0.9333 0.9032 45
390
- GENHX 0.7931 0.8679 0.8288 53
391
  GYNHX 1.0000 1.0000 1.0000 1
392
  IMAGING 1.0000 1.0000 1.0000 1
393
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
394
  LABS 0.0000 0.0000 0.0000 1
395
  MEDICATIONS 0.7692 1.0000 0.8696 10
396
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
397
- PASTMEDICALHX 0.4783 0.7857 0.5946 14
398
- PASTSURGICAL 0.8571 0.8571 0.8571 7
399
- PLAN 0.3333 1.0000 0.5000 1
400
  PROCEDURES 0.0000 0.0000 0.0000 1
401
- ROS 0.8462 0.6471 0.7333 17
402
 
403
- accuracy 0.7700 200
404
- macro avg 0.6330 0.6318 0.6120 200
405
- weighted avg 0.7682 0.7700 0.7551 200
406
- |
407
- | 0.0028 | 13.0 | 7813 | 0.8485 | precision recall f1-score support
408
 
409
  ALLERGY 1.0000 0.9167 0.9565 12
410
- ASSESSMENT 0.5714 0.3636 0.4444 11
411
- CC 0.5000 0.3636 0.4211 11
412
  DIAGNOSIS 0.0000 0.0000 0.0000 1
413
- DISPOSITION 1.0000 1.0000 1.0000 1
414
- EDCOURSE 1.0000 0.5000 0.6667 4
415
- EXAM 0.6667 0.4000 0.5000 5
416
- FAM/SOCHX 0.8750 0.9333 0.9032 45
417
- GENHX 0.7705 0.8868 0.8246 53
418
- GYNHX 0.0000 0.0000 0.0000 1
419
  IMAGING 1.0000 1.0000 1.0000 1
420
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
421
  LABS 0.0000 0.0000 0.0000 1
422
  MEDICATIONS 0.7692 1.0000 0.8696 10
423
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
424
  PASTMEDICALHX 0.6316 0.8571 0.7273 14
425
- PASTSURGICAL 0.8571 0.8571 0.8571 7
426
- PLAN 0.3333 1.0000 0.5000 1
427
  PROCEDURES 0.0000 0.0000 0.0000 1
428
- ROS 0.8462 0.6471 0.7333 17
429
 
430
- accuracy 0.7750 200
431
- macro avg 0.5911 0.5863 0.5702 200
432
- weighted avg 0.7579 0.7750 0.7568 200
433
- |
434
- | 0.0046 | 14.0 | 8414 | 0.8037 | precision recall f1-score support
435
 
436
  ALLERGY 1.0000 0.9167 0.9565 12
437
- ASSESSMENT 0.5000 0.3636 0.4211 11
438
- CC 0.5556 0.4545 0.5000 11
439
  DIAGNOSIS 0.0000 0.0000 0.0000 1
440
- DISPOSITION 1.0000 1.0000 1.0000 1
441
- EDCOURSE 1.0000 0.5000 0.6667 4
442
- EXAM 0.6667 0.4000 0.5000 5
443
- FAM/SOCHX 0.8750 0.9333 0.9032 45
444
  GENHX 0.7797 0.8679 0.8214 53
445
  GYNHX 1.0000 1.0000 1.0000 1
446
  IMAGING 1.0000 1.0000 1.0000 1
447
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
448
  LABS 0.0000 0.0000 0.0000 1
449
  MEDICATIONS 0.7692 1.0000 0.8696 10
450
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
451
- PARADIATIONS 0.0000 0.0000 0.0000 0
452
- PASTMEDICALHX 0.6667 0.7143 0.6897 14
453
- PASTSURGICAL 0.8571 0.8571 0.8571 7
454
- PLAN 0.3333 1.0000 0.5000 1
455
  PROCEDURES 0.0000 0.0000 0.0000 1
456
- ROS 0.8571 0.7059 0.7742 17
457
- first CC 0.0000 0.0000 0.0000 0
458
 
459
- accuracy 0.7750 200
460
- macro avg 0.5846 0.5779 0.5663 200
461
- weighted avg 0.7679 0.7750 0.7648 200
462
- |
463
- | 0.0018 | 15.0 | 9015 | 0.9396 | precision recall f1-score support
464
 
465
  ALLERGY 1.0000 0.9167 0.9565 12
466
- ASSESSMENT 0.7500 0.2727 0.4000 11
467
- CC 0.6250 0.4545 0.5263 11
468
  DIAGNOSIS 0.0000 0.0000 0.0000 1
469
- DISPOSITION 1.0000 1.0000 1.0000 1
470
- EDCOURSE 0.6667 0.5000 0.5714 4
471
  EXAM 1.0000 0.4000 0.5714 5
472
- FAM/SOCHX 0.8936 0.9333 0.9130 45
473
- GENHX 0.7931 0.8679 0.8288 53
474
- GYNHX 0.0000 0.0000 0.0000 1
475
- IMAGING 1.0000 1.0000 1.0000 1
476
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
477
- LABS 0.0000 0.0000 0.0000 1
478
  MEDICATIONS 0.7692 1.0000 0.8696 10
479
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
480
- PASTMEDICALHX 0.5238 0.7857 0.6286 14
481
- PASTSURGICAL 0.8571 0.8571 0.8571 7
482
- PLAN 0.3333 1.0000 0.5000 1
483
  PROCEDURES 0.0000 0.0000 0.0000 1
484
- ROS 0.7059 0.7059 0.7059 17
485
- first CC 0.0000 0.0000 0.0000 0
486
 
487
  accuracy 0.7700 200
488
- macro avg 0.5675 0.5569 0.5395 200
489
- weighted avg 0.7670 0.7700 0.7541 200
490
  |
491
- | 0.0014 | 16.0 | 9616 | 0.9559 | precision recall f1-score support
492
 
493
- 2-year-old 0.0000 0.0000 0.0000 0
494
  ALLERGY 1.0000 0.9167 0.9565 12
495
- ASSESSMENT 0.5000 0.2727 0.3529 11
496
- CC 0.6250 0.4545 0.5263 11
497
  DIAGNOSIS 0.0000 0.0000 0.0000 1
498
- DISPOSITION 1.0000 1.0000 1.0000 1
499
  EDCOURSE 0.0000 0.0000 0.0000 4
500
- EXAM 0.5000 0.4000 0.4444 5
501
- FAM/SOCHX 0.8750 0.9333 0.9032 45
502
- GENHX 0.8654 0.8491 0.8571 53
503
  GYNHX 1.0000 1.0000 1.0000 1
504
- IMAGING 1.0000 1.0000 1.0000 1
505
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
506
  LABS 0.0000 0.0000 0.0000 1
507
  MEDICATIONS 0.7692 1.0000 0.8696 10
508
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
509
- PASTMEDICALHX 0.5455 0.8571 0.6667 14
510
- PASTSURGICAL 0.8571 0.8571 0.8571 7
511
  PLAN 0.3333 1.0000 0.5000 1
512
  PROCEDURES 0.0000 0.0000 0.0000 1
513
- ROS 0.7059 0.7059 0.7059 17
514
 
515
- accuracy 0.7650 200
516
- macro avg 0.5513 0.5832 0.5543 200
517
- weighted avg 0.7489 0.7650 0.7499 200
518
  |
519
- | 0.0008 | 17.0 | 10217 | 0.9696 | precision recall f1-score support
520
 
521
  ALLERGY 1.0000 0.9167 0.9565 12
522
- ASSESSMENT 0.6000 0.2727 0.3750 11
523
- CC 0.6250 0.4545 0.5263 11
524
  DIAGNOSIS 0.0000 0.0000 0.0000 1
525
- DISPOSITION 1.0000 1.0000 1.0000 1
526
  EDCOURSE 0.0000 0.0000 0.0000 4
527
- EXAM 0.5000 0.4000 0.4444 5
528
  FAM/SOCHX 0.8750 0.9333 0.9032 45
529
- GENHX 0.8364 0.8679 0.8519 53
530
  GYNHX 1.0000 1.0000 1.0000 1
531
- IMAGING 1.0000 1.0000 1.0000 1
532
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
533
  LABS 0.0000 0.0000 0.0000 1
534
  MEDICATIONS 0.7692 1.0000 0.8696 10
535
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
536
- PASTMEDICALHX 0.5000 0.7857 0.6111 14
537
- PASTSURGICAL 0.8571 0.8571 0.8571 7
538
  PLAN 0.3333 1.0000 0.5000 1
539
  PROCEDURES 0.0000 0.0000 0.0000 1
540
- ROS 0.7500 0.7059 0.7273 17
541
- first CC 0.0000 0.0000 0.0000 0
542
 
543
- accuracy 0.7650 200
544
- macro avg 0.5546 0.5807 0.5535 200
545
- weighted avg 0.7473 0.7650 0.7476 200
546
  |
547
- | 0.0002 | 18.0 | 10818 | 0.9922 | precision recall f1-score support
548
 
549
  ALLERGY 1.0000 0.9167 0.9565 12
550
- ASSESSMENT 0.4000 0.1818 0.2500 11
551
- CC 0.6667 0.3636 0.4706 11
552
  DIAGNOSIS 0.0000 0.0000 0.0000 1
553
  DISPOSITION 0.2500 1.0000 0.4000 1
554
  EDCOURSE 0.0000 0.0000 0.0000 4
555
- EXAM 0.5000 0.4000 0.4444 5
556
- FAM/SOCHX 0.8750 0.9333 0.9032 45
557
- GENHX 0.7931 0.8679 0.8288 53
558
  GYNHX 1.0000 1.0000 1.0000 1
559
- IMAGING 1.0000 1.0000 1.0000 1
560
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
561
  LABS 0.0000 0.0000 0.0000 1
562
  MEDICATIONS 0.7692 1.0000 0.8696 10
563
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
564
- PASTMEDICALHX 0.6111 0.7857 0.6875 14
565
- PASTSURGICAL 0.8571 0.8571 0.8571 7
566
- PLAN 0.3333 1.0000 0.5000 1
567
  PROCEDURES 0.0000 0.0000 0.0000 1
568
  ROS 0.8000 0.7059 0.7500 17
569
- first CC 0.0000 0.0000 0.0000 0
570
 
571
- accuracy 0.7550 200
572
- macro avg 0.5169 0.5720 0.5199 200
573
- weighted avg 0.7354 0.7550 0.7359 200
574
  |
575
- | 0.0001 | 19.0 | 11419 | 0.9879 | precision recall f1-score support
576
 
577
  ALLERGY 1.0000 0.9167 0.9565 12
578
- ASSESSMENT 0.5000 0.2727 0.3529 11
579
- CC 0.6667 0.3636 0.4706 11
580
  DIAGNOSIS 0.0000 0.0000 0.0000 1
581
- DISPOSITION 0.2500 1.0000 0.4000 1
582
  EDCOURSE 0.0000 0.0000 0.0000 4
583
- EXAM 0.5000 0.4000 0.4444 5
584
- FAM/SOCHX 0.8750 0.9333 0.9032 45
585
  GENHX 0.7931 0.8679 0.8288 53
586
  GYNHX 1.0000 1.0000 1.0000 1
587
- IMAGING 1.0000 1.0000 1.0000 1
588
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
589
  LABS 0.0000 0.0000 0.0000 1
590
  MEDICATIONS 0.7692 1.0000 0.8696 10
591
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
592
- PASTMEDICALHX 0.6111 0.7857 0.6875 14
593
- PASTSURGICAL 0.8571 0.8571 0.8571 7
594
- PLAN 0.3333 1.0000 0.5000 1
595
  PROCEDURES 0.0000 0.0000 0.0000 1
596
  ROS 0.8000 0.7059 0.7500 17
597
- first CC 0.0000 0.0000 0.0000 0
598
 
599
- accuracy 0.7600 200
600
- macro avg 0.5217 0.5763 0.5248 200
601
- weighted avg 0.7409 0.7600 0.7415 200
602
  |
603
- | 0.0001 | 20.0 | 12020 | 0.9946 | precision recall f1-score support
604
 
605
  ALLERGY 1.0000 0.9167 0.9565 12
606
- ASSESSMENT 0.4000 0.1818 0.2500 11
607
  CC 0.5714 0.3636 0.4444 11
608
  DIAGNOSIS 0.0000 0.0000 0.0000 1
609
  DISPOSITION 0.2500 1.0000 0.4000 1
610
  EDCOURSE 0.0000 0.0000 0.0000 4
611
- EXAM 0.5000 0.4000 0.4444 5
612
- FAM/SOCHX 0.8750 0.9333 0.9032 45
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
613
  GENHX 0.7931 0.8679 0.8288 53
614
  GYNHX 1.0000 1.0000 1.0000 1
615
- IMAGING 1.0000 1.0000 1.0000 1
616
- IMMUNIZATIONS 1.0000 1.0000 1.0000 1
617
  LABS 0.0000 0.0000 0.0000 1
618
  MEDICATIONS 0.7692 1.0000 0.8696 10
619
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
620
- PASTMEDICALHX 0.6111 0.7857 0.6875 14
621
- PASTSURGICAL 0.8571 0.8571 0.8571 7
622
- PLAN 0.3333 1.0000 0.5000 1
623
  PROCEDURES 0.0000 0.0000 0.0000 1
624
  ROS 0.8000 0.7059 0.7500 17
625
- first CC 0.0000 0.0000 0.0000 0
626
 
627
- accuracy 0.7550 200
628
- macro avg 0.5124 0.5720 0.5187 200
629
- weighted avg 0.7301 0.7550 0.7344 200
630
  |
631
 
632
 
 
15
 
16
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.9149
19
  - Classification Report: precision recall f1-score support
20
 
21
  ALLERGY 1.0000 0.9167 0.9565 12
22
+ ASSESSMENT 0.5000 0.0909 0.1538 11
23
+ CC 0.5000 0.3636 0.4211 11
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 0.3333 1.0000 0.5000 1
26
  EDCOURSE 0.0000 0.0000 0.0000 4
27
+ EXAM 0.7500 0.6000 0.6667 5
28
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
29
  GENHX 0.7931 0.8679 0.8288 53
30
  GYNHX 1.0000 1.0000 1.0000 1
31
+ IMAGING 0.5000 1.0000 0.6667 1
32
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
33
  LABS 0.0000 0.0000 0.0000 1
34
  MEDICATIONS 0.7692 1.0000 0.8696 10
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
37
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
38
+ PLAN 0.5000 1.0000 0.6667 1
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
  ROS 0.8000 0.7059 0.7500 17
 
41
 
42
+ accuracy 0.7650 200
43
+ macro avg 0.5227 0.6107 0.5356 200
44
+ weighted avg 0.7412 0.7650 0.7391 200
45
 
46
 
47
  ## Model description
 
71
 
72
  ### Training results
73
 
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:-----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | 0.6076 | 1.0 | 601 | 0.3829 | precision recall f1-score support
77
 
78
  ALLERGY 1.0000 0.9167 0.9565 12
79
  ASSESSMENT 0.0000 0.0000 0.0000 11
80
+ CC 0.2632 0.4545 0.3333 11
81
  DIAGNOSIS 0.0000 0.0000 0.0000 1
82
  DISPOSITION 0.0000 0.0000 0.0000 1
83
  EDCOURSE 0.0000 0.0000 0.0000 4
84
+ EXAM 0.2500 0.2000 0.2222 5
85
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
86
+ GENHX 0.6714 0.8868 0.7642 53
87
  GYNHX 0.0000 0.0000 0.0000 1
88
  IMAGING 0.0000 0.0000 0.0000 1
89
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
  LABS 0.0000 0.0000 0.0000 1
91
+ MEDICATIONS 0.8333 1.0000 0.9091 10
92
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
93
+ PASTMEDICALHX 0.5500 0.7857 0.6471 14
94
  PASTSURGICAL 1.0000 1.0000 1.0000 7
95
  PLAN 0.0000 0.0000 0.0000 1
96
  PROCEDURES 0.0000 0.0000 0.0000 1
97
+ ROS 0.7143 0.2941 0.4167 17
98
+
99
+ accuracy 0.7050 200
100
+ macro avg 0.3081 0.3258 0.3088 200
101
+ weighted avg 0.6325 0.7050 0.6534 200
102
+ |
103
+ | 0.2134 | 2.0 | 1202 | 0.4271 | precision recall f1-score support
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
104
 
105
  ALLERGY 1.0000 0.9167 0.9565 12
106
  ASSESSMENT 0.0000 0.0000 0.0000 11
107
+ CC 0.6364 0.6364 0.6364 11
108
  DIAGNOSIS 0.0000 0.0000 0.0000 1
109
+ DISPOSITION 0.0000 0.0000 0.0000 1
110
+ EDCOURSE 0.4000 0.5000 0.4444 4
111
+ EXAM 1.0000 0.4000 0.5714 5
112
  FAM/SOCHX 0.8800 0.9778 0.9263 45
113
+ GENHX 0.8103 0.8868 0.8468 53
114
  GYNHX 0.0000 0.0000 0.0000 1
115
  IMAGING 1.0000 1.0000 1.0000 1
116
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
117
  LABS 0.0000 0.0000 0.0000 1
118
+ MEDICATIONS 0.7692 1.0000 0.8696 10
119
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
120
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
121
  PASTSURGICAL 1.0000 1.0000 1.0000 7
122
+ PLAN 0.5000 1.0000 0.6667 1
123
  PROCEDURES 0.0000 0.0000 0.0000 1
124
+ ROS 0.8571 0.7059 0.7742 17
125
 
126
+ accuracy 0.7850 200
127
+ macro avg 0.5212 0.5440 0.5189 200
128
+ weighted avg 0.7396 0.7850 0.7540 200
129
+ |
130
+ | 0.2007 | 3.0 | 1803 | 0.4843 | precision recall f1-score support
131
 
132
  ALLERGY 1.0000 0.9167 0.9565 12
133
+ ASSESSMENT 0.5000 0.0909 0.1538 11
134
+ CC 0.8000 0.3636 0.5000 11
135
  DIAGNOSIS 0.0000 0.0000 0.0000 1
136
  DISPOSITION 0.0000 0.0000 0.0000 1
137
  EDCOURSE 0.0000 0.0000 0.0000 4
138
+ EXAM 0.2857 0.4000 0.3333 5
139
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
140
+ GENHX 0.7719 0.8302 0.8000 53
141
+ GYNHX 1.0000 1.0000 1.0000 1
142
  IMAGING 1.0000 1.0000 1.0000 1
143
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
144
  LABS 0.0000 0.0000 0.0000 1
145
+ MEDICATIONS 0.7692 1.0000 0.8696 10
146
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
147
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
148
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
149
  PLAN 0.3333 1.0000 0.5000 1
150
  PROCEDURES 0.0000 0.0000 0.0000 1
151
+ ROS 0.7222 0.7647 0.7429 17
152
 
153
+ accuracy 0.7600 200
154
+ macro avg 0.5081 0.5601 0.5077 200
155
+ weighted avg 0.7322 0.7600 0.7290 200
156
+ |
157
+ | 0.1363 | 4.0 | 2404 | 0.4141 | precision recall f1-score support
158
 
159
  ALLERGY 1.0000 0.9167 0.9565 12
160
+ ASSESSMENT 0.0000 0.0000 0.0000 11
161
+ CC 0.5000 0.4545 0.4762 11
162
  DIAGNOSIS 0.0000 0.0000 0.0000 1
163
+ DISPOSITION 0.2500 1.0000 0.4000 1
164
  EDCOURSE 0.0000 0.0000 0.0000 4
165
+ EXAM 0.2500 0.2000 0.2222 5
166
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
167
+ GENHX 0.8000 0.9057 0.8496 53
168
+ GYNHX 0.0000 0.0000 0.0000 1
169
+ IMAGING 0.0000 0.0000 0.0000 1
170
  IMMUNIZATIONS 1.0000 1.0000 1.0000 1
171
  LABS 0.0000 0.0000 0.0000 1
172
+ MEDICATIONS 0.9091 1.0000 0.9524 10
173
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
174
+ PASTMEDICALHX 0.5455 0.8571 0.6667 14
175
  PASTSURGICAL 1.0000 0.8571 0.9231 7
176
+ PLAN 0.5000 1.0000 0.6667 1
177
  PROCEDURES 0.0000 0.0000 0.0000 1
178
+ ROS 0.8000 0.7059 0.7500 17
179
 
180
+ accuracy 0.7600 200
181
+ macro avg 0.4209 0.4937 0.4390 200
182
+ weighted avg 0.6953 0.7600 0.7212 200
183
+ |
184
+ | 0.074 | 5.0 | 3005 | 0.5234 | precision recall f1-score support
185
 
186
  ALLERGY 1.0000 0.9167 0.9565 12
187
+ ASSESSMENT 0.0000 0.0000 0.0000 11
188
+ CC 0.3846 0.4545 0.4167 11
189
  DIAGNOSIS 0.0000 0.0000 0.0000 1
190
+ DISPOSITION 0.1667 1.0000 0.2857 1
191
+ EDCOURSE 0.0000 0.0000 0.0000 4
192
+ EXAM 0.3333 0.2000 0.2500 5
193
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
194
+ GENHX 0.8980 0.8302 0.8627 53
195
+ GYNHX 0.0000 0.0000 0.0000 1
196
  IMAGING 1.0000 1.0000 1.0000 1
197
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
198
  LABS 0.0000 0.0000 0.0000 1
199
+ MEDICATIONS 0.7692 1.0000 0.8696 10
200
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
201
+ PASTMEDICALHX 0.7500 0.8571 0.8000 14
202
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
203
  PLAN 0.3333 1.0000 0.5000 1
204
  PROCEDURES 0.0000 0.0000 0.0000 1
205
+ ROS 0.6087 0.8235 0.7000 17
206
 
207
+ accuracy 0.7500 200
208
+ macro avg 0.4302 0.5447 0.4568 200
209
+ weighted avg 0.7086 0.7500 0.7224 200
210
+ |
211
+ | 0.0508 | 6.0 | 3606 | 0.5171 | precision recall f1-score support
212
 
 
213
  ALLERGY 1.0000 0.9167 0.9565 12
214
+ ASSESSMENT 0.3333 0.1818 0.2353 11
215
  CC 0.6667 0.5455 0.6000 11
216
  DIAGNOSIS 0.0000 0.0000 0.0000 1
217
+ DISPOSITION 1.0000 1.0000 1.0000 1
218
+ EDCOURSE 0.0000 0.0000 0.0000 4
219
+ EXAM 0.4000 0.4000 0.4000 5
220
+ FAM/SOCHX 0.8958 0.9556 0.9247 45
221
+ GENHX 0.9375 0.8491 0.8911 53
222
+ GYNHX 1.0000 1.0000 1.0000 1
223
  IMAGING 1.0000 1.0000 1.0000 1
224
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
225
  LABS 0.0000 0.0000 0.0000 1
226
+ MEDICATIONS 0.7692 1.0000 0.8696 10
227
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
228
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
229
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
230
  PLAN 0.3333 1.0000 0.5000 1
231
  PROCEDURES 0.0000 0.0000 0.0000 1
232
+ ROS 0.7368 0.8235 0.7778 17
233
+ restraint 0.0000 0.0000 0.0000 0
234
 
235
+ accuracy 0.7850 200
236
+ macro avg 0.5320 0.5966 0.5489 200
237
+ weighted avg 0.7723 0.7850 0.7724 200
238
+ |
239
+ | 0.0362 | 7.0 | 4207 | 0.5621 | precision recall f1-score support
240
 
 
241
  ALLERGY 1.0000 0.9167 0.9565 12
242
+ ASSESSMENT 0.5000 0.1818 0.2667 11
243
+ CC 0.4545 0.4545 0.4545 11
244
  DIAGNOSIS 0.0000 0.0000 0.0000 1
245
+ DISPOSITION 0.0000 0.0000 0.0000 1
246
  EDCOURSE 0.0000 0.0000 0.0000 4
247
  EXAM 0.5000 0.4000 0.4444 5
248
  FAM/SOCHX 0.8776 0.9556 0.9149 45
249
+ GENHX 0.8182 0.8491 0.8333 53
250
+ GYNHX 0.0000 0.0000 0.0000 1
251
+ IMAGING 1.0000 1.0000 1.0000 1
252
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
253
  LABS 0.0000 0.0000 0.0000 1
254
+ MEDICATIONS 0.7692 1.0000 0.8696 10
255
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
256
+ PASTMEDICALHX 0.6667 0.8571 0.7500 14
257
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
258
  PLAN 0.3333 1.0000 0.5000 1
259
  PROCEDURES 0.0000 0.0000 0.0000 1
260
+ ROS 0.7059 0.7059 0.7059 17
261
 
262
+ accuracy 0.7600 200
263
+ macro avg 0.4563 0.5160 0.4681 200
264
+ weighted avg 0.7286 0.7600 0.7367 200
265
  |
266
+ | 0.0207 | 8.0 | 4808 | 0.5918 | precision recall f1-score support
267
 
 
268
  ALLERGY 1.0000 0.9167 0.9565 12
269
  ASSESSMENT 0.5000 0.1818 0.2667 11
270
+ CC 0.3846 0.4545 0.4167 11
271
  DIAGNOSIS 0.0000 0.0000 0.0000 1
272
+ DISPOSITION 0.0000 0.0000 0.0000 1
273
+ EDCOURSE 0.0000 0.0000 0.0000 4
274
+ EXAM 0.5000 0.4000 0.4444 5
275
+ FAM/SOCHX 0.8958 0.9556 0.9247 45
276
+ GENHX 0.8364 0.8679 0.8519 53
277
+ GYNHX 0.0000 0.0000 0.0000 1
278
  IMAGING 1.0000 1.0000 1.0000 1
279
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
280
  LABS 0.0000 0.0000 0.0000 1
281
  MEDICATIONS 0.7692 1.0000 0.8696 10
282
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
283
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
284
  PASTSURGICAL 0.8571 0.8571 0.8571 7
285
+ PLAN 0.5000 1.0000 0.6667 1
286
  PROCEDURES 0.0000 0.0000 0.0000 1
287
+ ROS 0.7059 0.7059 0.7059 17
288
 
289
+ accuracy 0.7600 200
290
+ macro avg 0.4540 0.5098 0.4677 200
291
+ weighted avg 0.7270 0.7600 0.7359 200
292
  |
293
+ | 0.0119 | 9.0 | 5409 | 0.7718 | precision recall f1-score support
294
 
 
295
  ALLERGY 1.0000 0.9167 0.9565 12
296
+ ASSESSMENT 0.5000 0.0909 0.1538 11
297
+ CC 0.5000 0.3636 0.4211 11
298
  DIAGNOSIS 0.0000 0.0000 0.0000 1
299
+ DISPOSITION 0.0000 0.0000 0.0000 1
300
  EDCOURSE 0.0000 0.0000 0.0000 4
301
+ EXAM 0.5000 0.6000 0.5455 5
302
+ FAM/SOCHX 0.9318 0.9111 0.9213 45
303
+ GENHX 0.7833 0.8868 0.8319 53
304
  GYNHX 1.0000 1.0000 1.0000 1
305
  IMAGING 1.0000 1.0000 1.0000 1
306
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
307
  LABS 0.0000 0.0000 0.0000 1
308
+ MEDICATIONS 0.8333 1.0000 0.9091 10
309
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
310
+ PASTMEDICALHX 0.5000 0.8571 0.6316 14
311
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
312
+ PLAN 0.5000 1.0000 0.6667 1
313
  PROCEDURES 0.0000 0.0000 0.0000 1
314
+ ROS 0.8571 0.7059 0.7742 17
 
315
 
316
+ accuracy 0.7550 200
317
+ macro avg 0.5203 0.5595 0.5201 200
318
+ weighted avg 0.7443 0.7550 0.7348 200
319
+ |
320
+ | 0.0136 | 10.0 | 6010 | 0.6240 | precision recall f1-score support
321
 
322
  ALLERGY 1.0000 0.9167 0.9565 12
323
+ ASSESSMENT 0.4000 0.1818 0.2500 11
324
+ CC 0.7500 0.2727 0.4000 11
325
  DIAGNOSIS 0.0000 0.0000 0.0000 1
326
+ DISPOSITION 0.2000 1.0000 0.3333 1
327
+ EDCOURSE 0.0000 0.0000 0.0000 4
328
+ EXAM 0.3333 0.2000 0.2500 5
329
+ FAM/SOCHX 0.8958 0.9556 0.9247 45
330
+ GENHX 0.8214 0.8679 0.8440 53
331
  GYNHX 1.0000 1.0000 1.0000 1
332
  IMAGING 1.0000 1.0000 1.0000 1
333
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
334
  LABS 0.0000 0.0000 0.0000 1
335
  MEDICATIONS 0.7692 1.0000 0.8696 10
336
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
337
+ PASTMEDICALHX 0.5455 0.8571 0.6667 14
338
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
339
  PLAN 0.3333 1.0000 0.5000 1
340
  PROCEDURES 0.0000 0.0000 0.0000 1
341
+ ROS 0.8000 0.7059 0.7500 17
342
 
343
+ accuracy 0.7550 200
344
+ macro avg 0.5103 0.5907 0.5134 200
345
+ weighted avg 0.7406 0.7550 0.7325 200
346
+ |
347
+ | 0.0126 | 11.0 | 6611 | 0.7935 | precision recall f1-score support
348
 
349
  ALLERGY 1.0000 0.9167 0.9565 12
350
+ ASSESSMENT 0.5000 0.0909 0.1538 11
351
+ CC 0.5714 0.3636 0.4444 11
352
  DIAGNOSIS 0.0000 0.0000 0.0000 1
353
+ DISPOSITION 0.1667 1.0000 0.2857 1
354
+ EDCOURSE 0.0000 0.0000 0.0000 4
355
+ EXAM 0.2500 0.2000 0.2222 5
356
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
357
+ GENHX 0.7797 0.8679 0.8214 53
358
  GYNHX 1.0000 1.0000 1.0000 1
359
  IMAGING 1.0000 1.0000 1.0000 1
360
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
361
  LABS 0.0000 0.0000 0.0000 1
362
  MEDICATIONS 0.7692 1.0000 0.8696 10
363
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
364
+ PASTMEDICALHX 0.6667 0.8571 0.7500 14
365
+ PASTSURGICAL 0.7500 0.8571 0.8000 7
366
+ PLAN 0.5000 1.0000 0.6667 1
367
  PROCEDURES 0.0000 0.0000 0.0000 1
368
+ ROS 0.8000 0.7059 0.7500 17
369
 
370
+ accuracy 0.7550 200
371
+ macro avg 0.5066 0.5907 0.5151 200
372
+ weighted avg 0.7244 0.7550 0.7252 200
373
+ |
374
+ | 0.0018 | 12.0 | 7212 | 0.8006 | precision recall f1-score support
375
 
376
  ALLERGY 1.0000 0.9167 0.9565 12
377
+ ASSESSMENT 0.5000 0.0909 0.1538 11
378
+ CC 0.3077 0.3636 0.3333 11
379
  DIAGNOSIS 0.0000 0.0000 0.0000 1
380
+ DISPOSITION 0.5000 1.0000 0.6667 1
381
+ EDCOURSE 0.0000 0.0000 0.0000 4
382
+ EXAM 0.5000 0.4000 0.4444 5
383
+ FAM/SOCHX 0.8913 0.9111 0.9011 45
384
+ GENHX 0.7797 0.8679 0.8214 53
385
+ GYNHX 1.0000 1.0000 1.0000 1
386
  IMAGING 1.0000 1.0000 1.0000 1
387
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
388
  LABS 0.0000 0.0000 0.0000 1
389
  MEDICATIONS 0.7692 1.0000 0.8696 10
390
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
391
  PASTMEDICALHX 0.6316 0.8571 0.7273 14
392
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
393
+ PLAN 0.5000 1.0000 0.6667 1
394
  PROCEDURES 0.0000 0.0000 0.0000 1
395
+ ROS 0.7500 0.7059 0.7273 17
396
 
397
+ accuracy 0.7500 200
398
+ macro avg 0.5315 0.5985 0.5429 200
399
+ weighted avg 0.7230 0.7500 0.7242 200
400
+ |
401
+ | 0.0027 | 13.0 | 7813 | 0.7199 | precision recall f1-score support
402
 
403
  ALLERGY 1.0000 0.9167 0.9565 12
404
+ ASSESSMENT 0.5000 0.0909 0.1538 11
405
+ CC 0.5000 0.3636 0.4211 11
406
  DIAGNOSIS 0.0000 0.0000 0.0000 1
407
+ DISPOSITION 0.1667 1.0000 0.2857 1
408
+ EDCOURSE 0.0000 0.0000 0.0000 4
409
+ EXAM 0.5000 0.4000 0.4444 5
410
+ FAM/SOCHX 0.8958 0.9556 0.9247 45
411
  GENHX 0.7797 0.8679 0.8214 53
412
  GYNHX 1.0000 1.0000 1.0000 1
413
  IMAGING 1.0000 1.0000 1.0000 1
414
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
415
  LABS 0.0000 0.0000 0.0000 1
416
  MEDICATIONS 0.7692 1.0000 0.8696 10
417
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
418
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
419
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
420
+ PLAN 0.5000 1.0000 0.6667 1
 
421
  PROCEDURES 0.0000 0.0000 0.0000 1
422
+ ROS 0.8000 0.7059 0.7500 17
 
423
 
424
+ accuracy 0.7600 200
425
+ macro avg 0.5271 0.6007 0.5305 200
426
+ weighted avg 0.7372 0.7600 0.7344 200
427
+ |
428
+ | 0.0054 | 14.0 | 8414 | 0.8456 | precision recall f1-score support
429
 
430
  ALLERGY 1.0000 0.9167 0.9565 12
431
+ ASSESSMENT 0.5000 0.0909 0.1538 11
432
+ CC 0.3333 0.4545 0.3846 11
433
  DIAGNOSIS 0.0000 0.0000 0.0000 1
434
+ DISPOSITION 0.5000 1.0000 0.6667 1
435
+ EDCOURSE 0.0000 0.0000 0.0000 4
436
  EXAM 1.0000 0.4000 0.5714 5
437
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
438
+ GENHX 0.8519 0.8679 0.8598 53
439
+ GYNHX 1.0000 1.0000 1.0000 1
440
+ IMAGING 0.5000 1.0000 0.6667 1
441
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
442
+ LABS 1.0000 1.0000 1.0000 1
443
  MEDICATIONS 0.7692 1.0000 0.8696 10
444
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
445
+ PASTMEDICALHX 0.6667 0.8571 0.7500 14
446
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
447
+ PLAN 0.5000 1.0000 0.6667 1
448
  PROCEDURES 0.0000 0.0000 0.0000 1
449
+ ROS 0.8000 0.7059 0.7500 17
 
450
 
451
  accuracy 0.7700 200
452
+ macro avg 0.5891 0.6553 0.5895 200
453
+ weighted avg 0.7582 0.7700 0.7482 200
454
  |
455
+ | 0.0014 | 15.0 | 9015 | 0.9014 | precision recall f1-score support
456
 
 
457
  ALLERGY 1.0000 0.9167 0.9565 12
458
+ ASSESSMENT 0.0000 0.0000 0.0000 11
459
+ CC 0.5556 0.4545 0.5000 11
460
  DIAGNOSIS 0.0000 0.0000 0.0000 1
461
+ DISPOSITION 0.1667 1.0000 0.2857 1
462
  EDCOURSE 0.0000 0.0000 0.0000 4
463
+ EXAM 0.5000 0.2000 0.2857 5
464
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
465
+ GENHX 0.8364 0.8679 0.8519 53
466
  GYNHX 1.0000 1.0000 1.0000 1
467
+ IMAGING 0.5000 1.0000 0.6667 1
468
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
469
  LABS 0.0000 0.0000 0.0000 1
470
  MEDICATIONS 0.7692 1.0000 0.8696 10
471
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
472
+ PASTMEDICALHX 0.6667 0.8571 0.7500 14
473
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
474
  PLAN 0.3333 1.0000 0.5000 1
475
  PROCEDURES 0.0000 0.0000 0.0000 1
476
+ ROS 0.8000 0.7059 0.7500 17
477
 
478
+ accuracy 0.7550 200
479
+ macro avg 0.4735 0.5907 0.4951 200
480
+ weighted avg 0.7150 0.7550 0.7270 200
481
  |
482
+ | 0.0022 | 16.0 | 9616 | 0.8345 | precision recall f1-score support
483
 
484
  ALLERGY 1.0000 0.9167 0.9565 12
485
+ ASSESSMENT 0.5000 0.0909 0.1538 11
486
+ CC 0.4545 0.4545 0.4545 11
487
  DIAGNOSIS 0.0000 0.0000 0.0000 1
488
+ DISPOSITION 0.5000 1.0000 0.6667 1
489
  EDCOURSE 0.0000 0.0000 0.0000 4
490
+ EXAM 0.6667 0.4000 0.5000 5
491
  FAM/SOCHX 0.8750 0.9333 0.9032 45
492
+ GENHX 0.8519 0.8679 0.8598 53
493
  GYNHX 1.0000 1.0000 1.0000 1
494
+ IMAGING 0.5000 1.0000 0.6667 1
495
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
496
  LABS 0.0000 0.0000 0.0000 1
497
  MEDICATIONS 0.7692 1.0000 0.8696 10
498
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
499
+ PASTMEDICALHX 0.5455 0.8571 0.6667 14
500
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
501
  PLAN 0.3333 1.0000 0.5000 1
502
  PROCEDURES 0.0000 0.0000 0.0000 1
503
+ ROS 0.8000 0.7059 0.7500 17
 
504
 
505
+ accuracy 0.7600 200
506
+ macro avg 0.5148 0.6042 0.5269 200
507
+ weighted avg 0.7456 0.7600 0.7381 200
508
  |
509
+ | 0.0003 | 17.0 | 10217 | 0.8792 | precision recall f1-score support
510
 
511
  ALLERGY 1.0000 0.9167 0.9565 12
512
+ ASSESSMENT 0.5000 0.0909 0.1538 11
513
+ CC 0.5714 0.3636 0.4444 11
514
  DIAGNOSIS 0.0000 0.0000 0.0000 1
515
  DISPOSITION 0.2500 1.0000 0.4000 1
516
  EDCOURSE 0.0000 0.0000 0.0000 4
517
+ EXAM 0.7500 0.6000 0.6667 5
518
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
519
+ GENHX 0.8070 0.8679 0.8364 53
520
  GYNHX 1.0000 1.0000 1.0000 1
521
+ IMAGING 0.5000 1.0000 0.6667 1
522
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
523
  LABS 0.0000 0.0000 0.0000 1
524
  MEDICATIONS 0.7692 1.0000 0.8696 10
525
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
526
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
527
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
528
+ PLAN 0.5000 1.0000 0.6667 1
529
  PROCEDURES 0.0000 0.0000 0.0000 1
530
  ROS 0.8000 0.7059 0.7500 17
 
531
 
532
+ accuracy 0.7650 200
533
+ macro avg 0.5213 0.6107 0.5311 200
534
+ weighted avg 0.7462 0.7650 0.7404 200
535
  |
536
+ | 0.0003 | 18.0 | 10818 | 0.9484 | precision recall f1-score support
537
 
538
  ALLERGY 1.0000 0.9167 0.9565 12
539
+ ASSESSMENT 0.5000 0.0909 0.1538 11
540
+ CC 0.5000 0.3636 0.4211 11
541
  DIAGNOSIS 0.0000 0.0000 0.0000 1
542
+ DISPOSITION 0.3333 1.0000 0.5000 1
543
  EDCOURSE 0.0000 0.0000 0.0000 4
544
+ EXAM 0.7500 0.6000 0.6667 5
545
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
546
  GENHX 0.7931 0.8679 0.8288 53
547
  GYNHX 1.0000 1.0000 1.0000 1
548
+ IMAGING 0.5000 1.0000 0.6667 1
549
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
550
  LABS 0.0000 0.0000 0.0000 1
551
  MEDICATIONS 0.7692 1.0000 0.8696 10
552
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
553
+ PASTMEDICALHX 0.7059 0.8571 0.7742 14
554
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
555
+ PLAN 0.5000 1.0000 0.6667 1
556
  PROCEDURES 0.0000 0.0000 0.0000 1
557
  ROS 0.8000 0.7059 0.7500 17
 
558
 
559
+ accuracy 0.7650 200
560
+ macro avg 0.5247 0.6107 0.5370 200
561
+ weighted avg 0.7387 0.7650 0.7381 200
562
  |
563
+ | 0.0008 | 19.0 | 11419 | 0.9211 | precision recall f1-score support
564
 
565
  ALLERGY 1.0000 0.9167 0.9565 12
566
+ ASSESSMENT 0.5000 0.0909 0.1538 11
567
  CC 0.5714 0.3636 0.4444 11
568
  DIAGNOSIS 0.0000 0.0000 0.0000 1
569
  DISPOSITION 0.2500 1.0000 0.4000 1
570
  EDCOURSE 0.0000 0.0000 0.0000 4
571
+ EXAM 0.7500 0.6000 0.6667 5
572
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
573
+ GENHX 0.8070 0.8679 0.8364 53
574
+ GYNHX 1.0000 1.0000 1.0000 1
575
+ IMAGING 0.5000 1.0000 0.6667 1
576
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
577
+ LABS 0.0000 0.0000 0.0000 1
578
+ MEDICATIONS 0.7692 1.0000 0.8696 10
579
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
580
+ PASTMEDICALHX 0.6667 0.8571 0.7500 14
581
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
582
+ PLAN 0.5000 1.0000 0.6667 1
583
+ PROCEDURES 0.0000 0.0000 0.0000 1
584
+ ROS 0.8000 0.7059 0.7500 17
585
+
586
+ accuracy 0.7650 200
587
+ macro avg 0.5229 0.6107 0.5323 200
588
+ weighted avg 0.7431 0.7650 0.7392 200
589
+ |
590
+ | 0.0002 | 20.0 | 12020 | 0.9149 | precision recall f1-score support
591
+
592
+ ALLERGY 1.0000 0.9167 0.9565 12
593
+ ASSESSMENT 0.5000 0.0909 0.1538 11
594
+ CC 0.5000 0.3636 0.4211 11
595
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
596
+ DISPOSITION 0.3333 1.0000 0.5000 1
597
+ EDCOURSE 0.0000 0.0000 0.0000 4
598
+ EXAM 0.7500 0.6000 0.6667 5
599
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
600
  GENHX 0.7931 0.8679 0.8288 53
601
  GYNHX 1.0000 1.0000 1.0000 1
602
+ IMAGING 0.5000 1.0000 0.6667 1
603
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
604
  LABS 0.0000 0.0000 0.0000 1
605
  MEDICATIONS 0.7692 1.0000 0.8696 10
606
  OTHER_HISTORY 0.0000 0.0000 0.0000 3
607
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
608
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
609
+ PLAN 0.5000 1.0000 0.6667 1
610
  PROCEDURES 0.0000 0.0000 0.0000 1
611
  ROS 0.8000 0.7059 0.7500 17
 
612
 
613
+ accuracy 0.7650 200
614
+ macro avg 0.5227 0.6107 0.5356 200
615
+ weighted avg 0.7412 0.7650 0.7391 200
616
  |
617
 
618
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7bd2b4538d67bedfa3a93388a440ea96ecd3a56481d1d874eff5d6d4cce9ed5a
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:128e80ed78a38f2cb5615d3b2c3b128c8d89808bfe79e25ba5ba54ca33073398
3
  size 990345064
runs/Jan15_18-28-45_3e571f4cc206/events.out.tfevents.1705343371.3e571f4cc206.3629.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a88c8743a2ab6aee57a5c2b882d67f1c5af96dd68ac60ee19727cb058b88c679
3
- size 14237
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:461f57da6f66cfa567dda1d839b52bac5c612c6a1ee53200cc9baee2b3565f8d
3
+ size 14862