Hugging Face's logo

kmanaa
/
t5-dialogue-classification-3

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
kmanaa commited on
Commit
5cc3601
•
1 Parent(s): 1dba764

End of training

Browse files
Files changed (3) hide show
  1. README.md +324 -327
  2. model.safetensors +1 -1
  3. runs/Mar11_12-08-26_e24496f93c6c/events.out.tfevents.1710158908.e24496f93c6c.190.0 +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- base_model: google/flan-t5-small
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -13,36 +13,35 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # t5-dialogue-classification-3
15
 
16
- This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.4698
19
  - Classification Report: precision recall f1-score support
20
 
21
  ALLERGY 1.0000 0.2500 0.4000 4
22
- ASSESSMENT 0.0000 0.0000 0.0000 4
23
- CC 0.4286 0.7500 0.5455 4
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
  DISPOSITION 0.0000 0.0000 0.0000 2
26
  EDCOURSE 0.0000 0.0000 0.0000 3
27
  EXAM 0.3333 1.0000 0.5000 1
28
- FAM/SOCHX 0.8400 0.9545 0.8936 22
29
- GENHX 0.8947 0.8500 0.8718 20
30
  GYNHX 0.0000 0.0000 0.0000 1
31
  IMAGING 0.0000 0.0000 0.0000 1
32
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
- MEDICATIONS 0.5000 0.7143 0.5882 7
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
37
- PASTSURGICAL 0.8889 1.0000 0.9412 8
38
- PLAN 0.0000 0.0000 0.0000 3
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
- ROS 0.8889 0.7273 0.8000 11
41
- cesarian 0.0000 0.0000 0.0000 0
42
 
43
- accuracy 0.6700 100
44
- macro avg 0.2988 0.3331 0.2924 100
45
- weighted avg 0.6481 0.6700 0.6422 100
46
 
47
 
48
  ## Model description
@@ -72,549 +71,547 @@ The following hyperparameters were used during training:
72
 
73
  ### Training results
74
 
75
- | Training Loss | Epoch | Step | Validation Loss | Classification Report |
76
- |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
77
- | No log | 1.0 | 172 | 0.6054 | precision recall f1-score support
78
 
79
- ALLERGY 0.6667 0.5000 0.5714 4
80
  ASSESSMENT 0.0000 0.0000 0.0000 4
81
- CC 0.0000 0.0000 0.0000 4
82
  DIAGNOSIS 0.0000 0.0000 0.0000 1
83
  DISPOSITION 0.0000 0.0000 0.0000 2
84
  EDCOURSE 0.0000 0.0000 0.0000 3
85
- EXAM 0.0000 0.0000 0.0000 1
86
- FAM/SOCHX 0.5833 0.9545 0.7241 22
87
- GENHX 0.7273 0.8000 0.7619 20
88
  GYNHX 0.0000 0.0000 0.0000 1
89
  IMAGING 0.0000 0.0000 0.0000 1
90
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
91
  LABS 0.0000 0.0000 0.0000 1
92
- MEDICATIONS 0.7500 0.4286 0.5455 7
93
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
94
- PASTMEDICALHX 0.1000 0.7500 0.1765 4
95
- PASTSURGICAL 1.0000 0.2500 0.4000 8
96
  PLAN 0.0000 0.0000 0.0000 3
97
  PROCEDURES 0.0000 0.0000 0.0000 1
98
- ROS 0.3333 0.0909 0.1429 11
99
 
100
- accuracy 0.4800 100
101
- macro avg 0.2080 0.1887 0.1661 100
102
- weighted avg 0.4736 0.4800 0.4275 100
103
- |
104
- | No log | 2.0 | 344 | 0.3983 | precision recall f1-score support
105
 
106
- ALLERGY 0.5000 0.2500 0.3333 4
107
  ASSESSMENT 0.0000 0.0000 0.0000 4
108
- CC 0.1667 0.2500 0.2000 4
109
  DIAGNOSIS 0.0000 0.0000 0.0000 1
110
  DISPOSITION 0.0000 0.0000 0.0000 2
111
  EDCOURSE 0.0000 0.0000 0.0000 3
112
- EXAM 1.0000 1.0000 1.0000 1
113
- FAM/SOCHX 0.8750 0.9545 0.9130 22
114
- GENHX 0.6923 0.9000 0.7826 20
115
  GYNHX 0.0000 0.0000 0.0000 1
116
  IMAGING 0.0000 0.0000 0.0000 1
117
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
118
  LABS 0.0000 0.0000 0.0000 1
119
- MEDICATIONS 0.5556 0.7143 0.6250 7
120
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
121
- PASTMEDICALHX 0.3077 1.0000 0.4706 4
122
- PASTSURGICAL 0.8889 1.0000 0.9412 8
123
  PLAN 0.0000 0.0000 0.0000 3
124
  PROCEDURES 0.0000 0.0000 0.0000 1
125
- ROS 0.7000 0.6364 0.6667 11
126
 
127
- accuracy 0.6600 100
128
- macro avg 0.2843 0.3353 0.2966 100
129
- weighted avg 0.5669 0.6600 0.5999 100
130
- |
131
- | 0.6206 | 3.0 | 516 | 0.3787 | precision recall f1-score support
132
 
133
  ALLERGY 1.0000 0.2500 0.4000 4
134
  ASSESSMENT 0.0000 0.0000 0.0000 4
135
- CC 0.3000 0.7500 0.4286 4
136
  DIAGNOSIS 0.0000 0.0000 0.0000 1
137
  DISPOSITION 0.0000 0.0000 0.0000 2
138
  EDCOURSE 0.0000 0.0000 0.0000 3
139
- EXAM 0.5000 1.0000 0.6667 1
140
- FAM/SOCHX 0.8077 0.9545 0.8750 22
141
- GENHX 0.8571 0.9000 0.8780 20
142
  GYNHX 0.0000 0.0000 0.0000 1
143
  IMAGING 0.0000 0.0000 0.0000 1
144
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
145
  LABS 0.0000 0.0000 0.0000 1
146
  MEDICATIONS 0.5556 0.7143 0.6250 7
147
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
148
- PASTMEDICALHX 0.4000 1.0000 0.5714 4
149
- PASTSURGICAL 0.8000 1.0000 0.8889 8
150
  PLAN 0.0000 0.0000 0.0000 3
151
  PROCEDURES 0.0000 0.0000 0.0000 1
152
- ROS 0.8889 0.7273 0.8000 11
153
 
154
- accuracy 0.6900 100
155
- macro avg 0.3055 0.3648 0.3067 100
156
- weighted avg 0.6228 0.6900 0.6336 100
157
- |
158
- | 0.6206 | 4.0 | 688 | 0.3752 | precision recall f1-score support
159
 
160
  ALLERGY 1.0000 0.2500 0.4000 4
161
- ASSESSMENT 0.0000 0.0000 0.0000 4
162
  CC 0.6000 0.7500 0.6667 4
163
  DIAGNOSIS 0.0000 0.0000 0.0000 1
164
  DISPOSITION 0.0000 0.0000 0.0000 2
165
  EDCOURSE 0.0000 0.0000 0.0000 3
166
- EXAM 0.3333 1.0000 0.5000 1
167
- FAM/SOCHX 0.8077 0.9545 0.8750 22
168
- GENHX 0.8947 0.8500 0.8718 20
169
  GYNHX 0.0000 0.0000 0.0000 1
170
  IMAGING 0.0000 0.0000 0.0000 1
171
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
172
  LABS 0.0000 0.0000 0.0000 1
173
- MEDICATIONS 0.4545 0.7143 0.5556 7
174
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
175
- PASTMEDICALHX 0.2667 1.0000 0.4211 4
176
- PASTSURGICAL 0.8000 1.0000 0.8889 8
177
- PLAN 0.0000 0.0000 0.0000 3
178
  PROCEDURES 0.0000 0.0000 0.0000 1
179
  ROS 0.8750 0.6364 0.7368 11
180
 
181
- accuracy 0.6700 100
182
- macro avg 0.3016 0.3578 0.2958 100
183
- weighted avg 0.6267 0.6700 0.6224 100
184
- |
185
- | 0.6206 | 5.0 | 860 | 0.3933 | precision recall f1-score support
186
 
187
- ALLERGY 1.0000 0.5000 0.6667 4
188
- ASSESSMENT 0.0000 0.0000 0.0000 4
189
- CC 0.2143 0.7500 0.3333 4
190
  DIAGNOSIS 0.0000 0.0000 0.0000 1
191
  DISPOSITION 0.0000 0.0000 0.0000 2
192
  EDCOURSE 0.0000 0.0000 0.0000 3
193
- EXAM 0.2500 1.0000 0.4000 1
194
- FAM/SOCHX 0.8077 0.9545 0.8750 22
195
- GENHX 1.0000 0.7000 0.8235 20
196
  GYNHX 0.0000 0.0000 0.0000 1
197
  IMAGING 0.0000 0.0000 0.0000 1
198
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
199
  LABS 0.0000 0.0000 0.0000 1
200
- MEDICATIONS 0.5556 0.7143 0.6250 7
201
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
202
- PASTMEDICALHX 0.5714 1.0000 0.7273 4
203
- PASTSURGICAL 0.8000 1.0000 0.8889 8
204
- PLAN 0.0000 0.0000 0.0000 3
205
  PROCEDURES 0.0000 0.0000 0.0000 1
206
- ROS 0.8889 0.7273 0.8000 11
207
 
208
- accuracy 0.6600 100
209
- macro avg 0.3044 0.3673 0.3070 100
210
- weighted avg 0.6523 0.6600 0.6332 100
211
- |
212
- | 0.1606 | 6.0 | 1032 | 0.3971 | precision recall f1-score support
213
 
214
  ALLERGY 1.0000 0.2500 0.4000 4
215
- ASSESSMENT 0.0000 0.0000 0.0000 4
216
- CC 0.3750 0.7500 0.5000 4
217
  DIAGNOSIS 0.0000 0.0000 0.0000 1
218
  DISPOSITION 0.0000 0.0000 0.0000 2
219
  EDCOURSE 0.0000 0.0000 0.0000 3
220
  EXAM 0.2500 1.0000 0.4000 1
221
- FAM/SOCHX 0.8077 0.9545 0.8750 22
222
- GENHX 0.9048 0.9500 0.9268 20
223
  GYNHX 0.0000 0.0000 0.0000 1
224
  IMAGING 0.0000 0.0000 0.0000 1
225
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
226
  LABS 0.0000 0.0000 0.0000 1
227
- MEDICATIONS 0.5556 0.7143 0.6250 7
228
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
229
- PASTMEDICALHX 0.4444 1.0000 0.6154 4
230
- PASTSURGICAL 0.8889 1.0000 0.9412 8
231
- PLAN 1.0000 0.3333 0.5000 3
232
  PROCEDURES 0.0000 0.0000 0.0000 1
233
  ROS 0.8750 0.6364 0.7368 11
234
 
235
- accuracy 0.7000 100
236
- macro avg 0.3551 0.3794 0.3260 100
237
- weighted avg 0.6702 0.7000 0.6576 100
238
- |
239
- | 0.1606 | 7.0 | 1204 | 0.3323 | precision recall f1-score support
240
 
241
- ALLERGY 1.0000 0.5000 0.6667 4
242
- ASSESSMENT 0.3333 0.2500 0.2857 4
243
- CC 0.2500 0.7500 0.3750 4
244
  DIAGNOSIS 0.0000 0.0000 0.0000 1
245
  DISPOSITION 0.0000 0.0000 0.0000 2
246
- EDCOURSE 0.5000 0.3333 0.4000 3
247
- EXAM 0.3333 1.0000 0.5000 1
248
- FAM/SOCHX 0.8400 0.9545 0.8936 22
249
- GENHX 0.9500 0.9500 0.9500 20
250
  GYNHX 0.0000 0.0000 0.0000 1
251
  IMAGING 0.0000 0.0000 0.0000 1
252
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
253
  LABS 0.0000 0.0000 0.0000 1
254
- MEDICATIONS 0.6667 0.5714 0.6154 7
255
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
256
- PASTMEDICALHX 0.4444 1.0000 0.6154 4
257
- PASTSURGICAL 0.8889 1.0000 0.9412 8
258
- PLAN 0.0000 0.0000 0.0000 3
259
  PROCEDURES 0.0000 0.0000 0.0000 1
260
- ROS 0.8333 0.4545 0.5882 11
261
 
262
- accuracy 0.6900 100
263
- macro avg 0.3520 0.3882 0.3416 100
264
- weighted avg 0.6837 0.6900 0.6644 100
265
- |
266
- | 0.1606 | 8.0 | 1376 | 0.3775 | precision recall f1-score support
267
 
268
  ALLERGY 1.0000 0.2500 0.4000 4
269
- ASSESSMENT 0.0000 0.0000 0.0000 4
270
- CC 0.2500 0.7500 0.3750 4
271
  DIAGNOSIS 0.0000 0.0000 0.0000 1
272
  DISPOSITION 0.0000 0.0000 0.0000 2
273
  EDCOURSE 0.0000 0.0000 0.0000 3
274
- EXAM 0.5000 1.0000 0.6667 1
275
- FAM/SOCHX 0.8400 0.9545 0.8936 22
276
- GENHX 0.9500 0.9500 0.9500 20
277
  GYNHX 0.0000 0.0000 0.0000 1
278
  IMAGING 0.0000 0.0000 0.0000 1
279
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
280
  LABS 0.0000 0.0000 0.0000 1
281
- MEDICATIONS 0.5000 0.7143 0.5882 7
282
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
283
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
284
- PASTSURGICAL 0.8000 1.0000 0.8889 8
285
- PLAN 0.0000 0.0000 0.0000 3
286
  PROCEDURES 0.0000 0.0000 0.0000 1
287
- ROS 0.8571 0.5455 0.6667 11
288
 
289
- accuracy 0.6700 100
290
- macro avg 0.3099 0.3457 0.3015 100
291
- weighted avg 0.6431 0.6700 0.6339 100
292
- |
293
- | 0.1029 | 9.0 | 1548 | 0.4163 | precision recall f1-score support
294
 
295
  ALLERGY 1.0000 0.2500 0.4000 4
296
- ASSESSMENT 0.0000 0.0000 0.0000 4
297
- CC 0.3750 0.7500 0.5000 4
298
  DIAGNOSIS 0.0000 0.0000 0.0000 1
299
  DISPOSITION 0.0000 0.0000 0.0000 2
300
  EDCOURSE 0.0000 0.0000 0.0000 3
301
- EXAM 0.5000 1.0000 0.6667 1
302
- FAM/SOCHX 0.8750 0.9545 0.9130 22
303
- GENHX 0.8261 0.9500 0.8837 20
304
  GYNHX 0.0000 0.0000 0.0000 1
305
  IMAGING 0.0000 0.0000 0.0000 1
306
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
307
  LABS 0.0000 0.0000 0.0000 1
308
- MEDICATIONS 0.5000 0.7143 0.5882 7
309
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
310
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
311
  PASTSURGICAL 1.0000 1.0000 1.0000 8
312
- PLAN 0.0000 0.0000 0.0000 3
313
  PROCEDURES 0.0000 0.0000 0.0000 1
314
- ROS 0.8571 0.5455 0.6667 11
315
 
316
- accuracy 0.6700 100
317
- macro avg 0.3217 0.3457 0.3109 100
318
- weighted avg 0.6470 0.6700 0.6388 100
319
- |
320
- | 0.1029 | 10.0 | 1720 | 0.4054 | precision recall f1-score support
321
 
322
  ALLERGY 1.0000 0.2500 0.4000 4
323
- ASSESSMENT 0.2500 0.2500 0.2500 4
324
- CC 0.5000 0.7500 0.6000 4
325
  DIAGNOSIS 0.0000 0.0000 0.0000 1
326
  DISPOSITION 0.0000 0.0000 0.0000 2
327
  EDCOURSE 0.0000 0.0000 0.0000 3
328
  EXAM 0.3333 1.0000 0.5000 1
329
- FAM/SOCHX 0.8750 0.9545 0.9130 22
330
- GENHX 0.9048 0.9500 0.9268 20
331
  GYNHX 0.0000 0.0000 0.0000 1
332
  IMAGING 0.0000 0.0000 0.0000 1
333
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
334
  LABS 0.0000 0.0000 0.0000 1
335
- MEDICATIONS 0.6250 0.7143 0.6667 7
336
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
337
- PASTMEDICALHX 0.4444 1.0000 0.6154 4
338
- PASTSURGICAL 0.8889 1.0000 0.9412 8
339
- PLAN 0.0000 0.0000 0.0000 3
340
  PROCEDURES 0.0000 0.0000 0.0000 1
341
- ROS 0.8889 0.7273 0.8000 11
342
 
343
  accuracy 0.7100 100
344
- macro avg 0.3355 0.3798 0.3307 100
345
- weighted avg 0.6772 0.7100 0.6758 100
346
- |
347
- | 0.1029 | 11.0 | 1892 | 0.3970 | precision recall f1-score support
348
-
349
- ALLERGY 1.0000 0.5000 0.6667 4
350
- ASSESSMENT 0.2000 0.2500 0.2222 4
351
- CC 0.5000 0.5000 0.5000 4
352
  DIAGNOSIS 0.0000 0.0000 0.0000 1
353
  DISPOSITION 0.0000 0.0000 0.0000 2
354
  EDCOURSE 0.0000 0.0000 0.0000 3
355
- EXAM 0.3333 1.0000 0.5000 1
356
- FAM/SOCHX 0.8077 0.9545 0.8750 22
357
- GENHX 0.8947 0.8500 0.8718 20
358
  GYNHX 0.0000 0.0000 0.0000 1
359
  IMAGING 0.0000 0.0000 0.0000 1
360
  IMMUNIZATIONS 1.0000 1.0000 1.0000 1
361
  LABS 0.0000 0.0000 0.0000 1
362
- MEDICATIONS 0.7143 0.7143 0.7143 7
363
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
364
- PASTMEDICALHX 0.5714 1.0000 0.7273 4
365
- PASTSURGICAL 0.8889 1.0000 0.9412 8
366
- PLAN 0.0000 0.0000 0.0000 3
367
  PROCEDURES 0.0000 0.0000 0.0000 1
368
  ROS 0.8750 0.6364 0.7368 11
369
 
370
- accuracy 0.6900 100
371
- macro avg 0.3893 0.4203 0.3878 100
372
- weighted avg 0.6782 0.6900 0.6729 100
373
- |
374
- | 0.0648 | 12.0 | 2064 | 0.4382 | precision recall f1-score support
375
 
376
- ALLERGY 1.0000 0.5000 0.6667 4
377
- ASSESSMENT 0.0000 0.0000 0.0000 4
378
- CC 0.5000 0.5000 0.5000 4
379
  DIAGNOSIS 0.0000 0.0000 0.0000 1
380
  DISPOSITION 0.0000 0.0000 0.0000 2
381
  EDCOURSE 0.0000 0.0000 0.0000 3
382
- EXAM 0.5000 1.0000 0.6667 1
383
- FAM/SOCHX 0.8750 0.9545 0.9130 22
384
- GENHX 0.8636 0.9500 0.9048 20
385
  GYNHX 0.0000 0.0000 0.0000 1
386
  IMAGING 0.0000 0.0000 0.0000 1
387
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
388
  LABS 0.0000 0.0000 0.0000 1
389
- MEDICATIONS 0.5556 0.7143 0.6250 7
390
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
391
- PASTMEDICALHX 0.5000 1.0000 0.6667 4
392
- PASTSURGICAL 0.8000 1.0000 0.8889 8
393
- PLAN 0.0000 0.0000 0.0000 3
394
  PROCEDURES 0.0000 0.0000 0.0000 1
395
- ROS 0.8571 0.5455 0.6667 11
396
 
397
- accuracy 0.6800 100
398
- macro avg 0.3226 0.3582 0.3249 100
399
- weighted avg 0.6474 0.6800 0.6500 100
400
- |
401
- | 0.0648 | 13.0 | 2236 | 0.4215 | precision recall f1-score support
402
 
403
- ALLERGY 1.0000 0.5000 0.6667 4
404
- ASSESSMENT 0.0000 0.0000 0.0000 4
405
- CC 0.6000 0.7500 0.6667 4
406
  DIAGNOSIS 0.0000 0.0000 0.0000 1
407
  DISPOSITION 0.0000 0.0000 0.0000 2
408
  EDCOURSE 0.0000 0.0000 0.0000 3
409
- EXAM 0.5000 1.0000 0.6667 1
410
- FAM/SOCHX 0.8750 0.9545 0.9130 22
411
- GENHX 0.8571 0.9000 0.8780 20
412
  GYNHX 0.0000 0.0000 0.0000 1
413
  IMAGING 0.0000 0.0000 0.0000 1
414
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
415
  LABS 0.0000 0.0000 0.0000 1
416
- MEDICATIONS 0.5556 0.7143 0.6250 7
417
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
418
- PASTMEDICALHX 0.5000 1.0000 0.6667 4
419
- PASTSURGICAL 0.8889 1.0000 0.9412 8
420
- PLAN 0.0000 0.0000 0.0000 3
421
  PROCEDURES 0.0000 0.0000 0.0000 1
422
- ROS 0.8000 0.7273 0.7619 11
423
 
424
- accuracy 0.7000 100
425
- macro avg 0.3288 0.3773 0.3393 100
426
- weighted avg 0.6509 0.7000 0.6660 100
427
- |
428
- | 0.0648 | 14.0 | 2408 | 0.4805 | precision recall f1-score support
429
 
430
- ALLERGY 1.0000 0.5000 0.6667 4
431
- ASSESSMENT 0.0000 0.0000 0.0000 4
432
- CC 0.2857 0.5000 0.3636 4
433
  DIAGNOSIS 0.0000 0.0000 0.0000 1
434
  DISPOSITION 0.0000 0.0000 0.0000 2
435
  EDCOURSE 0.0000 0.0000 0.0000 3
436
- EXAM 0.5000 1.0000 0.6667 1
437
- FAM/SOCHX 0.8750 0.9545 0.9130 22
438
- GENHX 0.8636 0.9500 0.9048 20
439
  GYNHX 0.0000 0.0000 0.0000 1
440
  IMAGING 0.0000 0.0000 0.0000 1
441
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
442
  LABS 0.0000 0.0000 0.0000 1
443
- MEDICATIONS 0.5556 0.7143 0.6250 7
444
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
445
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
446
- PASTSURGICAL 0.8889 1.0000 0.9412 8
447
- PLAN 0.5000 0.3333 0.4000 3
448
  PROCEDURES 0.0000 0.0000 0.0000 1
449
- ROS 0.8571 0.5455 0.6667 11
450
 
451
- accuracy 0.6800 100
452
- macro avg 0.3413 0.3624 0.3374 100
453
- weighted avg 0.6609 0.6800 0.6581 100
454
- |
455
- | 0.0452 | 15.0 | 2580 | 0.4488 | precision recall f1-score support
456
 
457
- ALLERGY 1.0000 0.5000 0.6667 4
458
- ASSESSMENT 0.0000 0.0000 0.0000 4
459
- CC 0.5000 0.5000 0.5000 4
460
  DIAGNOSIS 0.0000 0.0000 0.0000 1
461
  DISPOSITION 0.0000 0.0000 0.0000 2
462
  EDCOURSE 0.0000 0.0000 0.0000 3
463
  EXAM 0.3333 1.0000 0.5000 1
464
- FAM/SOCHX 0.8400 0.9545 0.8936 22
465
- GENHX 0.8947 0.8500 0.8718 20
466
  GYNHX 0.0000 0.0000 0.0000 1
467
  IMAGING 0.0000 0.0000 0.0000 1
468
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
469
  LABS 0.0000 0.0000 0.0000 1
470
- MEDICATIONS 0.5556 0.7143 0.6250 7
471
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
472
- PASTMEDICALHX 0.5714 1.0000 0.7273 4
473
- PASTSURGICAL 0.8000 1.0000 0.8889 8
474
- PLAN 0.5000 0.3333 0.4000 3
475
  PROCEDURES 0.0000 0.0000 0.0000 1
476
- ROS 0.8750 0.6364 0.7368 11
477
 
478
- accuracy 0.6800 100
479
- macro avg 0.3435 0.3744 0.3405 100
480
- weighted avg 0.6641 0.6800 0.6596 100
481
- |
482
- | 0.0452 | 16.0 | 2752 | 0.4551 | precision recall f1-score support
483
 
484
  ALLERGY 1.0000 0.2500 0.4000 4
485
- ASSESSMENT 0.0000 0.0000 0.0000 4
486
- CC 0.3333 0.5000 0.4000 4
487
  DIAGNOSIS 0.0000 0.0000 0.0000 1
488
  DISPOSITION 0.0000 0.0000 0.0000 2
489
  EDCOURSE 0.0000 0.0000 0.0000 3
490
- EXAM 0.5000 1.0000 0.6667 1
491
- FAM/SOCHX 0.8400 0.9545 0.8936 22
492
- GENHX 0.9048 0.9500 0.9268 20
493
  GYNHX 0.0000 0.0000 0.0000 1
494
  IMAGING 0.0000 0.0000 0.0000 1
495
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
496
  LABS 0.0000 0.0000 0.0000 1
497
- MEDICATIONS 0.5000 0.7143 0.5882 7
498
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
499
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
500
- PASTSURGICAL 0.8889 1.0000 0.9412 8
501
- PLAN 0.0000 0.0000 0.0000 3
502
  PROCEDURES 0.0000 0.0000 0.0000 1
503
- ROS 0.8750 0.6364 0.7368 11
504
 
505
- accuracy 0.6700 100
506
- macro avg 0.3171 0.3378 0.3077 100
507
- weighted avg 0.6464 0.6700 0.6422 100
508
- |
509
- | 0.0452 | 17.0 | 2924 | 0.4787 | precision recall f1-score support
510
 
511
  ALLERGY 1.0000 0.2500 0.4000 4
512
- ASSESSMENT 0.0000 0.0000 0.0000 4
513
- CC 0.4286 0.7500 0.5455 4
514
  DIAGNOSIS 0.0000 0.0000 0.0000 1
515
  DISPOSITION 0.0000 0.0000 0.0000 2
516
  EDCOURSE 0.0000 0.0000 0.0000 3
517
  EXAM 0.3333 1.0000 0.5000 1
518
- FAM/SOCHX 0.8400 0.9545 0.8936 22
519
- GENHX 0.8947 0.8500 0.8718 20
520
  GYNHX 0.0000 0.0000 0.0000 1
521
  IMAGING 0.0000 0.0000 0.0000 1
522
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
523
  LABS 0.0000 0.0000 0.0000 1
524
- MEDICATIONS 0.5000 0.7143 0.5882 7
525
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
526
- PASTMEDICALHX 0.4286 0.7500 0.5455 4
527
- PASTSURGICAL 0.8889 1.0000 0.9412 8
528
- PLAN 0.0000 0.0000 0.0000 3
529
  PROCEDURES 0.0000 0.0000 0.0000 1
530
- ROS 0.8889 0.7273 0.8000 11
531
 
532
- accuracy 0.6700 100
533
- macro avg 0.3101 0.3498 0.3043 100
534
- weighted avg 0.6453 0.6700 0.6401 100
535
- |
536
- | 0.0312 | 18.0 | 3096 | 0.4561 | precision recall f1-score support
537
 
538
- ALLERGY 1.0000 0.5000 0.6667 4
539
- ASSESSMENT 0.0000 0.0000 0.0000 4
540
- CC 0.4286 0.7500 0.5455 4
541
  DIAGNOSIS 0.0000 0.0000 0.0000 1
542
  DISPOSITION 0.0000 0.0000 0.0000 2
543
  EDCOURSE 0.0000 0.0000 0.0000 3
544
  EXAM 0.3333 1.0000 0.5000 1
545
- FAM/SOCHX 0.8400 0.9545 0.8936 22
546
- GENHX 0.9000 0.9000 0.9000 20
547
  GYNHX 0.0000 0.0000 0.0000 1
548
  IMAGING 0.0000 0.0000 0.0000 1
549
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
550
  LABS 0.0000 0.0000 0.0000 1
551
- MEDICATIONS 0.5556 0.7143 0.6250 7
552
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
553
- PASTMEDICALHX 0.4286 0.7500 0.5455 4
554
- PASTSURGICAL 0.8889 1.0000 0.9412 8
555
- PLAN 0.0000 0.0000 0.0000 3
556
  PROCEDURES 0.0000 0.0000 0.0000 1
557
- ROS 0.8889 0.7273 0.8000 11
558
 
559
- accuracy 0.6900 100
560
- macro avg 0.3132 0.3648 0.3209 100
561
- weighted avg 0.6502 0.6900 0.6589 100
562
- |
563
- | 0.0312 | 19.0 | 3268 | 0.4728 | precision recall f1-score support
564
 
565
  ALLERGY 1.0000 0.2500 0.4000 4
566
- ASSESSMENT 0.0000 0.0000 0.0000 4
567
- CC 0.4286 0.7500 0.5455 4
568
  DIAGNOSIS 0.0000 0.0000 0.0000 1
569
  DISPOSITION 0.0000 0.0000 0.0000 2
570
  EDCOURSE 0.0000 0.0000 0.0000 3
571
  EXAM 0.3333 1.0000 0.5000 1
572
- FAM/SOCHX 0.8400 0.9545 0.8936 22
573
- GENHX 0.8889 0.8000 0.8421 20
574
  GYNHX 0.0000 0.0000 0.0000 1
575
  IMAGING 0.0000 0.0000 0.0000 1
576
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
577
  LABS 0.0000 0.0000 0.0000 1
578
- MEDICATIONS 0.5000 0.7143 0.5882 7
579
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
580
- PASTMEDICALHX 0.4286 0.7500 0.5455 4
581
- PASTSURGICAL 0.8889 1.0000 0.9412 8
582
- PLAN 0.0000 0.0000 0.0000 3
583
  PROCEDURES 0.0000 0.0000 0.0000 1
584
  ROS 0.8889 0.7273 0.8000 11
585
- cesarian 0.0000 0.0000 0.0000 0
586
 
587
- accuracy 0.6600 100
588
- macro avg 0.2951 0.3308 0.2884 100
589
- weighted avg 0.6441 0.6600 0.6341 100
590
  |
591
- | 0.0312 | 20.0 | 3440 | 0.4698 | precision recall f1-score support
592
 
593
  ALLERGY 1.0000 0.2500 0.4000 4
594
- ASSESSMENT 0.0000 0.0000 0.0000 4
595
- CC 0.4286 0.7500 0.5455 4
596
  DIAGNOSIS 0.0000 0.0000 0.0000 1
597
  DISPOSITION 0.0000 0.0000 0.0000 2
598
  EDCOURSE 0.0000 0.0000 0.0000 3
599
  EXAM 0.3333 1.0000 0.5000 1
600
- FAM/SOCHX 0.8400 0.9545 0.8936 22
601
- GENHX 0.8947 0.8500 0.8718 20
602
  GYNHX 0.0000 0.0000 0.0000 1
603
  IMAGING 0.0000 0.0000 0.0000 1
604
- IMMUNIZATIONS 0.0000 0.0000 0.0000 1
605
  LABS 0.0000 0.0000 0.0000 1
606
- MEDICATIONS 0.5000 0.7143 0.5882 7
607
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
608
- PASTMEDICALHX 0.5000 0.7500 0.6000 4
609
- PASTSURGICAL 0.8889 1.0000 0.9412 8
610
- PLAN 0.0000 0.0000 0.0000 3
611
  PROCEDURES 0.0000 0.0000 0.0000 1
612
- ROS 0.8889 0.7273 0.8000 11
613
- cesarian 0.0000 0.0000 0.0000 0
614
 
615
- accuracy 0.6700 100
616
- macro avg 0.2988 0.3331 0.2924 100
617
- weighted avg 0.6481 0.6700 0.6422 100
618
  |
619
 
620
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: google/flan-t5-base
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
13
 
14
  # t5-dialogue-classification-3
15
 
16
+ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.6547
19
  - Classification Report: precision recall f1-score support
20
 
21
  ALLERGY 1.0000 0.2500 0.4000 4
22
+ ASSESSMENT 0.5000 0.2500 0.3333 4
23
+ CC 0.7500 0.7500 0.7500 4
24
  DIAGNOSIS 0.0000 0.0000 0.0000 1
25
  DISPOSITION 0.0000 0.0000 0.0000 2
26
  EDCOURSE 0.0000 0.0000 0.0000 3
27
  EXAM 0.3333 1.0000 0.5000 1
28
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
29
+ GENHX 0.8095 0.8500 0.8293 20
30
  GYNHX 0.0000 0.0000 0.0000 1
31
  IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
  LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.6000 0.8571 0.7059 7
35
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
37
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
38
+ PLAN 0.5000 0.3333 0.4000 3
39
  PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.8750 0.6364 0.7368 11
 
41
 
42
+ accuracy 0.7200 100
43
+ macro avg 0.4289 0.4463 0.4053 100
44
+ weighted avg 0.6992 0.7200 0.6857 100
45
 
46
 
47
  ## Model description
 
71
 
72
  ### Training results
73
 
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 172 | 0.4137 | precision recall f1-score support
77
 
78
+ ALLERGY 1.0000 0.2500 0.4000 4
79
  ASSESSMENT 0.0000 0.0000 0.0000 4
80
+ CC 0.3333 0.5000 0.4000 4
81
  DIAGNOSIS 0.0000 0.0000 0.0000 1
82
  DISPOSITION 0.0000 0.0000 0.0000 2
83
  EDCOURSE 0.0000 0.0000 0.0000 3
84
+ EXAM 0.5000 1.0000 0.6667 1
85
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
86
+ GENHX 0.8824 0.7500 0.8108 20
87
  GYNHX 0.0000 0.0000 0.0000 1
88
  IMAGING 0.0000 0.0000 0.0000 1
89
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
  LABS 0.0000 0.0000 0.0000 1
91
+ MEDICATIONS 0.6667 0.8571 0.7500 7
92
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
93
+ PASTMEDICALHX 0.1905 1.0000 0.3200 4
94
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
95
  PLAN 0.0000 0.0000 0.0000 3
96
  PROCEDURES 0.0000 0.0000 0.0000 1
97
+ ROS 0.6667 0.5455 0.6000 11
98
 
99
+ accuracy 0.6400 100
100
+ macro avg 0.3024 0.3429 0.2911 100
101
+ weighted avg 0.6201 0.6400 0.6046 100
102
+ |
103
+ | No log | 2.0 | 344 | 0.3062 | precision recall f1-score support
104
 
105
+ ALLERGY 1.0000 0.2500 0.4000 4
106
  ASSESSMENT 0.0000 0.0000 0.0000 4
107
+ CC 0.5000 0.2500 0.3333 4
108
  DIAGNOSIS 0.0000 0.0000 0.0000 1
109
  DISPOSITION 0.0000 0.0000 0.0000 2
110
  EDCOURSE 0.0000 0.0000 0.0000 3
111
+ EXAM 0.1429 1.0000 0.2500 1
112
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
113
+ GENHX 0.7308 0.9500 0.8261 20
114
  GYNHX 0.0000 0.0000 0.0000 1
115
  IMAGING 0.0000 0.0000 0.0000 1
116
  IMMUNIZATIONS 0.0000 0.0000 0.0000 1
117
  LABS 0.0000 0.0000 0.0000 1
118
+ MEDICATIONS 0.6364 1.0000 0.7778 7
119
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
120
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
121
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
122
  PLAN 0.0000 0.0000 0.0000 3
123
  PROCEDURES 0.0000 0.0000 0.0000 1
124
+ ROS 0.6667 0.7273 0.6957 11
125
 
126
+ accuracy 0.7000 100
127
+ macro avg 0.3028 0.3566 0.2943 100
128
+ weighted avg 0.6060 0.7000 0.6296 100
129
+ |
130
+ | 0.3608 | 3.0 | 516 | 0.2925 | precision recall f1-score support
131
 
132
  ALLERGY 1.0000 0.2500 0.4000 4
133
  ASSESSMENT 0.0000 0.0000 0.0000 4
134
+ CC 0.5000 0.7500 0.6000 4
135
  DIAGNOSIS 0.0000 0.0000 0.0000 1
136
  DISPOSITION 0.0000 0.0000 0.0000 2
137
  EDCOURSE 0.0000 0.0000 0.0000 3
138
+ EXAM 0.1667 1.0000 0.2857 1
139
+ FAM/SOCHX 0.9091 0.9091 0.9091 22
140
+ GENHX 0.8095 0.8500 0.8293 20
141
  GYNHX 0.0000 0.0000 0.0000 1
142
  IMAGING 0.0000 0.0000 0.0000 1
143
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
144
  LABS 0.0000 0.0000 0.0000 1
145
  MEDICATIONS 0.5556 0.7143 0.6250 7
146
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
147
+ PASTMEDICALHX 0.2353 1.0000 0.3810 4
148
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
149
  PLAN 0.0000 0.0000 0.0000 3
150
  PROCEDURES 0.0000 0.0000 0.0000 1
151
+ ROS 0.8750 0.6364 0.7368 11
152
 
153
+ accuracy 0.6700 100
154
+ macro avg 0.3526 0.4055 0.3383 100
155
+ weighted avg 0.6581 0.6700 0.6388 100
156
+ |
157
+ | 0.3608 | 4.0 | 688 | 0.2630 | precision recall f1-score support
158
 
159
  ALLERGY 1.0000 0.2500 0.4000 4
160
+ ASSESSMENT 0.4000 0.5000 0.4444 4
161
  CC 0.6000 0.7500 0.6667 4
162
  DIAGNOSIS 0.0000 0.0000 0.0000 1
163
  DISPOSITION 0.0000 0.0000 0.0000 2
164
  EDCOURSE 0.0000 0.0000 0.0000 3
165
+ EXAM 0.2000 1.0000 0.3333 1
166
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
167
+ GENHX 0.9444 0.8500 0.8947 20
168
  GYNHX 0.0000 0.0000 0.0000 1
169
  IMAGING 0.0000 0.0000 0.0000 1
170
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
171
  LABS 0.0000 0.0000 0.0000 1
172
+ MEDICATIONS 0.7500 0.8571 0.8000 7
173
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
174
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
175
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
176
+ PLAN 0.5000 0.3333 0.4000 3
177
  PROCEDURES 0.0000 0.0000 0.0000 1
178
  ROS 0.8750 0.6364 0.7368 11
179
 
180
+ accuracy 0.7300 100
181
+ macro avg 0.4224 0.4588 0.4054 100
182
+ weighted avg 0.7184 0.7300 0.7007 100
183
+ |
184
+ | 0.3608 | 5.0 | 860 | 0.3561 | precision recall f1-score support
185
 
186
+ ALLERGY 1.0000 0.2500 0.4000 4
187
+ ASSESSMENT 0.3333 0.5000 0.4000 4
188
+ CC 0.5000 0.7500 0.6000 4
189
  DIAGNOSIS 0.0000 0.0000 0.0000 1
190
  DISPOSITION 0.0000 0.0000 0.0000 2
191
  EDCOURSE 0.0000 0.0000 0.0000 3
192
+ EXAM 0.2000 1.0000 0.3333 1
193
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
194
+ GENHX 0.8750 0.7000 0.7778 20
195
  GYNHX 0.0000 0.0000 0.0000 1
196
  IMAGING 0.0000 0.0000 0.0000 1
197
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
198
  LABS 0.0000 0.0000 0.0000 1
199
+ MEDICATIONS 0.7143 0.7143 0.7143 7
200
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
201
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
202
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
203
+ PLAN 0.5000 0.3333 0.4000 3
204
  PROCEDURES 0.0000 0.0000 0.0000 1
205
+ ROS 0.8750 0.6364 0.7368 11
206
 
207
+ accuracy 0.6900 100
208
+ macro avg 0.4048 0.4442 0.3877 100
209
+ weighted avg 0.6934 0.6900 0.6662 100
210
+ |
211
+ | 0.0859 | 6.0 | 1032 | 0.4536 | precision recall f1-score support
212
 
213
  ALLERGY 1.0000 0.2500 0.4000 4
214
+ ASSESSMENT 0.5000 0.2500 0.3333 4
215
+ CC 0.7500 0.7500 0.7500 4
216
  DIAGNOSIS 0.0000 0.0000 0.0000 1
217
  DISPOSITION 0.0000 0.0000 0.0000 2
218
  EDCOURSE 0.0000 0.0000 0.0000 3
219
  EXAM 0.2500 1.0000 0.4000 1
220
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
221
+ GENHX 0.7895 0.7500 0.7692 20
222
  GYNHX 0.0000 0.0000 0.0000 1
223
  IMAGING 0.0000 0.0000 0.0000 1
224
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
225
  LABS 0.0000 0.0000 0.0000 1
226
+ MEDICATIONS 0.6364 1.0000 0.7778 7
227
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
228
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
229
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
230
+ PLAN 0.5000 0.6667 0.5714 3
231
  PROCEDURES 0.0000 0.0000 0.0000 1
232
  ROS 0.8750 0.6364 0.7368 11
233
 
234
+ accuracy 0.7200 100
235
+ macro avg 0.4290 0.4652 0.4123 100
236
+ weighted avg 0.7058 0.7200 0.6886 100
237
+ |
238
+ | 0.0859 | 7.0 | 1204 | 0.4567 | precision recall f1-score support
239
 
240
+ ALLERGY 1.0000 0.2500 0.4000 4
241
+ ASSESSMENT 0.4000 0.5000 0.4444 4
242
+ CC 0.4286 0.7500 0.5455 4
243
  DIAGNOSIS 0.0000 0.0000 0.0000 1
244
  DISPOSITION 0.0000 0.0000 0.0000 2
245
+ EDCOURSE 0.0000 0.0000 0.0000 3
246
+ EXAM 0.0000 0.0000 0.0000 1
247
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
248
+ GENHX 0.9048 0.9500 0.9268 20
249
  GYNHX 0.0000 0.0000 0.0000 1
250
  IMAGING 0.0000 0.0000 0.0000 1
251
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
252
  LABS 0.0000 0.0000 0.0000 1
253
+ MEDICATIONS 0.7500 0.8571 0.8000 7
254
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
255
+ PASTMEDICALHX 0.6667 1.0000 0.8000 4
256
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
257
+ PLAN 1.0000 0.6667 0.8000 3
258
  PROCEDURES 0.0000 0.0000 0.0000 1
259
+ ROS 0.8750 0.6364 0.7368 11
260
 
261
+ accuracy 0.7500 100
262
+ macro avg 0.4436 0.4305 0.4185 100
263
+ weighted avg 0.7357 0.7500 0.7257 100
264
+ |
265
+ | 0.0859 | 8.0 | 1376 | 0.4684 | precision recall f1-score support
266
 
267
  ALLERGY 1.0000 0.2500 0.4000 4
268
+ ASSESSMENT 0.5000 0.2500 0.3333 4
269
+ CC 0.7500 0.7500 0.7500 4
270
  DIAGNOSIS 0.0000 0.0000 0.0000 1
271
  DISPOSITION 0.0000 0.0000 0.0000 2
272
  EDCOURSE 0.0000 0.0000 0.0000 3
273
+ EXAM 0.2500 1.0000 0.4000 1
274
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
275
+ GENHX 0.8947 0.8500 0.8718 20
276
  GYNHX 0.0000 0.0000 0.0000 1
277
  IMAGING 0.0000 0.0000 0.0000 1
278
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
279
  LABS 0.0000 0.0000 0.0000 1
280
+ MEDICATIONS 0.6364 1.0000 0.7778 7
281
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
282
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
283
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
284
+ PLAN 0.5000 0.3333 0.4000 3
285
  PROCEDURES 0.0000 0.0000 0.0000 1
286
+ ROS 0.8889 0.7273 0.8000 11
287
 
288
+ accuracy 0.7400 100
289
+ macro avg 0.4332 0.4580 0.4101 100
290
+ weighted avg 0.7269 0.7400 0.7094 100
291
+ |
292
+ | 0.031 | 9.0 | 1548 | 0.5316 | precision recall f1-score support
293
 
294
  ALLERGY 1.0000 0.2500 0.4000 4
295
+ ASSESSMENT 0.2500 0.2500 0.2500 4
296
+ CC 1.0000 0.7500 0.8571 4
297
  DIAGNOSIS 0.0000 0.0000 0.0000 1
298
  DISPOSITION 0.0000 0.0000 0.0000 2
299
  EDCOURSE 0.0000 0.0000 0.0000 3
300
+ EXAM 0.2500 1.0000 0.4000 1
301
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
302
+ GENHX 0.8500 0.8500 0.8500 20
303
  GYNHX 0.0000 0.0000 0.0000 1
304
  IMAGING 0.0000 0.0000 0.0000 1
305
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
306
  LABS 0.0000 0.0000 0.0000 1
307
+ MEDICATIONS 0.6364 1.0000 0.7778 7
308
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
309
+ PASTMEDICALHX 0.6667 1.0000 0.8000 4
310
  PASTSURGICAL 1.0000 1.0000 1.0000 8
311
+ PLAN 0.5000 0.3333 0.4000 3
312
  PROCEDURES 0.0000 0.0000 0.0000 1
313
+ ROS 0.8889 0.7273 0.8000 11
314
 
315
+ accuracy 0.7400 100
316
+ macro avg 0.4428 0.4580 0.4216 100
317
+ weighted avg 0.7157 0.7400 0.7083 100
318
+ |
319
+ | 0.031 | 10.0 | 1720 | 0.5335 | precision recall f1-score support
320
 
321
  ALLERGY 1.0000 0.2500 0.4000 4
322
+ ASSESSMENT 0.5000 0.2500 0.3333 4
323
+ CC 0.6000 0.7500 0.6667 4
324
  DIAGNOSIS 0.0000 0.0000 0.0000 1
325
  DISPOSITION 0.0000 0.0000 0.0000 2
326
  EDCOURSE 0.0000 0.0000 0.0000 3
327
  EXAM 0.3333 1.0000 0.5000 1
328
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
329
+ GENHX 0.8889 0.8000 0.8421 20
330
  GYNHX 0.0000 0.0000 0.0000 1
331
  IMAGING 0.0000 0.0000 0.0000 1
332
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
333
  LABS 0.0000 0.0000 0.0000 1
334
+ MEDICATIONS 0.6000 0.8571 0.7059 7
335
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
336
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
337
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
338
+ PLAN 0.5000 0.3333 0.4000 3
339
  PROCEDURES 0.0000 0.0000 0.0000 1
340
+ ROS 0.8750 0.6364 0.7368 11
341
 
342
  accuracy 0.7100 100
343
+ macro avg 0.4238 0.4438 0.4008 100
344
+ weighted avg 0.7022 0.7100 0.6808 100
345
+ |
346
+ | 0.031 | 11.0 | 1892 | 0.6325 | precision recall f1-score support
347
+
348
+ ALLERGY 1.0000 0.2500 0.4000 4
349
+ ASSESSMENT 0.3333 0.2500 0.2857 4
350
+ CC 1.0000 0.7500 0.8571 4
351
  DIAGNOSIS 0.0000 0.0000 0.0000 1
352
  DISPOSITION 0.0000 0.0000 0.0000 2
353
  EDCOURSE 0.0000 0.0000 0.0000 3
354
+ EXAM 0.2500 1.0000 0.4000 1
355
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
356
+ GENHX 0.8000 0.8000 0.8000 20
357
  GYNHX 0.0000 0.0000 0.0000 1
358
  IMAGING 0.0000 0.0000 0.0000 1
359
  IMMUNIZATIONS 1.0000 1.0000 1.0000 1
360
  LABS 0.0000 0.0000 0.0000 1
361
+ MEDICATIONS 0.6364 1.0000 0.7778 7
362
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
363
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
364
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
365
+ PLAN 0.5000 0.3333 0.4000 3
366
  PROCEDURES 0.0000 0.0000 0.0000 1
367
  ROS 0.8750 0.6364 0.7368 11
368
 
369
+ accuracy 0.7200 100
370
+ macro avg 0.4327 0.4510 0.4085 100
371
+ weighted avg 0.6987 0.7200 0.6854 100
372
+ |
373
+ | 0.0115 | 12.0 | 2064 | 0.5900 | precision recall f1-score support
374
 
375
+ ALLERGY 1.0000 0.2500 0.4000 4
376
+ ASSESSMENT 0.5000 0.2500 0.3333 4
377
+ CC 0.6000 0.7500 0.6667 4
378
  DIAGNOSIS 0.0000 0.0000 0.0000 1
379
  DISPOSITION 0.0000 0.0000 0.0000 2
380
  EDCOURSE 0.0000 0.0000 0.0000 3
381
+ EXAM 0.3333 1.0000 0.5000 1
382
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
383
+ GENHX 0.8571 0.9000 0.8780 20
384
  GYNHX 0.0000 0.0000 0.0000 1
385
  IMAGING 0.0000 0.0000 0.0000 1
386
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
387
  LABS 0.0000 0.0000 0.0000 1
388
+ MEDICATIONS 0.6667 0.8571 0.7500 7
389
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
390
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
391
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
392
+ PLAN 1.0000 0.6667 0.8000 3
393
  PROCEDURES 0.0000 0.0000 0.0000 1
394
+ ROS 0.7778 0.6364 0.7000 11
395
 
396
+ accuracy 0.7400 100
397
+ macro avg 0.4491 0.4655 0.4258 100
398
+ weighted avg 0.7131 0.7400 0.7046 100
399
+ |
400
+ | 0.0115 | 13.0 | 2236 | 0.5914 | precision recall f1-score support
401
 
402
+ ALLERGY 1.0000 0.2500 0.4000 4
403
+ ASSESSMENT 0.5000 0.2500 0.3333 4
404
+ CC 0.7500 0.7500 0.7500 4
405
  DIAGNOSIS 0.0000 0.0000 0.0000 1
406
  DISPOSITION 0.0000 0.0000 0.0000 2
407
  EDCOURSE 0.0000 0.0000 0.0000 3
408
+ EXAM 0.2500 1.0000 0.4000 1
409
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
410
+ GENHX 0.8095 0.8500 0.8293 20
411
  GYNHX 0.0000 0.0000 0.0000 1
412
  IMAGING 0.0000 0.0000 0.0000 1
413
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
414
  LABS 0.0000 0.0000 0.0000 1
415
+ MEDICATIONS 0.6667 0.8571 0.7500 7
416
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
417
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
418
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
419
+ PLAN 0.6667 0.6667 0.6667 3
420
  PROCEDURES 0.0000 0.0000 0.0000 1
421
+ ROS 0.7778 0.6364 0.7000 11
422
 
423
+ accuracy 0.7300 100
424
+ macro avg 0.4333 0.4630 0.4159 100
425
+ weighted avg 0.6988 0.7300 0.6932 100
426
+ |
427
+ | 0.0115 | 14.0 | 2408 | 0.6534 | precision recall f1-score support
428
 
429
+ ALLERGY 1.0000 0.2500 0.4000 4
430
+ ASSESSMENT 0.5000 0.2500 0.3333 4
431
+ CC 0.7500 0.7500 0.7500 4
432
  DIAGNOSIS 0.0000 0.0000 0.0000 1
433
  DISPOSITION 0.0000 0.0000 0.0000 2
434
  EDCOURSE 0.0000 0.0000 0.0000 3
435
+ EXAM 0.3333 1.0000 0.5000 1
436
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
437
+ GENHX 0.8095 0.8500 0.8293 20
438
  GYNHX 0.0000 0.0000 0.0000 1
439
  IMAGING 0.0000 0.0000 0.0000 1
440
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
441
  LABS 0.0000 0.0000 0.0000 1
442
+ MEDICATIONS 0.6667 0.8571 0.7500 7
443
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
444
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
445
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
446
+ PLAN 0.6667 0.6667 0.6667 3
447
  PROCEDURES 0.0000 0.0000 0.0000 1
448
+ ROS 0.7778 0.6364 0.7000 11
449
 
450
+ accuracy 0.7300 100
451
+ macro avg 0.4375 0.4630 0.4209 100
452
+ weighted avg 0.6996 0.7300 0.6942 100
453
+ |
454
+ | 0.0061 | 15.0 | 2580 | 0.6094 | precision recall f1-score support
455
 
456
+ ALLERGY 1.0000 0.2500 0.4000 4
457
+ ASSESSMENT 0.5000 0.2500 0.3333 4
458
+ CC 0.7500 0.7500 0.7500 4
459
  DIAGNOSIS 0.0000 0.0000 0.0000 1
460
  DISPOSITION 0.0000 0.0000 0.0000 2
461
  EDCOURSE 0.0000 0.0000 0.0000 3
462
  EXAM 0.3333 1.0000 0.5000 1
463
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
464
+ GENHX 0.8095 0.8500 0.8293 20
465
  GYNHX 0.0000 0.0000 0.0000 1
466
  IMAGING 0.0000 0.0000 0.0000 1
467
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
468
  LABS 0.0000 0.0000 0.0000 1
469
+ MEDICATIONS 0.6667 0.8571 0.7500 7
470
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
471
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
472
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
473
+ PLAN 0.5000 0.6667 0.5714 3
474
  PROCEDURES 0.0000 0.0000 0.0000 1
475
+ ROS 0.7778 0.6364 0.7000 11
476
 
477
+ accuracy 0.7300 100
478
+ macro avg 0.4309 0.4630 0.4171 100
479
+ weighted avg 0.7021 0.7300 0.6956 100
480
+ |
481
+ | 0.0061 | 16.0 | 2752 | 0.6588 | precision recall f1-score support
482
 
483
  ALLERGY 1.0000 0.2500 0.4000 4
484
+ ASSESSMENT 0.5000 0.2500 0.3333 4
485
+ CC 0.7500 0.7500 0.7500 4
486
  DIAGNOSIS 0.0000 0.0000 0.0000 1
487
  DISPOSITION 0.0000 0.0000 0.0000 2
488
  EDCOURSE 0.0000 0.0000 0.0000 3
489
+ EXAM 0.3333 1.0000 0.5000 1
490
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
491
+ GENHX 0.8095 0.8500 0.8293 20
492
  GYNHX 0.0000 0.0000 0.0000 1
493
  IMAGING 0.0000 0.0000 0.0000 1
494
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
495
  LABS 0.0000 0.0000 0.0000 1
496
+ MEDICATIONS 0.6667 0.8571 0.7500 7
497
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
498
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
499
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
500
+ PLAN 0.6667 0.6667 0.6667 3
501
  PROCEDURES 0.0000 0.0000 0.0000 1
502
+ ROS 0.7778 0.6364 0.7000 11
503
 
504
+ accuracy 0.7300 100
505
+ macro avg 0.4357 0.4630 0.4190 100
506
+ weighted avg 0.6982 0.7300 0.6927 100
507
+ |
508
+ | 0.0061 | 17.0 | 2924 | 0.6644 | precision recall f1-score support
509
 
510
  ALLERGY 1.0000 0.2500 0.4000 4
511
+ ASSESSMENT 0.5000 0.2500 0.3333 4
512
+ CC 0.6000 0.7500 0.6667 4
513
  DIAGNOSIS 0.0000 0.0000 0.0000 1
514
  DISPOSITION 0.0000 0.0000 0.0000 2
515
  EDCOURSE 0.0000 0.0000 0.0000 3
516
  EXAM 0.3333 1.0000 0.5000 1
517
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
518
+ GENHX 0.8095 0.8500 0.8293 20
519
  GYNHX 0.0000 0.0000 0.0000 1
520
  IMAGING 0.0000 0.0000 0.0000 1
521
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
522
  LABS 0.0000 0.0000 0.0000 1
523
+ MEDICATIONS 0.6667 0.8571 0.7500 7
524
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
525
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
526
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
527
+ PLAN 0.5000 0.3333 0.4000 3
528
  PROCEDURES 0.0000 0.0000 0.0000 1
529
+ ROS 0.7778 0.6364 0.7000 11
530
 
531
+ accuracy 0.7200 100
532
+ macro avg 0.4217 0.4463 0.4034 100
533
+ weighted avg 0.6886 0.7200 0.6829 100
534
+ |
535
+ | 0.003 | 18.0 | 3096 | 0.6608 | precision recall f1-score support
536
 
537
+ ALLERGY 1.0000 0.2500 0.4000 4
538
+ ASSESSMENT 0.5000 0.2500 0.3333 4
539
+ CC 0.7500 0.7500 0.7500 4
540
  DIAGNOSIS 0.0000 0.0000 0.0000 1
541
  DISPOSITION 0.0000 0.0000 0.0000 2
542
  EDCOURSE 0.0000 0.0000 0.0000 3
543
  EXAM 0.3333 1.0000 0.5000 1
544
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
545
+ GENHX 0.8500 0.8500 0.8500 20
546
  GYNHX 0.0000 0.0000 0.0000 1
547
  IMAGING 0.0000 0.0000 0.0000 1
548
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
549
  LABS 0.0000 0.0000 0.0000 1
550
+ MEDICATIONS 0.6667 0.8571 0.7500 7
551
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
552
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
553
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
554
+ PLAN 0.5000 0.3333 0.4000 3
555
  PROCEDURES 0.0000 0.0000 0.0000 1
556
+ ROS 0.8000 0.7273 0.7619 11
557
 
558
+ accuracy 0.7300 100
559
+ macro avg 0.4305 0.4509 0.4098 100
560
+ weighted avg 0.7037 0.7300 0.6956 100
561
+ |
562
+ | 0.003 | 19.0 | 3268 | 0.6542 | precision recall f1-score support
563
 
564
  ALLERGY 1.0000 0.2500 0.4000 4
565
+ ASSESSMENT 0.5000 0.2500 0.3333 4
566
+ CC 0.7500 0.7500 0.7500 4
567
  DIAGNOSIS 0.0000 0.0000 0.0000 1
568
  DISPOSITION 0.0000 0.0000 0.0000 2
569
  EDCOURSE 0.0000 0.0000 0.0000 3
570
  EXAM 0.3333 1.0000 0.5000 1
571
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
572
+ GENHX 0.8500 0.8500 0.8500 20
573
  GYNHX 0.0000 0.0000 0.0000 1
574
  IMAGING 0.0000 0.0000 0.0000 1
575
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
576
  LABS 0.0000 0.0000 0.0000 1
577
+ MEDICATIONS 0.6000 0.8571 0.7059 7
578
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
579
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
580
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
581
+ PLAN 0.5000 0.3333 0.4000 3
582
  PROCEDURES 0.0000 0.0000 0.0000 1
583
  ROS 0.8889 0.7273 0.8000 11
 
584
 
585
+ accuracy 0.7300 100
586
+ macro avg 0.4316 0.4509 0.4095 100
587
+ weighted avg 0.7088 0.7300 0.6967 100
588
  |
589
+ | 0.003 | 20.0 | 3440 | 0.6547 | precision recall f1-score support
590
 
591
  ALLERGY 1.0000 0.2500 0.4000 4
592
+ ASSESSMENT 0.5000 0.2500 0.3333 4
593
+ CC 0.7500 0.7500 0.7500 4
594
  DIAGNOSIS 0.0000 0.0000 0.0000 1
595
  DISPOSITION 0.0000 0.0000 0.0000 2
596
  EDCOURSE 0.0000 0.0000 0.0000 3
597
  EXAM 0.3333 1.0000 0.5000 1
598
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
599
+ GENHX 0.8095 0.8500 0.8293 20
600
  GYNHX 0.0000 0.0000 0.0000 1
601
  IMAGING 0.0000 0.0000 0.0000 1
602
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
603
  LABS 0.0000 0.0000 0.0000 1
604
+ MEDICATIONS 0.6000 0.8571 0.7059 7
605
  OTHER_HISTORY 0.0000 0.0000 0.0000 1
606
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
607
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
608
+ PLAN 0.5000 0.3333 0.4000 3
609
  PROCEDURES 0.0000 0.0000 0.0000 1
610
+ ROS 0.8750 0.6364 0.7368 11
 
611
 
612
+ accuracy 0.7200 100
613
+ macro avg 0.4289 0.4463 0.4053 100
614
+ weighted avg 0.6992 0.7200 0.6857 100
615
  |
616
 
617
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:70107ae45aa0f0bb29d498e8b6ab8a8d185bf960bfaa678fa427dae638a53247
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69d418d22ae9333dee904f8be242d26cdf846ddbc90f01f73433dbd05775d21c
3
  size 990345064
runs/Mar11_12-08-26_e24496f93c6c/events.out.tfevents.1710158908.e24496f93c6c.190.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e042c16ea74c72cdad195496dc82358af17953ec374d0357076e7d2fa7fe2cd9
3
- size 11509
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a00a4765b049dea450e053e12a68bac4e52d421721f182e1a34eba60f4674cf
3
+ size 12676