Hugging Face's logo

veronica-girolimetti
/
t5-dialogue-classification-enriched-base

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
veronica-girolimetti commited on
Commit
73a04a8
•
1 Parent(s): dc72244

End of training

Browse files
Files changed (4) hide show
  1. README.md +638 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Jan15_16-34-58_6653ac6dbe93/events.out.tfevents.1705336506.6653ac6dbe93.6660.0 +2 -2
README.md ADDED
@@ -0,0 +1,638 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification-enriched-base
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification-enriched-base
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.9946
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.9167 0.9565 12
22
+ ASSESSMENT 0.4000 0.1818 0.2500 11
23
+ CC 0.5714 0.3636 0.4444 11
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 0.2500 1.0000 0.4000 1
26
+ EDCOURSE 0.0000 0.0000 0.0000 4
27
+ EXAM 0.5000 0.4000 0.4444 5
28
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
29
+ GENHX 0.7931 0.8679 0.8288 53
30
+ GYNHX 1.0000 1.0000 1.0000 1
31
+ IMAGING 1.0000 1.0000 1.0000 1
32
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.7692 1.0000 0.8696 10
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
+ PASTMEDICALHX 0.6111 0.7857 0.6875 14
37
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
38
+ PLAN 0.3333 1.0000 0.5000 1
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.8000 0.7059 0.7500 17
41
+ first CC 0.0000 0.0000 0.0000 0
42
+
43
+ accuracy 0.7550 200
44
+ macro avg 0.5124 0.5720 0.5187 200
45
+ weighted avg 0.7301 0.7550 0.7344 200
46
+
47
+
48
+ ## Model description
49
+
50
+ More information needed
51
+
52
+ ## Intended uses & limitations
53
+
54
+ More information needed
55
+
56
+ ## Training and evaluation data
57
+
58
+ More information needed
59
+
60
+ ## Training procedure
61
+
62
+ ### Training hyperparameters
63
+
64
+ The following hyperparameters were used during training:
65
+ - learning_rate: 0.0001
66
+ - train_batch_size: 2
67
+ - eval_batch_size: 2
68
+ - seed: 42
69
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
+ - lr_scheduler_type: linear
71
+ - num_epochs: 20
72
+
73
+ ### Training results
74
+
75
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
76
+ |:-------------:|:-----:|:-----:|:---------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
77
+ | 0.612 | 1.0 | 601 | 0.3791 | precision recall f1-score support
78
+
79
+ ALLERGY 1.0000 0.9167 0.9565 12
80
+ ASSESSMENT 0.0000 0.0000 0.0000 11
81
+ CC 0.2000 0.4545 0.2778 11
82
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
83
+ DISPOSITION 0.0000 0.0000 0.0000 1
84
+ EDCOURSE 0.0000 0.0000 0.0000 4
85
+ EXAM 0.0000 0.0000 0.0000 5
86
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
87
+ GENHX 0.7627 0.8491 0.8036 53
88
+ GYNHX 0.0000 0.0000 0.0000 1
89
+ IMAGING 0.0000 0.0000 0.0000 1
90
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
91
+ LABS 0.0000 0.0000 0.0000 1
92
+ MEDICATIONS 0.7143 1.0000 0.8333 10
93
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
94
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
95
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
96
+ PLAN 0.0000 0.0000 0.0000 1
97
+ PROCEDURES 0.0000 0.0000 0.0000 1
98
+ ROS 0.8000 0.4706 0.5926 17
99
+
100
+ accuracy 0.7100 200
101
+ macro avg 0.2947 0.3263 0.3028 200
102
+ weighted avg 0.6422 0.7100 0.6648 200
103
+ |
104
+ | 0.2185 | 2.0 | 1202 | 0.3511 | precision recall f1-score support
105
+
106
+ ALLERGY 1.0000 0.9167 0.9565 12
107
+ ASSESSMENT 0.0000 0.0000 0.0000 11
108
+ CC 0.5000 0.4545 0.4762 11
109
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
110
+ DISPOSITION 0.0000 0.0000 0.0000 1
111
+ EDCOURSE 0.0000 0.0000 0.0000 4
112
+ EXAM 0.6667 0.4000 0.5000 5
113
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
114
+ GENHX 0.8679 0.8679 0.8679 53
115
+ GYNHX 0.0000 0.0000 0.0000 1
116
+ IMAGING 0.0000 0.0000 0.0000 1
117
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
118
+ LABS 0.0000 0.0000 0.0000 1
119
+ MEDICATIONS 0.7143 1.0000 0.8333 10
120
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
121
+ PASTMEDICALHX 0.4800 0.8571 0.6154 14
122
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
123
+ PLAN 0.0000 0.0000 0.0000 1
124
+ PROCEDURES 0.0000 0.0000 0.0000 1
125
+ ROS 0.8125 0.7647 0.7879 17
126
+ well developed 0.0000 0.0000 0.0000 0
127
+
128
+ accuracy 0.7550 200
129
+ macro avg 0.3764 0.3923 0.3788 200
130
+ weighted avg 0.7067 0.7550 0.7240 200
131
+ |
132
+ | 0.2103 | 3.0 | 1803 | 0.5588 | precision recall f1-score support
133
+
134
+ ALLERGY 1.0000 0.9167 0.9565 12
135
+ ASSESSMENT 0.0000 0.0000 0.0000 11
136
+ CC 0.4000 0.3636 0.3810 11
137
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
138
+ DISPOSITION 0.3333 1.0000 0.5000 1
139
+ EDCOURSE 0.0000 0.0000 0.0000 4
140
+ EXAM 0.4000 0.4000 0.4000 5
141
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
142
+ GENHX 0.7895 0.8491 0.8182 53
143
+ GYNHX 0.0000 0.0000 0.0000 1
144
+ IMAGING 1.0000 1.0000 1.0000 1
145
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
146
+ LABS 0.0000 0.0000 0.0000 1
147
+ MEDICATIONS 0.8333 1.0000 0.9091 10
148
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
149
+ PASTMEDICALHX 0.4444 0.8571 0.5854 14
150
+ PASTSURGICAL 1.0000 1.0000 1.0000 7
151
+ PLAN 0.0000 0.0000 0.0000 1
152
+ PROCEDURES 0.0000 0.0000 0.0000 1
153
+ ROS 0.8182 0.5294 0.6429 17
154
+
155
+ accuracy 0.7350 200
156
+ macro avg 0.4199 0.4947 0.4393 200
157
+ weighted avg 0.6857 0.7350 0.7005 200
158
+ |
159
+ | 0.1329 | 4.0 | 2404 | 0.5146 | precision recall f1-score support
160
+
161
+ ALLERGY 1.0000 0.9167 0.9565 12
162
+ ASSESSMENT 0.3333 0.0909 0.1429 11
163
+ CC 0.4615 0.5455 0.5000 11
164
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
165
+ DISPOSITION 0.0000 0.0000 0.0000 1
166
+ EDCOURSE 0.0000 0.0000 0.0000 4
167
+ EXAM 0.6667 0.4000 0.5000 5
168
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
169
+ GENHX 0.8246 0.8868 0.8545 53
170
+ GYNHX 0.0000 0.0000 0.0000 1
171
+ IMAGING 1.0000 1.0000 1.0000 1
172
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
173
+ LABS 0.0000 0.0000 0.0000 1
174
+ MEDICATIONS 0.8333 1.0000 0.9091 10
175
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
176
+ PASTMEDICALHX 0.5217 0.8571 0.6486 14
177
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
178
+ PLAN 0.3333 1.0000 0.5000 1
179
+ PROCEDURES 0.0000 0.0000 0.0000 1
180
+ ROS 0.8000 0.7059 0.7500 17
181
+
182
+ accuracy 0.7650 200
183
+ macro avg 0.4826 0.5108 0.4800 200
184
+ weighted avg 0.7292 0.7650 0.7370 200
185
+ |
186
+ | 0.0896 | 5.0 | 3005 | 0.5567 | precision recall f1-score support
187
+
188
+ ALLERGY 1.0000 0.9167 0.9565 12
189
+ ASSESSMENT 0.3333 0.0909 0.1429 11
190
+ CC 0.5556 0.4545 0.5000 11
191
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
192
+ DISPOSITION 0.0000 0.0000 0.0000 1
193
+ EDCOURSE 0.0000 0.0000 0.0000 4
194
+ EXAM 0.5000 0.4000 0.4444 5
195
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
196
+ GENHX 0.8246 0.8868 0.8545 53
197
+ GYNHX 1.0000 1.0000 1.0000 1
198
+ IMAGING 1.0000 1.0000 1.0000 1
199
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
200
+ LABS 0.0000 0.0000 0.0000 1
201
+ MEDICATIONS 0.8333 1.0000 0.9091 10
202
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
203
+ PASTMEDICALHX 0.6000 0.8571 0.7059 14
204
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
205
+ PLAN 0.2500 1.0000 0.4000 1
206
+ PROCEDURES 0.0000 0.0000 0.0000 1
207
+ ROS 0.6667 0.7059 0.6857 17
208
+
209
+ accuracy 0.7650 200
210
+ macro avg 0.5221 0.5562 0.5219 200
211
+ weighted avg 0.7289 0.7650 0.7386 200
212
+ |
213
+ | 0.058 | 6.0 | 3606 | 0.5499 | precision recall f1-score support
214
+
215
+ ALLERGY 1.0000 0.9167 0.9565 12
216
+ ASSESSMENT 0.6667 0.1818 0.2857 11
217
+ CC 0.7000 0.6364 0.6667 11
218
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
219
+ DISPOSITION 0.5000 1.0000 0.6667 1
220
+ EDCOURSE 0.5000 0.2500 0.3333 4
221
+ EXAM 0.6667 0.4000 0.5000 5
222
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
223
+ GENHX 0.8846 0.8679 0.8762 53
224
+ GYNHX 0.5000 1.0000 0.6667 1
225
+ IMAGING 1.0000 1.0000 1.0000 1
226
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
227
+ LABS 0.0000 0.0000 0.0000 1
228
+ MEDICATIONS 0.8333 1.0000 0.9091 10
229
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
230
+ PASTMEDICALHX 0.5000 0.7857 0.6111 14
231
+ PASTSURGICAL 0.7000 1.0000 0.8235 7
232
+ PLAN 0.3333 1.0000 0.5000 1
233
+ PROCEDURES 0.0000 0.0000 0.0000 1
234
+ ROS 0.7333 0.6471 0.6875 17
235
+
236
+ accuracy 0.7750 200
237
+ macro avg 0.5696 0.6309 0.5693 200
238
+ weighted avg 0.7733 0.7750 0.7590 200
239
+ |
240
+ | 0.0343 | 7.0 | 4207 | 0.5794 | precision recall f1-score support
241
+
242
+ 2-year-old 0.0000 0.0000 0.0000 0
243
+ ALLERGY 1.0000 0.9167 0.9565 12
244
+ ASSESSMENT 0.5000 0.1818 0.2667 11
245
+ CC 0.6667 0.5455 0.6000 11
246
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
247
+ DISPOSITION 0.3333 1.0000 0.5000 1
248
+ EDCOURSE 1.0000 0.2500 0.4000 4
249
+ EXAM 0.6667 0.4000 0.5000 5
250
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
251
+ GENHX 0.8545 0.8868 0.8704 53
252
+ GYNHX 0.0000 0.0000 0.0000 1
253
+ IMAGING 1.0000 1.0000 1.0000 1
254
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
255
+ LABS 0.0000 0.0000 0.0000 1
256
+ MEDICATIONS 0.8333 1.0000 0.9091 10
257
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
258
+ PASTMEDICALHX 0.7500 0.8571 0.8000 14
259
+ PASTSURGICAL 0.8750 1.0000 0.9333 7
260
+ PLAN 0.3333 1.0000 0.5000 1
261
+ PROCEDURES 0.0000 0.0000 0.0000 1
262
+ ROS 0.7000 0.8235 0.7568 17
263
+
264
+ accuracy 0.7950 200
265
+ macro avg 0.5424 0.5627 0.5194 200
266
+ weighted avg 0.7824 0.7950 0.7755 200
267
+ |
268
+ | 0.0225 | 8.0 | 4808 | 0.5625 | precision recall f1-score support
269
+
270
+ 2-year-old 0.0000 0.0000 0.0000 0
271
+ ALLERGY 1.0000 0.9167 0.9565 12
272
+ ASSESSMENT 0.6667 0.3636 0.4706 11
273
+ CC 0.5833 0.6364 0.6087 11
274
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
275
+ DISPOSITION 0.5000 1.0000 0.6667 1
276
+ EDCOURSE 0.0000 0.0000 0.0000 4
277
+ EXAM 0.5000 0.4000 0.4444 5
278
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
279
+ GENHX 0.8519 0.8679 0.8598 53
280
+ GYNHX 1.0000 1.0000 1.0000 1
281
+ IMAGING 0.5000 1.0000 0.6667 1
282
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
283
+ LABS 0.0000 0.0000 0.0000 1
284
+ MEDICATIONS 0.8333 1.0000 0.9091 10
285
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
286
+ PASTMEDICALHX 0.7333 0.7857 0.7586 14
287
+ PASTSURGICAL 0.8750 1.0000 0.9333 7
288
+ PLAN 0.3333 1.0000 0.5000 1
289
+ PROCEDURES 0.0000 0.0000 0.0000 1
290
+ ROS 0.7647 0.7647 0.7647 17
291
+
292
+ accuracy 0.7950 200
293
+ macro avg 0.5247 0.6043 0.5454 200
294
+ weighted avg 0.7697 0.7950 0.7770 200
295
+ |
296
+ | 0.0176 | 9.0 | 5409 | 0.7529 | precision recall f1-score support
297
+
298
+ 2-GENHX 0.0000 0.0000 0.0000 0
299
+ ALLERGY 1.0000 0.9167 0.9565 12
300
+ ASSESSMENT 0.5000 0.1818 0.2667 11
301
+ CC 0.7143 0.4545 0.5556 11
302
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
303
+ DISPOSITION 0.5000 1.0000 0.6667 1
304
+ EDCOURSE 1.0000 0.5000 0.6667 4
305
+ EXAM 0.6667 0.4000 0.5000 5
306
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
307
+ GENHX 0.8393 0.8868 0.8624 53
308
+ GYNHX 1.0000 1.0000 1.0000 1
309
+ IMAGING 1.0000 1.0000 1.0000 1
310
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
311
+ LABS 0.0000 0.0000 0.0000 1
312
+ MEDICATIONS 0.7692 1.0000 0.8696 10
313
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
314
+ PASTMEDICALHX 0.5714 0.8571 0.6857 14
315
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
316
+ PLAN 0.3333 1.0000 0.5000 1
317
+ PROCEDURES 0.0000 0.0000 0.0000 1
318
+ ROS 0.8667 0.7647 0.8125 17
319
+
320
+ accuracy 0.7900 200
321
+ macro avg 0.5950 0.6083 0.5769 200
322
+ weighted avg 0.7846 0.7900 0.7742 200
323
+ |
324
+ | 0.0099 | 10.0 | 6010 | 0.7371 | precision recall f1-score support
325
+
326
+ 2-year-old 0.0000 0.0000 0.0000 0
327
+ ALLERGY 1.0000 0.9167 0.9565 12
328
+ ASSESSMENT 0.5000 0.2727 0.3529 11
329
+ CC 0.7500 0.5455 0.6316 11
330
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
331
+ DISPOSITION 0.5000 1.0000 0.6667 1
332
+ EDCOURSE 0.0000 0.0000 0.0000 4
333
+ EXAM 0.5000 0.4000 0.4444 5
334
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
335
+ GENHX 0.8431 0.8113 0.8269 53
336
+ GYNHX 1.0000 1.0000 1.0000 1
337
+ IMAGING 1.0000 1.0000 1.0000 1
338
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
339
+ LABS 0.0000 0.0000 0.0000 1
340
+ MEDICATIONS 0.7692 1.0000 0.8696 10
341
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
342
+ PASTMEDICALHX 0.5789 0.7857 0.6667 14
343
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
344
+ PLAN 0.3333 1.0000 0.5000 1
345
+ PROCEDURES 0.0000 0.0000 0.0000 1
346
+ ROS 0.6667 0.7059 0.6857 17
347
+ first 0.0000 0.0000 0.0000 0
348
+
349
+ accuracy 0.7600 200
350
+ macro avg 0.5064 0.5568 0.5161 200
351
+ weighted avg 0.7392 0.7600 0.7426 200
352
+ |
353
+ | 0.0099 | 11.0 | 6611 | 0.7250 | precision recall f1-score support
354
+
355
+ ALLERGY 1.0000 0.9167 0.9565 12
356
+ ASSESSMENT 0.6000 0.2727 0.3750 11
357
+ CC 0.5556 0.4545 0.5000 11
358
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
359
+ DISPOSITION 0.3333 1.0000 0.5000 1
360
+ EDCOURSE 1.0000 0.2500 0.4000 4
361
+ EXAM 1.0000 0.4000 0.5714 5
362
+ FAM/SOCHX 0.8936 0.9333 0.9130 45
363
+ GENHX 0.7931 0.8679 0.8288 53
364
+ GYNHX 1.0000 1.0000 1.0000 1
365
+ IMAGING 1.0000 1.0000 1.0000 1
366
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
367
+ LABS 0.0000 0.0000 0.0000 1
368
+ MEDICATIONS 0.7692 1.0000 0.8696 10
369
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
370
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
371
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
372
+ PLAN 0.3333 1.0000 0.5000 1
373
+ PROCEDURES 0.0000 0.0000 0.0000 1
374
+ ROS 0.7222 0.7647 0.7429 17
375
+
376
+ accuracy 0.7800 200
377
+ macro avg 0.6316 0.6287 0.5904 200
378
+ weighted avg 0.7772 0.7800 0.7627 200
379
+ |
380
+ | 0.002 | 12.0 | 7212 | 0.8297 | precision recall f1-score support
381
+
382
+ ALLERGY 1.0000 0.9167 0.9565 12
383
+ ASSESSMENT 0.7500 0.2727 0.4000 11
384
+ CC 0.6250 0.4545 0.5263 11
385
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
386
+ DISPOSITION 1.0000 1.0000 1.0000 1
387
+ EDCOURSE 0.6667 0.5000 0.5714 4
388
+ EXAM 0.6667 0.4000 0.5000 5
389
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
390
+ GENHX 0.7931 0.8679 0.8288 53
391
+ GYNHX 1.0000 1.0000 1.0000 1
392
+ IMAGING 1.0000 1.0000 1.0000 1
393
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
394
+ LABS 0.0000 0.0000 0.0000 1
395
+ MEDICATIONS 0.7692 1.0000 0.8696 10
396
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
397
+ PASTMEDICALHX 0.4783 0.7857 0.5946 14
398
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
399
+ PLAN 0.3333 1.0000 0.5000 1
400
+ PROCEDURES 0.0000 0.0000 0.0000 1
401
+ ROS 0.8462 0.6471 0.7333 17
402
+
403
+ accuracy 0.7700 200
404
+ macro avg 0.6330 0.6318 0.6120 200
405
+ weighted avg 0.7682 0.7700 0.7551 200
406
+ |
407
+ | 0.0028 | 13.0 | 7813 | 0.8485 | precision recall f1-score support
408
+
409
+ ALLERGY 1.0000 0.9167 0.9565 12
410
+ ASSESSMENT 0.5714 0.3636 0.4444 11
411
+ CC 0.5000 0.3636 0.4211 11
412
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
413
+ DISPOSITION 1.0000 1.0000 1.0000 1
414
+ EDCOURSE 1.0000 0.5000 0.6667 4
415
+ EXAM 0.6667 0.4000 0.5000 5
416
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
417
+ GENHX 0.7705 0.8868 0.8246 53
418
+ GYNHX 0.0000 0.0000 0.0000 1
419
+ IMAGING 1.0000 1.0000 1.0000 1
420
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
421
+ LABS 0.0000 0.0000 0.0000 1
422
+ MEDICATIONS 0.7692 1.0000 0.8696 10
423
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
424
+ PASTMEDICALHX 0.6316 0.8571 0.7273 14
425
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
426
+ PLAN 0.3333 1.0000 0.5000 1
427
+ PROCEDURES 0.0000 0.0000 0.0000 1
428
+ ROS 0.8462 0.6471 0.7333 17
429
+
430
+ accuracy 0.7750 200
431
+ macro avg 0.5911 0.5863 0.5702 200
432
+ weighted avg 0.7579 0.7750 0.7568 200
433
+ |
434
+ | 0.0046 | 14.0 | 8414 | 0.8037 | precision recall f1-score support
435
+
436
+ ALLERGY 1.0000 0.9167 0.9565 12
437
+ ASSESSMENT 0.5000 0.3636 0.4211 11
438
+ CC 0.5556 0.4545 0.5000 11
439
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
440
+ DISPOSITION 1.0000 1.0000 1.0000 1
441
+ EDCOURSE 1.0000 0.5000 0.6667 4
442
+ EXAM 0.6667 0.4000 0.5000 5
443
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
444
+ GENHX 0.7797 0.8679 0.8214 53
445
+ GYNHX 1.0000 1.0000 1.0000 1
446
+ IMAGING 1.0000 1.0000 1.0000 1
447
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
448
+ LABS 0.0000 0.0000 0.0000 1
449
+ MEDICATIONS 0.7692 1.0000 0.8696 10
450
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
451
+ PARADIATIONS 0.0000 0.0000 0.0000 0
452
+ PASTMEDICALHX 0.6667 0.7143 0.6897 14
453
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
454
+ PLAN 0.3333 1.0000 0.5000 1
455
+ PROCEDURES 0.0000 0.0000 0.0000 1
456
+ ROS 0.8571 0.7059 0.7742 17
457
+ first CC 0.0000 0.0000 0.0000 0
458
+
459
+ accuracy 0.7750 200
460
+ macro avg 0.5846 0.5779 0.5663 200
461
+ weighted avg 0.7679 0.7750 0.7648 200
462
+ |
463
+ | 0.0018 | 15.0 | 9015 | 0.9396 | precision recall f1-score support
464
+
465
+ ALLERGY 1.0000 0.9167 0.9565 12
466
+ ASSESSMENT 0.7500 0.2727 0.4000 11
467
+ CC 0.6250 0.4545 0.5263 11
468
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
469
+ DISPOSITION 1.0000 1.0000 1.0000 1
470
+ EDCOURSE 0.6667 0.5000 0.5714 4
471
+ EXAM 1.0000 0.4000 0.5714 5
472
+ FAM/SOCHX 0.8936 0.9333 0.9130 45
473
+ GENHX 0.7931 0.8679 0.8288 53
474
+ GYNHX 0.0000 0.0000 0.0000 1
475
+ IMAGING 1.0000 1.0000 1.0000 1
476
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
477
+ LABS 0.0000 0.0000 0.0000 1
478
+ MEDICATIONS 0.7692 1.0000 0.8696 10
479
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
480
+ PASTMEDICALHX 0.5238 0.7857 0.6286 14
481
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
482
+ PLAN 0.3333 1.0000 0.5000 1
483
+ PROCEDURES 0.0000 0.0000 0.0000 1
484
+ ROS 0.7059 0.7059 0.7059 17
485
+ first CC 0.0000 0.0000 0.0000 0
486
+
487
+ accuracy 0.7700 200
488
+ macro avg 0.5675 0.5569 0.5395 200
489
+ weighted avg 0.7670 0.7700 0.7541 200
490
+ |
491
+ | 0.0014 | 16.0 | 9616 | 0.9559 | precision recall f1-score support
492
+
493
+ 2-year-old 0.0000 0.0000 0.0000 0
494
+ ALLERGY 1.0000 0.9167 0.9565 12
495
+ ASSESSMENT 0.5000 0.2727 0.3529 11
496
+ CC 0.6250 0.4545 0.5263 11
497
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
498
+ DISPOSITION 1.0000 1.0000 1.0000 1
499
+ EDCOURSE 0.0000 0.0000 0.0000 4
500
+ EXAM 0.5000 0.4000 0.4444 5
501
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
502
+ GENHX 0.8654 0.8491 0.8571 53
503
+ GYNHX 1.0000 1.0000 1.0000 1
504
+ IMAGING 1.0000 1.0000 1.0000 1
505
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
506
+ LABS 0.0000 0.0000 0.0000 1
507
+ MEDICATIONS 0.7692 1.0000 0.8696 10
508
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
509
+ PASTMEDICALHX 0.5455 0.8571 0.6667 14
510
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
511
+ PLAN 0.3333 1.0000 0.5000 1
512
+ PROCEDURES 0.0000 0.0000 0.0000 1
513
+ ROS 0.7059 0.7059 0.7059 17
514
+
515
+ accuracy 0.7650 200
516
+ macro avg 0.5513 0.5832 0.5543 200
517
+ weighted avg 0.7489 0.7650 0.7499 200
518
+ |
519
+ | 0.0008 | 17.0 | 10217 | 0.9696 | precision recall f1-score support
520
+
521
+ ALLERGY 1.0000 0.9167 0.9565 12
522
+ ASSESSMENT 0.6000 0.2727 0.3750 11
523
+ CC 0.6250 0.4545 0.5263 11
524
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
525
+ DISPOSITION 1.0000 1.0000 1.0000 1
526
+ EDCOURSE 0.0000 0.0000 0.0000 4
527
+ EXAM 0.5000 0.4000 0.4444 5
528
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
529
+ GENHX 0.8364 0.8679 0.8519 53
530
+ GYNHX 1.0000 1.0000 1.0000 1
531
+ IMAGING 1.0000 1.0000 1.0000 1
532
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
533
+ LABS 0.0000 0.0000 0.0000 1
534
+ MEDICATIONS 0.7692 1.0000 0.8696 10
535
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
536
+ PASTMEDICALHX 0.5000 0.7857 0.6111 14
537
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
538
+ PLAN 0.3333 1.0000 0.5000 1
539
+ PROCEDURES 0.0000 0.0000 0.0000 1
540
+ ROS 0.7500 0.7059 0.7273 17
541
+ first CC 0.0000 0.0000 0.0000 0
542
+
543
+ accuracy 0.7650 200
544
+ macro avg 0.5546 0.5807 0.5535 200
545
+ weighted avg 0.7473 0.7650 0.7476 200
546
+ |
547
+ | 0.0002 | 18.0 | 10818 | 0.9922 | precision recall f1-score support
548
+
549
+ ALLERGY 1.0000 0.9167 0.9565 12
550
+ ASSESSMENT 0.4000 0.1818 0.2500 11
551
+ CC 0.6667 0.3636 0.4706 11
552
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
553
+ DISPOSITION 0.2500 1.0000 0.4000 1
554
+ EDCOURSE 0.0000 0.0000 0.0000 4
555
+ EXAM 0.5000 0.4000 0.4444 5
556
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
557
+ GENHX 0.7931 0.8679 0.8288 53
558
+ GYNHX 1.0000 1.0000 1.0000 1
559
+ IMAGING 1.0000 1.0000 1.0000 1
560
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
561
+ LABS 0.0000 0.0000 0.0000 1
562
+ MEDICATIONS 0.7692 1.0000 0.8696 10
563
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
564
+ PASTMEDICALHX 0.6111 0.7857 0.6875 14
565
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
566
+ PLAN 0.3333 1.0000 0.5000 1
567
+ PROCEDURES 0.0000 0.0000 0.0000 1
568
+ ROS 0.8000 0.7059 0.7500 17
569
+ first CC 0.0000 0.0000 0.0000 0
570
+
571
+ accuracy 0.7550 200
572
+ macro avg 0.5169 0.5720 0.5199 200
573
+ weighted avg 0.7354 0.7550 0.7359 200
574
+ |
575
+ | 0.0001 | 19.0 | 11419 | 0.9879 | precision recall f1-score support
576
+
577
+ ALLERGY 1.0000 0.9167 0.9565 12
578
+ ASSESSMENT 0.5000 0.2727 0.3529 11
579
+ CC 0.6667 0.3636 0.4706 11
580
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
581
+ DISPOSITION 0.2500 1.0000 0.4000 1
582
+ EDCOURSE 0.0000 0.0000 0.0000 4
583
+ EXAM 0.5000 0.4000 0.4444 5
584
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
585
+ GENHX 0.7931 0.8679 0.8288 53
586
+ GYNHX 1.0000 1.0000 1.0000 1
587
+ IMAGING 1.0000 1.0000 1.0000 1
588
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
589
+ LABS 0.0000 0.0000 0.0000 1
590
+ MEDICATIONS 0.7692 1.0000 0.8696 10
591
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
592
+ PASTMEDICALHX 0.6111 0.7857 0.6875 14
593
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
594
+ PLAN 0.3333 1.0000 0.5000 1
595
+ PROCEDURES 0.0000 0.0000 0.0000 1
596
+ ROS 0.8000 0.7059 0.7500 17
597
+ first CC 0.0000 0.0000 0.0000 0
598
+
599
+ accuracy 0.7600 200
600
+ macro avg 0.5217 0.5763 0.5248 200
601
+ weighted avg 0.7409 0.7600 0.7415 200
602
+ |
603
+ | 0.0001 | 20.0 | 12020 | 0.9946 | precision recall f1-score support
604
+
605
+ ALLERGY 1.0000 0.9167 0.9565 12
606
+ ASSESSMENT 0.4000 0.1818 0.2500 11
607
+ CC 0.5714 0.3636 0.4444 11
608
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
609
+ DISPOSITION 0.2500 1.0000 0.4000 1
610
+ EDCOURSE 0.0000 0.0000 0.0000 4
611
+ EXAM 0.5000 0.4000 0.4444 5
612
+ FAM/SOCHX 0.8750 0.9333 0.9032 45
613
+ GENHX 0.7931 0.8679 0.8288 53
614
+ GYNHX 1.0000 1.0000 1.0000 1
615
+ IMAGING 1.0000 1.0000 1.0000 1
616
+ IMMUNIZATIONS 1.0000 1.0000 1.0000 1
617
+ LABS 0.0000 0.0000 0.0000 1
618
+ MEDICATIONS 0.7692 1.0000 0.8696 10
619
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
620
+ PASTMEDICALHX 0.6111 0.7857 0.6875 14
621
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
622
+ PLAN 0.3333 1.0000 0.5000 1
623
+ PROCEDURES 0.0000 0.0000 0.0000 1
624
+ ROS 0.8000 0.7059 0.7500 17
625
+ first CC 0.0000 0.0000 0.0000 0
626
+
627
+ accuracy 0.7550 200
628
+ macro avg 0.5124 0.5720 0.5187 200
629
+ weighted avg 0.7301 0.7550 0.7344 200
630
+ |
631
+
632
+
633
+ ### Framework versions
634
+
635
+ - Transformers 4.35.2
636
+ - Pytorch 2.1.0+cu121
637
+ - Datasets 2.16.1
638
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:909a12253e118ac5b22ced4fc3ffd79bb3c083a787dc3d7b67351aafd571eb73
3
  size 990345064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08bc12f33a2974742f3f2988806d0dfc64fb4890cc7d9a3b300eed1dc94f04db
3
  size 990345064
runs/Jan15_16-34-58_6653ac6dbe93/events.out.tfevents.1705336506.6653ac6dbe93.6660.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f927a8f591f504779183ceea5c7e7b0eef6921587ff68585e5e543401926a4db
3
- size 14237
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b4c4bcd12ffb869534c5dad6400d67d8c68768424023bb92892c89ab02e59f1
3
+ size 14862