nttaii commited on
Commit
549cbe6
1 Parent(s): 76ae007

Training complete

Browse files
Files changed (2) hide show
  1. README.md +236 -0
  2. model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,236 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: bert-base-multilingual-cased
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: run_20240702210535
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # run_20240702210535
15
+
16
+ This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.3214
19
+ - Precision: 0.6028
20
+ - Recall: 0.6325
21
+ - F1: 0.6173
22
+ - Number: 237046
23
+ - Ageno Precision: 0.8230
24
+ - Ageno Recall: 0.8335
25
+ - Ageno F1: 0.8282
26
+ - Ageno Number: 8131
27
+ - Ank Account/bic Precision: 0.9559
28
+ - Ank Account/bic Recall: 0.9753
29
+ - Ank Account/bic F1: 0.9655
30
+ - Ank Account/bic Number: 50290
31
+ - Ank Account/iban Precision: 0.8894
32
+ - Ank Account/iban Recall: 0.9289
33
+ - Ank Account/iban F1: 0.9087
34
+ - Ank Account/iban Number: 84619
35
+ - Ank Account/bankinfo Precision: 0.7777
36
+ - Ank Account/bankinfo Recall: 0.8063
37
+ - Ank Account/bankinfo F1: 0.7917
38
+ - Ank Account/bankinfo Number: 36138
39
+ - Ank Account/currencycode Precision: 0.7507
40
+ - Ank Account/currencycode Recall: 0.3748
41
+ - Ank Account/currencycode F1: 0.5
42
+ - Ank Account/currencycode Number: 1374
43
+ - Ardnumber Precision: 0.3289
44
+ - Ardnumber Recall: 0.3175
45
+ - Ardnumber F1: 0.3231
46
+ - Ardnumber Number: 929
47
+ - Ardtype Precision: 0.5436
48
+ - Ardtype Recall: 0.5444
49
+ - Ardtype F1: 0.5440
50
+ - Ardtype Number: 3821
51
+ - Axamount Precision: 0.7977
52
+ - Axamount Recall: 0.7972
53
+ - Axamount F1: 0.7975
54
+ - Axamount Number: 5302
55
+ - Eservationnumber Precision: 0.4791
56
+ - Eservationnumber Recall: 0.5078
57
+ - Eservationnumber F1: 0.4930
58
+ - Eservationnumber Number: 2568
59
+ - Etamount Precision: 0.7795
60
+ - Etamount Recall: 0.7792
61
+ - Etamount F1: 0.7794
62
+ - Etamount Number: 6299
63
+ - Heckin Precision: 0.9099
64
+ - Heckin Recall: 0.9260
65
+ - Heckin F1: 0.9179
66
+ - Heckin Number: 17115
67
+ - Heckout Precision: 0.9203
68
+ - Heckout Recall: 0.9320
69
+ - Heckout F1: 0.9261
70
+ - Heckout Number: 17016
71
+ - Nvoicedate Precision: 0.9084
72
+ - Nvoicedate Recall: 0.9204
73
+ - Nvoicedate F1: 0.9144
74
+ - Nvoicedate Number: 14899
75
+ - Nvoicenumber Precision: 0.8595
76
+ - Nvoicenumber Recall: 0.8827
77
+ - Nvoicenumber F1: 0.8710
78
+ - Nvoicenumber Number: 14479
79
+ - Ocumenttype Precision: 0.7821
80
+ - Ocumenttype Recall: 0.8193
81
+ - Ocumenttype F1: 0.8003
82
+ - Ocumenttype Number: 13966
83
+ - Ompanyaddress Precision: 0.7657
84
+ - Ompanyaddress Recall: 0.7917
85
+ - Ompanyaddress F1: 0.7785
86
+ - Ompanyaddress Number: 15201
87
+ - Ompanycity Precision: 0.8504
88
+ - Ompanycity Recall: 0.8760
89
+ - Ompanycity F1: 0.8630
90
+ - Ompanycity Number: 14804
91
+ - Ompanycountry Precision: 0.8759
92
+ - Ompanycountry Recall: 0.8851
93
+ - Ompanycountry F1: 0.8805
94
+ - Ompanycountry Number: 9011
95
+ - Ompanyname Precision: 0.6986
96
+ - Ompanyname Recall: 0.7240
97
+ - Ompanyname F1: 0.7111
98
+ - Ompanyname Number: 15233
99
+ - Ompanyvatnumber Precision: 0.6079
100
+ - Ompanyvatnumber Recall: 0.6684
101
+ - Ompanyvatnumber F1: 0.6367
102
+ - Ompanyvatnumber Number: 3474
103
+ - Ompanyzipcode Precision: 0.9190
104
+ - Ompanyzipcode Recall: 0.9434
105
+ - Ompanyzipcode F1: 0.9310
106
+ - Ompanyzipcode Number: 14770
107
+ - Ookingnumber Precision: 0.4084
108
+ - Ookingnumber Recall: 0.3214
109
+ - Ookingnumber F1: 0.3597
110
+ - Ookingnumber Number: 2156
111
+ - Oomno Precision: 0.8351
112
+ - Oomno Recall: 0.8537
113
+ - Oomno F1: 0.8443
114
+ - Oomno Number: 17347
115
+ - Oteladdress Precision: 0.4710
116
+ - Oteladdress Recall: 0.5188
117
+ - Oteladdress F1: 0.4937
118
+ - Oteladdress Number: 14199
119
+ - Otelbankaccount Precision: 0.0
120
+ - Otelbankaccount Recall: 0.0
121
+ - Otelbankaccount F1: 0.0
122
+ - Otelbankaccount Number: 73
123
+ - Otelcity Precision: 0.6779
124
+ - Otelcity Recall: 0.7343
125
+ - Otelcity F1: 0.7050
126
+ - Otelcity Number: 13694
127
+ - Otelcountry Precision: 0.7598
128
+ - Otelcountry Recall: 0.7686
129
+ - Otelcountry F1: 0.7642
130
+ - Otelcountry Number: 3358
131
+ - Otelemail Precision: 0.8933
132
+ - Otelemail Recall: 0.9382
133
+ - Otelemail F1: 0.9152
134
+ - Otelemail Number: 10425
135
+ - Otelfaxnumber Precision: 0.8234
136
+ - Otelfaxnumber Recall: 0.8668
137
+ - Otelfaxnumber F1: 0.8446
138
+ - Otelfaxnumber Number: 7689
139
+ - Otelname Precision: 0.3599
140
+ - Otelname Recall: 0.3987
141
+ - Otelname F1: 0.3783
142
+ - Otelname Number: 14855
143
+ - Otelphonenumber Precision: 0.8023
144
+ - Otelphonenumber Recall: 0.8373
145
+ - Otelphonenumber F1: 0.8194
146
+ - Otelphonenumber Number: 11808
147
+ - Oteltaxcode Precision: 0.4169
148
+ - Oteltaxcode Recall: 0.4602
149
+ - Oteltaxcode F1: 0.4375
150
+ - Oteltaxcode Number: 2338
151
+ - Otelvatnumber Precision: 0.6870
152
+ - Otelvatnumber Recall: 0.7394
153
+ - Otelvatnumber F1: 0.7122
154
+ - Otelvatnumber Number: 9094
155
+ - Otelzipcode Precision: 0.7230
156
+ - Otelzipcode Recall: 0.7776
157
+ - Otelzipcode F1: 0.7493
158
+ - Otelzipcode Number: 13620
159
+ - Rafficdate Precision: 0.0
160
+ - Rafficdate Recall: 0.0
161
+ - Rafficdate F1: 0.0
162
+ - Rafficdate Number: 106
163
+ - Ravellername Precision: 0.5621
164
+ - Ravellername Recall: 0.5663
165
+ - Ravellername F1: 0.5642
166
+ - Ravellername Number: 17893
167
+ - Rewtype Precision: 0.0
168
+ - Rewtype Recall: 0.0
169
+ - Rewtype F1: 0.0
170
+ - Rewtype Number: 56
171
+ - Rossamount Precision: 0.7012
172
+ - Rossamount Recall: 0.7258
173
+ - Rossamount F1: 0.7133
174
+ - Rossamount Number: 12491
175
+ - Rrivaltrainno Precision: 0.1818
176
+ - Rrivaltrainno Recall: 0.0494
177
+ - Rrivaltrainno F1: 0.0777
178
+ - Rrivaltrainno Number: 81
179
+ - Urrencycode Precision: 0.5212
180
+ - Urrencycode Recall: 0.5927
181
+ - Urrencycode F1: 0.5547
182
+ - Urrencycode Number: 8510
183
+ - Xternalreservationnumber Precision: 0.3103
184
+ - Xternalreservationnumber Recall: 0.3205
185
+ - Xternalreservationnumber F1: 0.3153
186
+ - Xternalreservationnumber Number: 546
187
+ - Overall Precision: 0.7298
188
+ - Overall Recall: 0.7596
189
+ - Overall F1: 0.7444
190
+ - Overall Accuracy: 0.9298
191
+
192
+ ## Model description
193
+
194
+ More information needed
195
+
196
+ ## Intended uses & limitations
197
+
198
+ More information needed
199
+
200
+ ## Training and evaluation data
201
+
202
+ More information needed
203
+
204
+ ## Training procedure
205
+
206
+ ### Training hyperparameters
207
+
208
+ The following hyperparameters were used during training:
209
+ - learning_rate: 2e-05
210
+ - train_batch_size: 8
211
+ - eval_batch_size: 8
212
+ - seed: 42
213
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
214
+ - lr_scheduler_type: linear
215
+ - num_epochs: 8
216
+
217
+ ### Training results
218
+
219
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Number | Ageno Precision | Ageno Recall | Ageno F1 | Ageno Number | Ank Account/bic Precision | Ank Account/bic Recall | Ank Account/bic F1 | Ank Account/bic Number | Ank Account/iban Precision | Ank Account/iban Recall | Ank Account/iban F1 | Ank Account/iban Number | Ank Account/bankinfo Precision | Ank Account/bankinfo Recall | Ank Account/bankinfo F1 | Ank Account/bankinfo Number | Ank Account/currencycode Precision | Ank Account/currencycode Recall | Ank Account/currencycode F1 | Ank Account/currencycode Number | Ardnumber Precision | Ardnumber Recall | Ardnumber F1 | Ardnumber Number | Ardtype Precision | Ardtype Recall | Ardtype F1 | Ardtype Number | Axamount Precision | Axamount Recall | Axamount F1 | Axamount Number | Eservationnumber Precision | Eservationnumber Recall | Eservationnumber F1 | Eservationnumber Number | Etamount Precision | Etamount Recall | Etamount F1 | Etamount Number | Heckin Precision | Heckin Recall | Heckin F1 | Heckin Number | Heckout Precision | Heckout Recall | Heckout F1 | Heckout Number | Nvoicedate Precision | Nvoicedate Recall | Nvoicedate F1 | Nvoicedate Number | Nvoicenumber Precision | Nvoicenumber Recall | Nvoicenumber F1 | Nvoicenumber Number | Ocumenttype Precision | Ocumenttype Recall | Ocumenttype F1 | Ocumenttype Number | Ompanyaddress Precision | Ompanyaddress Recall | Ompanyaddress F1 | Ompanyaddress Number | Ompanycity Precision | Ompanycity Recall | Ompanycity F1 | Ompanycity Number | Ompanycountry Precision | Ompanycountry Recall | Ompanycountry F1 | Ompanycountry Number | Ompanyname Precision | Ompanyname Recall | Ompanyname F1 | Ompanyname Number | Ompanyvatnumber Precision | Ompanyvatnumber Recall | Ompanyvatnumber F1 | Ompanyvatnumber Number | Ompanyzipcode Precision | Ompanyzipcode Recall | Ompanyzipcode F1 | Ompanyzipcode Number | Ookingnumber Precision | Ookingnumber Recall | Ookingnumber F1 | Ookingnumber Number | Oomno Precision | Oomno Recall | Oomno F1 | Oomno Number | Oteladdress Precision | Oteladdress Recall | Oteladdress F1 | Oteladdress Number | Otelbankaccount Precision | Otelbankaccount Recall | Otelbankaccount F1 | Otelbankaccount Number | Otelcity Precision | Otelcity Recall | Otelcity F1 | Otelcity Number | Otelcountry Precision | Otelcountry Recall | Otelcountry F1 | Otelcountry Number | Otelemail Precision | Otelemail Recall | Otelemail F1 | Otelemail Number | Otelfaxnumber Precision | Otelfaxnumber Recall | Otelfaxnumber F1 | Otelfaxnumber Number | Otelname Precision | Otelname Recall | Otelname F1 | Otelname Number | Otelphonenumber Precision | Otelphonenumber Recall | Otelphonenumber F1 | Otelphonenumber Number | Oteltaxcode Precision | Oteltaxcode Recall | Oteltaxcode F1 | Oteltaxcode Number | Otelvatnumber Precision | Otelvatnumber Recall | Otelvatnumber F1 | Otelvatnumber Number | Otelzipcode Precision | Otelzipcode Recall | Otelzipcode F1 | Otelzipcode Number | Rafficdate Precision | Rafficdate Recall | Rafficdate F1 | Rafficdate Number | Ravellername Precision | Ravellername Recall | Ravellername F1 | Ravellername Number | Rewtype Precision | Rewtype Recall | Rewtype F1 | Rewtype Number | Rossamount Precision | Rossamount Recall | Rossamount F1 | Rossamount Number | Rrivaltrainno Precision | Rrivaltrainno Recall | Rrivaltrainno F1 | Rrivaltrainno Number | Urrencycode Precision | Urrencycode Recall | Urrencycode F1 | Urrencycode Number | Xternalreservationnumber Precision | Xternalreservationnumber Recall | Xternalreservationnumber F1 | Xternalreservationnumber Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
220
+ |:-------------:|:-----:|:-----:|:---------------:|:-----------:|:--------:|:------:|:--------:|:---------------:|:------------:|:--------:|:------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:------------------------------:|:---------------------------:|:-----------------------:|:---------------------------:|:----------------------------------:|:-------------------------------:|:---------------------------:|:-------------------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------:|:--------------:|:----------:|:--------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------------------:|:-----------------------:|:-------------------:|:-----------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:---------------:|:------------:|:--------:|:------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-------------------:|:----------------:|:------------:|:----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:------------------:|:---------------:|:-----------:|:---------------:|:-------------------------:|:----------------------:|:------------------:|:----------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:-----------------:|:--------------:|:----------:|:--------------:|:--------------------:|:-----------------:|:-------------:|:-----------------:|:-----------------------:|:--------------------:|:----------------:|:--------------------:|:---------------------:|:------------------:|:--------------:|:------------------:|:----------------------------------:|:-------------------------------:|:---------------------------:|:-------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
221
+ | 0.1284 | 1.0 | 9028 | 0.2249 | 0.6051 | 0.6381 | 0.6212 | 237046 | 0.8298 | 0.8486 | 0.8391 | 8131 | 0.9500 | 0.9829 | 0.9661 | 50290 | 0.8675 | 0.9672 | 0.9147 | 84619 | 0.7426 | 0.8671 | 0.8000 | 36138 | 0.7634 | 0.2278 | 0.3509 | 1374 | 0.4002 | 0.4273 | 0.4133 | 929 | 0.4746 | 0.6053 | 0.5320 | 3821 | 0.7542 | 0.7993 | 0.7761 | 5302 | 0.5823 | 0.5234 | 0.5513 | 2568 | 0.7222 | 0.7484 | 0.7351 | 6299 | 0.8997 | 0.9417 | 0.9202 | 17115 | 0.8939 | 0.9516 | 0.9219 | 17016 | 0.9084 | 0.9411 | 0.9245 | 14899 | 0.8265 | 0.9056 | 0.8643 | 14479 | 0.7735 | 0.8466 | 0.8084 | 13966 | 0.7846 | 0.8053 | 0.7949 | 15201 | 0.8367 | 0.8781 | 0.8569 | 14804 | 0.8513 | 0.8905 | 0.8704 | 9011 | 0.7246 | 0.7488 | 0.7365 | 15233 | 0.5700 | 0.7029 | 0.6295 | 3474 | 0.9078 | 0.9416 | 0.9244 | 14770 | 0.4890 | 0.2880 | 0.3625 | 2156 | 0.8005 | 0.8676 | 0.8327 | 17347 | 0.5074 | 0.5322 | 0.5195 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6766 | 0.7324 | 0.7034 | 13694 | 0.7753 | 0.7335 | 0.7538 | 3358 | 0.8659 | 0.9431 | 0.9028 | 10425 | 0.8095 | 0.8758 | 0.8413 | 7689 | 0.3709 | 0.3988 | 0.3843 | 14855 | 0.8148 | 0.8661 | 0.8397 | 11808 | 0.4123 | 0.4808 | 0.4439 | 2338 | 0.6639 | 0.7497 | 0.7042 | 9094 | 0.7285 | 0.7670 | 0.7473 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5650 | 0.5714 | 0.5682 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6678 | 0.7477 | 0.7055 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5382 | 0.5533 | 0.5457 | 8510 | 0.2434 | 0.3370 | 0.2826 | 546 | 0.7255 | 0.7735 | 0.7487 | 0.9302 |
222
+ | 0.0949 | 2.0 | 18056 | 0.2538 | 0.6162 | 0.6452 | 0.6303 | 237046 | 0.8405 | 0.8458 | 0.8431 | 8131 | 0.9490 | 0.9812 | 0.9649 | 50290 | 0.8735 | 0.9649 | 0.9170 | 84619 | 0.7396 | 0.8769 | 0.8024 | 36138 | 0.6905 | 0.3719 | 0.4834 | 1374 | 0.4151 | 0.3897 | 0.4020 | 929 | 0.5313 | 0.5258 | 0.5285 | 3821 | 0.8081 | 0.7988 | 0.8034 | 5302 | 0.5410 | 0.5191 | 0.5298 | 2568 | 0.7758 | 0.7496 | 0.7625 | 6299 | 0.8919 | 0.9457 | 0.9180 | 17115 | 0.9044 | 0.9463 | 0.9249 | 17016 | 0.9129 | 0.9350 | 0.9238 | 14899 | 0.8430 | 0.8905 | 0.8661 | 14479 | 0.7821 | 0.8443 | 0.8120 | 13966 | 0.7772 | 0.8112 | 0.7938 | 15201 | 0.8387 | 0.8730 | 0.8555 | 14804 | 0.8723 | 0.8940 | 0.8830 | 9011 | 0.7337 | 0.7492 | 0.7414 | 15233 | 0.5927 | 0.7637 | 0.6674 | 3474 | 0.9079 | 0.9436 | 0.9254 | 14770 | 0.4455 | 0.3827 | 0.4117 | 2156 | 0.8238 | 0.8998 | 0.8601 | 17347 | 0.5073 | 0.5811 | 0.5417 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6748 | 0.7625 | 0.7159 | 13694 | 0.7798 | 0.7719 | 0.7758 | 3358 | 0.8900 | 0.9372 | 0.9130 | 10425 | 0.8245 | 0.8796 | 0.8511 | 7689 | 0.3752 | 0.4187 | 0.3958 | 14855 | 0.8101 | 0.8608 | 0.8347 | 11808 | 0.3970 | 0.3867 | 0.3918 | 2338 | 0.6857 | 0.7671 | 0.7241 | 9094 | 0.7172 | 0.8081 | 0.7600 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5803 | 0.6002 | 0.5901 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6878 | 0.7319 | 0.7091 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5058 | 0.6246 | 0.5589 | 8510 | 0.2834 | 0.2601 | 0.2713 | 546 | 0.7320 | 0.7803 | 0.7554 | 0.9309 |
223
+ | 0.0782 | 3.0 | 27084 | 0.2606 | 0.6117 | 0.6390 | 0.6250 | 237046 | 0.8184 | 0.8262 | 0.8223 | 8131 | 0.9502 | 0.9816 | 0.9657 | 50290 | 0.8877 | 0.9201 | 0.9036 | 84619 | 0.7477 | 0.8500 | 0.7955 | 36138 | 0.5903 | 0.3282 | 0.4219 | 1374 | 0.3621 | 0.4241 | 0.3907 | 929 | 0.5362 | 0.5972 | 0.5651 | 3821 | 0.8191 | 0.8059 | 0.8124 | 5302 | 0.4764 | 0.5350 | 0.5040 | 2568 | 0.7917 | 0.7520 | 0.7714 | 6299 | 0.9026 | 0.9322 | 0.9172 | 17115 | 0.9173 | 0.9306 | 0.9239 | 17016 | 0.9072 | 0.9280 | 0.9175 | 14899 | 0.8581 | 0.8802 | 0.8690 | 14479 | 0.7958 | 0.8043 | 0.8000 | 13966 | 0.7862 | 0.8067 | 0.7963 | 15201 | 0.8454 | 0.8715 | 0.8583 | 14804 | 0.8700 | 0.8935 | 0.8816 | 9011 | 0.7315 | 0.7457 | 0.7385 | 15233 | 0.6142 | 0.7260 | 0.6654 | 3474 | 0.9243 | 0.9458 | 0.9349 | 14770 | 0.4591 | 0.3200 | 0.3772 | 2156 | 0.8301 | 0.8991 | 0.8632 | 17347 | 0.5019 | 0.5571 | 0.5281 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6794 | 0.7505 | 0.7132 | 13694 | 0.7549 | 0.7731 | 0.7639 | 3358 | 0.8898 | 0.9406 | 0.9145 | 10425 | 0.8262 | 0.8744 | 0.8496 | 7689 | 0.3755 | 0.4342 | 0.4027 | 14855 | 0.8130 | 0.8565 | 0.8342 | 11808 | 0.4039 | 0.4880 | 0.4420 | 2338 | 0.6806 | 0.7690 | 0.7221 | 9094 | 0.7218 | 0.7937 | 0.7560 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5664 | 0.5833 | 0.5747 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7069 | 0.7203 | 0.7135 | 12491 | 0.0 | 0.0 | 0.0 | 81 | 0.5185 | 0.6040 | 0.5580 | 8510 | 0.2916 | 0.2985 | 0.2950 | 546 | 0.7324 | 0.7688 | 0.7501 | 0.9298 |
224
+ | 0.0694 | 4.0 | 36112 | 0.2742 | 0.6140 | 0.6404 | 0.6269 | 237046 | 0.8279 | 0.8427 | 0.8353 | 8131 | 0.9584 | 0.9779 | 0.9681 | 50290 | 0.8788 | 0.9550 | 0.9153 | 84619 | 0.7570 | 0.8489 | 0.8003 | 36138 | 0.6154 | 0.3726 | 0.4642 | 1374 | 0.3753 | 0.3079 | 0.3383 | 929 | 0.5500 | 0.5472 | 0.5486 | 3821 | 0.8143 | 0.8046 | 0.8094 | 5302 | 0.4958 | 0.5502 | 0.5216 | 2568 | 0.7635 | 0.7820 | 0.7726 | 6299 | 0.8950 | 0.9375 | 0.9158 | 17115 | 0.9195 | 0.9421 | 0.9307 | 17016 | 0.9184 | 0.9130 | 0.9157 | 14899 | 0.8473 | 0.8920 | 0.8691 | 14479 | 0.7910 | 0.8237 | 0.8070 | 13966 | 0.7911 | 0.8068 | 0.7989 | 15201 | 0.8482 | 0.8748 | 0.8613 | 14804 | 0.8821 | 0.8880 | 0.8850 | 9011 | 0.7338 | 0.7524 | 0.7430 | 15233 | 0.6135 | 0.7268 | 0.6653 | 3474 | 0.9229 | 0.9471 | 0.9348 | 14770 | 0.4395 | 0.3353 | 0.3804 | 2156 | 0.8377 | 0.8575 | 0.8475 | 17347 | 0.5023 | 0.5608 | 0.5299 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6818 | 0.7411 | 0.7102 | 13694 | 0.7758 | 0.7624 | 0.7690 | 3358 | 0.8859 | 0.9463 | 0.9151 | 10425 | 0.8254 | 0.8763 | 0.8501 | 7689 | 0.3629 | 0.4012 | 0.3811 | 14855 | 0.8099 | 0.8589 | 0.8337 | 11808 | 0.4079 | 0.4179 | 0.4128 | 2338 | 0.6814 | 0.7562 | 0.7168 | 9094 | 0.7155 | 0.7878 | 0.7499 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5795 | 0.5858 | 0.5826 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7074 | 0.7414 | 0.7240 | 12491 | 0.1667 | 0.0123 | 0.0230 | 81 | 0.5150 | 0.6221 | 0.5635 | 8510 | 0.3077 | 0.1832 | 0.2296 | 546 | 0.7348 | 0.7723 | 0.7531 | 0.9304 |
225
+ | 0.0611 | 5.0 | 45140 | 0.2882 | 0.6023 | 0.6380 | 0.6197 | 237046 | 0.8333 | 0.8466 | 0.8399 | 8131 | 0.9550 | 0.9796 | 0.9671 | 50290 | 0.8793 | 0.9514 | 0.9139 | 84619 | 0.7702 | 0.8053 | 0.7873 | 36138 | 0.6968 | 0.3362 | 0.4536 | 1374 | 0.3502 | 0.3423 | 0.3462 | 929 | 0.5616 | 0.5357 | 0.5484 | 3821 | 0.7968 | 0.8084 | 0.8025 | 5302 | 0.4867 | 0.5257 | 0.5054 | 2568 | 0.7753 | 0.7809 | 0.7781 | 6299 | 0.8936 | 0.9431 | 0.9177 | 17115 | 0.9145 | 0.9476 | 0.9307 | 17016 | 0.9093 | 0.9276 | 0.9184 | 14899 | 0.8563 | 0.8794 | 0.8677 | 14479 | 0.7865 | 0.8224 | 0.8041 | 13966 | 0.7796 | 0.8055 | 0.7924 | 15201 | 0.8437 | 0.8769 | 0.8600 | 14804 | 0.8774 | 0.8936 | 0.8854 | 9011 | 0.7129 | 0.7315 | 0.7221 | 15233 | 0.6146 | 0.6894 | 0.6498 | 3474 | 0.9177 | 0.9469 | 0.9320 | 14770 | 0.4048 | 0.3905 | 0.3975 | 2156 | 0.8147 | 0.8874 | 0.8495 | 17347 | 0.4697 | 0.5330 | 0.4993 | 14199 | 0.0167 | 0.0137 | 0.0150 | 73 | 0.6612 | 0.7259 | 0.6921 | 13694 | 0.7438 | 0.7832 | 0.7630 | 3358 | 0.8861 | 0.9432 | 0.9138 | 10425 | 0.8241 | 0.8813 | 0.8517 | 7689 | 0.3579 | 0.3929 | 0.3746 | 14855 | 0.8134 | 0.8595 | 0.8358 | 11808 | 0.4019 | 0.3888 | 0.3952 | 2338 | 0.6700 | 0.7726 | 0.7176 | 9094 | 0.7078 | 0.7703 | 0.7377 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5627 | 0.5884 | 0.5752 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6969 | 0.7388 | 0.7172 | 12491 | 0.0833 | 0.0123 | 0.0215 | 81 | 0.5232 | 0.5875 | 0.5535 | 8510 | 0.3384 | 0.2033 | 0.2540 | 546 | 0.7275 | 0.7683 | 0.7473 | 0.9289 |
226
+ | 0.0553 | 6.0 | 54168 | 0.3093 | 0.6089 | 0.6331 | 0.6207 | 237046 | 0.8358 | 0.8460 | 0.8409 | 8131 | 0.9535 | 0.9790 | 0.9660 | 50290 | 0.8810 | 0.9473 | 0.9130 | 84619 | 0.7619 | 0.8295 | 0.7942 | 36138 | 0.7952 | 0.3588 | 0.4945 | 1374 | 0.3539 | 0.3574 | 0.3557 | 929 | 0.5173 | 0.5708 | 0.5427 | 3821 | 0.7957 | 0.8005 | 0.7980 | 5302 | 0.4793 | 0.5549 | 0.5143 | 2568 | 0.7789 | 0.7742 | 0.7766 | 6299 | 0.9099 | 0.9173 | 0.9136 | 17115 | 0.9204 | 0.9266 | 0.9235 | 17016 | 0.9095 | 0.9170 | 0.9132 | 14899 | 0.8601 | 0.8832 | 0.8715 | 14479 | 0.7790 | 0.8266 | 0.8021 | 13966 | 0.7831 | 0.8054 | 0.7941 | 15201 | 0.8500 | 0.8801 | 0.8648 | 14804 | 0.8702 | 0.8956 | 0.8827 | 9011 | 0.7089 | 0.7308 | 0.7197 | 15233 | 0.6191 | 0.6635 | 0.6405 | 3474 | 0.9154 | 0.9443 | 0.9296 | 14770 | 0.3951 | 0.3660 | 0.3800 | 2156 | 0.8354 | 0.8543 | 0.8447 | 17347 | 0.4847 | 0.5319 | 0.5072 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6816 | 0.7360 | 0.7078 | 13694 | 0.7452 | 0.7707 | 0.7577 | 3358 | 0.8872 | 0.9373 | 0.9116 | 10425 | 0.8264 | 0.8736 | 0.8493 | 7689 | 0.3592 | 0.3978 | 0.3775 | 14855 | 0.8103 | 0.8536 | 0.8314 | 11808 | 0.4039 | 0.4196 | 0.4116 | 2338 | 0.6838 | 0.7559 | 0.7181 | 9094 | 0.7153 | 0.7747 | 0.7438 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5742 | 0.5826 | 0.5784 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7049 | 0.7295 | 0.7170 | 12491 | 0.125 | 0.0247 | 0.0412 | 81 | 0.5273 | 0.5794 | 0.5522 | 8510 | 0.3026 | 0.3187 | 0.3104 | 546 | 0.7317 | 0.7651 | 0.7480 | 0.9291 |
227
+ | 0.0479 | 7.0 | 63196 | 0.3174 | 0.6063 | 0.6329 | 0.6193 | 237046 | 0.8272 | 0.8409 | 0.8340 | 8131 | 0.9548 | 0.9760 | 0.9652 | 50290 | 0.8877 | 0.9305 | 0.9086 | 84619 | 0.7774 | 0.8091 | 0.7929 | 36138 | 0.7544 | 0.3755 | 0.5015 | 1374 | 0.3398 | 0.3402 | 0.3400 | 929 | 0.5445 | 0.5391 | 0.5418 | 3821 | 0.7955 | 0.7954 | 0.7954 | 5302 | 0.4725 | 0.5315 | 0.5003 | 2568 | 0.7750 | 0.7741 | 0.7745 | 6299 | 0.9077 | 0.9259 | 0.9167 | 17115 | 0.9165 | 0.9339 | 0.9252 | 17016 | 0.9098 | 0.9213 | 0.9155 | 14899 | 0.8606 | 0.8861 | 0.8732 | 14479 | 0.7805 | 0.8167 | 0.7982 | 13966 | 0.7704 | 0.7950 | 0.7825 | 15201 | 0.8509 | 0.8750 | 0.8628 | 14804 | 0.8754 | 0.8853 | 0.8803 | 9011 | 0.7043 | 0.7325 | 0.7181 | 15233 | 0.6016 | 0.6364 | 0.6185 | 3474 | 0.9171 | 0.9425 | 0.9296 | 14770 | 0.4277 | 0.2964 | 0.3501 | 2156 | 0.8348 | 0.8539 | 0.8442 | 17347 | 0.4832 | 0.5269 | 0.5041 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6770 | 0.7370 | 0.7057 | 13694 | 0.7586 | 0.7647 | 0.7617 | 3358 | 0.8926 | 0.9375 | 0.9145 | 10425 | 0.8242 | 0.8684 | 0.8457 | 7689 | 0.3697 | 0.3917 | 0.3803 | 14855 | 0.8084 | 0.8468 | 0.8271 | 11808 | 0.4032 | 0.4927 | 0.4435 | 2338 | 0.6847 | 0.7479 | 0.7149 | 9094 | 0.7230 | 0.7801 | 0.7505 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5682 | 0.5708 | 0.5695 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.6910 | 0.7284 | 0.7092 | 12491 | 0.1667 | 0.0370 | 0.0606 | 81 | 0.5161 | 0.5920 | 0.5514 | 8510 | 0.2874 | 0.2747 | 0.2809 | 546 | 0.7316 | 0.7609 | 0.7460 | 0.9297 |
228
+ | 0.0436 | 8.0 | 72224 | 0.3214 | 0.6028 | 0.6325 | 0.6173 | 237046 | 0.8230 | 0.8335 | 0.8282 | 8131 | 0.9559 | 0.9753 | 0.9655 | 50290 | 0.8894 | 0.9289 | 0.9087 | 84619 | 0.7777 | 0.8063 | 0.7917 | 36138 | 0.7507 | 0.3748 | 0.5 | 1374 | 0.3289 | 0.3175 | 0.3231 | 929 | 0.5436 | 0.5444 | 0.5440 | 3821 | 0.7977 | 0.7972 | 0.7975 | 5302 | 0.4791 | 0.5078 | 0.4930 | 2568 | 0.7795 | 0.7792 | 0.7794 | 6299 | 0.9099 | 0.9260 | 0.9179 | 17115 | 0.9203 | 0.9320 | 0.9261 | 17016 | 0.9084 | 0.9204 | 0.9144 | 14899 | 0.8595 | 0.8827 | 0.8710 | 14479 | 0.7821 | 0.8193 | 0.8003 | 13966 | 0.7657 | 0.7917 | 0.7785 | 15201 | 0.8504 | 0.8760 | 0.8630 | 14804 | 0.8759 | 0.8851 | 0.8805 | 9011 | 0.6986 | 0.7240 | 0.7111 | 15233 | 0.6079 | 0.6684 | 0.6367 | 3474 | 0.9190 | 0.9434 | 0.9310 | 14770 | 0.4084 | 0.3214 | 0.3597 | 2156 | 0.8351 | 0.8537 | 0.8443 | 17347 | 0.4710 | 0.5188 | 0.4937 | 14199 | 0.0 | 0.0 | 0.0 | 73 | 0.6779 | 0.7343 | 0.7050 | 13694 | 0.7598 | 0.7686 | 0.7642 | 3358 | 0.8933 | 0.9382 | 0.9152 | 10425 | 0.8234 | 0.8668 | 0.8446 | 7689 | 0.3599 | 0.3987 | 0.3783 | 14855 | 0.8023 | 0.8373 | 0.8194 | 11808 | 0.4169 | 0.4602 | 0.4375 | 2338 | 0.6870 | 0.7394 | 0.7122 | 9094 | 0.7230 | 0.7776 | 0.7493 | 13620 | 0.0 | 0.0 | 0.0 | 106 | 0.5621 | 0.5663 | 0.5642 | 17893 | 0.0 | 0.0 | 0.0 | 56 | 0.7012 | 0.7258 | 0.7133 | 12491 | 0.1818 | 0.0494 | 0.0777 | 81 | 0.5212 | 0.5927 | 0.5547 | 8510 | 0.3103 | 0.3205 | 0.3153 | 546 | 0.7298 | 0.7596 | 0.7444 | 0.9298 |
229
+
230
+
231
+ ### Framework versions
232
+
233
+ - Transformers 4.40.2
234
+ - Pytorch 2.3.1+cu121
235
+ - Datasets 2.20.0
236
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:05044ecf5adde71407ff65c242a3fcfb6cfd8439a0da445e555a692fc4d74186
3
  size 709203944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f85f04c8c2b546b7421b1239aac42e71bcc3541f6b530cf6c945320b13cf9f79
3
  size 709203944