File size: 36,791 Bytes
b4b65d1
 
 
 
 
cae4b52
 
b4b65d1
 
 
 
 
 
 
 
 
 
 
cae4b52
b4b65d1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# detr-finetuned-cppe-5-10k-steps

This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2399
- Map: 0.296
- Map 50: 0.5758
- Map 75: 0.258
- Map Small: 0.0949
- Map Medium: 0.2452
- Map Large: 0.4635
- Mar 1: 0.2979
- Mar 10: 0.4713
- Mar 100: 0.4813
- Mar Small: 0.2026
- Mar Medium: 0.4228
- Mar Large: 0.6701
- Map Coverall: 0.5371
- Mar 100 Coverall: 0.6878
- Map Face Shield: 0.2634
- Mar 100 Face Shield: 0.4785
- Map Gloves: 0.2261
- Mar 100 Gloves: 0.4201
- Map Goggles: 0.1544
- Mar 100 Goggles: 0.3954
- Map Mask: 0.299
- Mar 100 Mask: 0.4249

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 3.1413        | 1.0   | 107   | 2.5672          | 0.0222 | 0.0515 | 0.0183 | 0.0012    | 0.0167     | 0.0238    | 0.0482 | 0.112  | 0.1464  | 0.0328    | 0.1046     | 0.1847    | 0.1017       | 0.4509           | 0.0             | 0.0                 | 0.0037     | 0.1125         | 0.0         | 0.0             | 0.0058   | 0.1684       |
| 2.1763        | 2.0   | 214   | 2.3691          | 0.0418 | 0.0978 | 0.03   | 0.0093    | 0.0232     | 0.0481    | 0.0632 | 0.14   | 0.1706  | 0.0603    | 0.1211     | 0.2081    | 0.1796       | 0.5027           | 0.0             | 0.0                 | 0.0065     | 0.1835         | 0.0         | 0.0             | 0.0228   | 0.1667       |
| 2.033         | 3.0   | 321   | 2.1971          | 0.051  | 0.1174 | 0.0452 | 0.0081    | 0.0458     | 0.0551    | 0.07   | 0.1497 | 0.1775  | 0.0554    | 0.1426     | 0.2071    | 0.2186       | 0.4986           | 0.0             | 0.0                 | 0.012      | 0.2089         | 0.0         | 0.0             | 0.0241   | 0.18         |
| 1.9673        | 4.0   | 428   | 2.2385          | 0.0525 | 0.1271 | 0.0364 | 0.0103    | 0.0458     | 0.0576    | 0.0808 | 0.1604 | 0.1836  | 0.0529    | 0.1426     | 0.2078    | 0.1835       | 0.5311           | 0.0013          | 0.0139              | 0.023      | 0.1839         | 0.0         | 0.0             | 0.0547   | 0.1889       |
| 1.8638        | 5.0   | 535   | 2.1170          | 0.0726 | 0.1604 | 0.0617 | 0.0172    | 0.0471     | 0.0866    | 0.0858 | 0.1729 | 0.1906  | 0.0584    | 0.1324     | 0.238     | 0.2801       | 0.5338           | 0.0077          | 0.0506              | 0.0272     | 0.1795         | 0.0         | 0.0             | 0.0478   | 0.1889       |
| 1.7537        | 6.0   | 642   | 1.8691          | 0.0996 | 0.2181 | 0.082  | 0.0343    | 0.0784     | 0.1225    | 0.1125 | 0.2125 | 0.2296  | 0.0823    | 0.1789     | 0.2897    | 0.3412       | 0.5608           | 0.0062          | 0.0848              | 0.0431     | 0.2576         | 0.0         | 0.0             | 0.1076   | 0.2449       |
| 1.8525        | 7.0   | 749   | 1.9352          | 0.0883 | 0.1972 | 0.0729 | 0.0162    | 0.0604     | 0.1131    | 0.0985 | 0.1901 | 0.2068  | 0.0537    | 0.1505     | 0.277     | 0.321        | 0.5514           | 0.004           | 0.0595              | 0.0186     | 0.1683         | 0.0         | 0.0             | 0.0981   | 0.2547       |
| 1.7128        | 8.0   | 856   | 2.0212          | 0.0902 | 0.2058 | 0.0703 | 0.026     | 0.0967     | 0.1188    | 0.1292 | 0.2362 | 0.2487  | 0.0897    | 0.2289     | 0.3068    | 0.2383       | 0.4662           | 0.0293          | 0.2051              | 0.0422     | 0.1955         | 0.01        | 0.0723          | 0.1312   | 0.3044       |
| 1.6811        | 9.0   | 963   | 1.8181          | 0.1123 | 0.2626 | 0.0793 | 0.0414    | 0.1039     | 0.1486    | 0.1474 | 0.2796 | 0.3016  | 0.1084    | 0.2635     | 0.3804    | 0.3228       | 0.5851           | 0.0444          | 0.243               | 0.0537     | 0.2612         | 0.0055      | 0.1262          | 0.1354   | 0.2924       |
| 1.5809        | 10.0  | 1070  | 1.8683          | 0.1227 | 0.2838 | 0.0904 | 0.0536    | 0.106      | 0.1514    | 0.1464 | 0.2618 | 0.2856  | 0.1016    | 0.2436     | 0.3584    | 0.3417       | 0.5712           | 0.0665          | 0.2557              | 0.0441     | 0.2478         | 0.0089      | 0.0585          | 0.1525   | 0.2951       |
| 1.5978        | 11.0  | 1177  | 1.7746          | 0.1169 | 0.2736 | 0.0897 | 0.0278    | 0.0922     | 0.1677    | 0.143  | 0.2665 | 0.2851  | 0.0903    | 0.2138     | 0.4063    | 0.3609       | 0.5932           | 0.0394          | 0.2051              | 0.0447     | 0.2241         | 0.0116      | 0.1431          | 0.1279   | 0.26         |
| 1.5157        | 12.0  | 1284  | 1.7348          | 0.1261 | 0.2961 | 0.0899 | 0.0398    | 0.0923     | 0.1887    | 0.1445 | 0.2861 | 0.3027  | 0.1129    | 0.2438     | 0.4051    | 0.3806       | 0.555            | 0.0643          | 0.3                 | 0.044      | 0.2545         | 0.0052      | 0.1323          | 0.1363   | 0.272        |
| 1.4842        | 13.0  | 1391  | 1.6683          | 0.1459 | 0.3258 | 0.1245 | 0.0497    | 0.1165     | 0.2135    | 0.1808 | 0.333  | 0.3509  | 0.1028    | 0.2823     | 0.4944    | 0.4019       | 0.6036           | 0.0706          | 0.2987              | 0.0556     | 0.271          | 0.0121      | 0.2462          | 0.1894   | 0.3351       |
| 1.4971        | 14.0  | 1498  | 1.8224          | 0.1376 | 0.3065 | 0.1079 | 0.0544    | 0.102      | 0.201     | 0.1601 | 0.2728 | 0.2865  | 0.1007    | 0.2205     | 0.4186    | 0.3695       | 0.5486           | 0.0501          | 0.2076              | 0.0497     | 0.2125         | 0.0215      | 0.1523          | 0.1971   | 0.3116       |
| 1.4884        | 15.0  | 1605  | 1.6449          | 0.1567 | 0.3398 | 0.1244 | 0.0575    | 0.1118     | 0.2375    | 0.1708 | 0.3298 | 0.3492  | 0.1181    | 0.2709     | 0.5033    | 0.4296       | 0.6149           | 0.0709          | 0.3165              | 0.0662     | 0.2884         | 0.0101      | 0.1846          | 0.2068   | 0.3418       |
| 1.4714        | 16.0  | 1712  | 1.6947          | 0.1451 | 0.3108 | 0.1146 | 0.0384    | 0.1007     | 0.2271    | 0.1673 | 0.3191 | 0.3475  | 0.1298    | 0.2767     | 0.5012    | 0.4384       | 0.6541           | 0.063           | 0.3089              | 0.0542     | 0.2799         | 0.0067      | 0.2062          | 0.1631   | 0.2884       |
| 1.4282        | 17.0  | 1819  | 1.6426          | 0.1489 | 0.3459 | 0.1074 | 0.0545    | 0.1174     | 0.2215    | 0.176  | 0.3311 | 0.3488  | 0.1237    | 0.2875     | 0.4835    | 0.3759       | 0.5806           | 0.082           | 0.2608              | 0.0737     | 0.3246         | 0.0206      | 0.2538          | 0.1923   | 0.324        |
| 1.401         | 18.0  | 1926  | 1.6453          | 0.1623 | 0.3508 | 0.1355 | 0.0404    | 0.1236     | 0.2432    | 0.1947 | 0.3464 | 0.3572  | 0.1363    | 0.286      | 0.5063    | 0.4247       | 0.6194           | 0.0808          | 0.3101              | 0.0892     | 0.2902         | 0.0189      | 0.2523          | 0.198    | 0.3142       |
| 1.3853        | 19.0  | 2033  | 1.6557          | 0.1625 | 0.364  | 0.1221 | 0.0429    | 0.1351     | 0.2452    | 0.1883 | 0.3572 | 0.3791  | 0.1265    | 0.3225     | 0.5293    | 0.3997       | 0.6027           | 0.0739          | 0.338               | 0.1018     | 0.3281         | 0.0223      | 0.2723          | 0.2149   | 0.3542       |
| 1.3623        | 20.0  | 2140  | 1.5289          | 0.1714 | 0.3623 | 0.1442 | 0.0628    | 0.1307     | 0.255     | 0.1846 | 0.3604 | 0.3811  | 0.1259    | 0.3197     | 0.5249    | 0.4419       | 0.6631           | 0.0922          | 0.3709              | 0.0966     | 0.3161         | 0.0104      | 0.2077          | 0.2158   | 0.3476       |
| 1.3285        | 21.0  | 2247  | 1.5132          | 0.1702 | 0.3673 | 0.1336 | 0.0684    | 0.1297     | 0.2644    | 0.1868 | 0.366  | 0.3789  | 0.1566    | 0.3097     | 0.5341    | 0.4426       | 0.6509           | 0.0996          | 0.3899              | 0.0908     | 0.2906         | 0.0151      | 0.2385          | 0.203    | 0.3244       |
| 1.3149        | 22.0  | 2354  | 1.4973          | 0.1811 | 0.3975 | 0.1431 | 0.0654    | 0.148      | 0.272     | 0.2062 | 0.3738 | 0.3921  | 0.1473    | 0.3242     | 0.5597    | 0.4239       | 0.6405           | 0.1129          | 0.3557              | 0.1112     | 0.317          | 0.0213      | 0.2923          | 0.236    | 0.3551       |
| 1.3068        | 23.0  | 2461  | 1.4898          | 0.177  | 0.3899 | 0.1367 | 0.0688    | 0.1308     | 0.2934    | 0.1963 | 0.3586 | 0.3792  | 0.1551    | 0.3026     | 0.5689    | 0.4363       | 0.6455           | 0.1079          | 0.3038              | 0.1159     | 0.3192         | 0.0137      | 0.2908          | 0.2111   | 0.3369       |
| 1.2989        | 24.0  | 2568  | 1.5076          | 0.1798 | 0.4009 | 0.14   | 0.0721    | 0.1432     | 0.2728    | 0.1963 | 0.3758 | 0.4003  | 0.1595    | 0.343      | 0.5591    | 0.4407       | 0.6541           | 0.091           | 0.3266              | 0.1228     | 0.3705         | 0.0225      | 0.3046          | 0.2223   | 0.3458       |
| 1.2774        | 25.0  | 2675  | 1.4761          | 0.1836 | 0.3988 | 0.151  | 0.0584    | 0.1545     | 0.2718    | 0.2089 | 0.3823 | 0.4049  | 0.2009    | 0.3468     | 0.5419    | 0.457        | 0.645            | 0.095           | 0.3519              | 0.1143     | 0.354          | 0.0281      | 0.32            | 0.2236   | 0.3533       |
| 1.2854        | 26.0  | 2782  | 1.4837          | 0.183  | 0.3948 | 0.1453 | 0.0562    | 0.143      | 0.2978    | 0.2086 | 0.3706 | 0.39    | 0.1384    | 0.3259     | 0.5593    | 0.4526       | 0.6617           | 0.0929          | 0.3494              | 0.1228     | 0.3607         | 0.0288      | 0.2415          | 0.218    | 0.3369       |
| 1.2664        | 27.0  | 2889  | 1.4817          | 0.1854 | 0.3881 | 0.15   | 0.0674    | 0.1359     | 0.3007    | 0.2194 | 0.3635 | 0.3848  | 0.1468    | 0.3192     | 0.5599    | 0.441        | 0.6351           | 0.1261          | 0.343               | 0.1203     | 0.3603         | 0.0206      | 0.2385          | 0.2189   | 0.3471       |
| 1.2362        | 28.0  | 2996  | 1.5092          | 0.1895 | 0.4105 | 0.1573 | 0.0664    | 0.1529     | 0.2986    | 0.2278 | 0.3784 | 0.3927  | 0.1304    | 0.3329     | 0.5668    | 0.4319       | 0.6315           | 0.1316          | 0.3595              | 0.1424     | 0.3607         | 0.0227      | 0.2677          | 0.219    | 0.344        |
| 1.2433        | 29.0  | 3103  | 1.5012          | 0.173  | 0.3884 | 0.124  | 0.0487    | 0.1368     | 0.2585    | 0.2016 | 0.3509 | 0.3601  | 0.1423    | 0.2913     | 0.4978    | 0.4395       | 0.595            | 0.0937          | 0.3354              | 0.1109     | 0.3054         | 0.0136      | 0.2308          | 0.2073   | 0.3338       |
| 1.221         | 30.0  | 3210  | 1.4452          | 0.1939 | 0.4169 | 0.1656 | 0.0769    | 0.1538     | 0.2959    | 0.2181 | 0.372  | 0.3802  | 0.1333    | 0.3207     | 0.5319    | 0.4588       | 0.6437           | 0.1116          | 0.3582              | 0.1265     | 0.2996         | 0.0285      | 0.2508          | 0.2442   | 0.3489       |
| 1.1826        | 31.0  | 3317  | 1.4250          | 0.2024 | 0.4309 | 0.1642 | 0.0577    | 0.1592     | 0.32      | 0.2186 | 0.3952 | 0.4116  | 0.1439    | 0.3663     | 0.5764    | 0.4798       | 0.6779           | 0.1187          | 0.3696              | 0.1517     | 0.3455         | 0.0314      | 0.3123          | 0.2304   | 0.3524       |
| 1.2067        | 32.0  | 3424  | 1.4167          | 0.1991 | 0.4379 | 0.144  | 0.0729    | 0.1628     | 0.3051    | 0.2248 | 0.3895 | 0.4076  | 0.2067    | 0.3476     | 0.5385    | 0.4682       | 0.6518           | 0.1416          | 0.3595              | 0.1252     | 0.3384         | 0.0301      | 0.3338          | 0.2302   | 0.3547       |
| 1.1873        | 33.0  | 3531  | 1.4461          | 0.1935 | 0.4322 | 0.143  | 0.0748    | 0.1479     | 0.3049    | 0.217  | 0.3865 | 0.4044  | 0.1737    | 0.3478     | 0.5585    | 0.4472       | 0.6315           | 0.0929          | 0.3696              | 0.1704     | 0.3429         | 0.0355      | 0.3585          | 0.2215   | 0.3196       |
| 1.1774        | 34.0  | 3638  | 1.4112          | 0.2036 | 0.4482 | 0.1642 | 0.0695    | 0.1481     | 0.3243    | 0.2318 | 0.3955 | 0.4051  | 0.1743    | 0.3449     | 0.5468    | 0.4832       | 0.6631           | 0.1264          | 0.3975              | 0.1389     | 0.3281         | 0.0363      | 0.3             | 0.2332   | 0.3369       |
| 1.1894        | 35.0  | 3745  | 1.4219          | 0.213  | 0.4398 | 0.1839 | 0.0646    | 0.1641     | 0.3189    | 0.2258 | 0.3885 | 0.4009  | 0.1443    | 0.3434     | 0.567     | 0.4973       | 0.673            | 0.1232          | 0.3291              | 0.153      | 0.3562         | 0.0402      | 0.3046          | 0.2515   | 0.3418       |
| 1.1719        | 36.0  | 3852  | 1.3858          | 0.2075 | 0.43   | 0.1761 | 0.0632    | 0.1567     | 0.3405    | 0.2291 | 0.3966 | 0.4078  | 0.1714    | 0.3427     | 0.5842    | 0.4981       | 0.6883           | 0.1098          | 0.3696              | 0.1647     | 0.3554         | 0.0362      | 0.2785          | 0.2286   | 0.3471       |
| 1.1191        | 37.0  | 3959  | 1.4685          | 0.1947 | 0.413  | 0.1557 | 0.0639    | 0.147      | 0.3064    | 0.2115 | 0.3668 | 0.3791  | 0.1312    | 0.3394     | 0.5027    | 0.4546       | 0.6514           | 0.1321          | 0.3177              | 0.1435     | 0.3491         | 0.0262      | 0.2415          | 0.2174   | 0.3356       |
| 1.1376        | 38.0  | 4066  | 1.3801          | 0.2095 | 0.4365 | 0.1706 | 0.0729    | 0.1621     | 0.3205    | 0.2337 | 0.3964 | 0.4109  | 0.1773    | 0.352      | 0.5531    | 0.4944       | 0.6734           | 0.1034          | 0.3582              | 0.1508     | 0.3679         | 0.0556      | 0.3015          | 0.2435   | 0.3533       |
| 1.1187        | 39.0  | 4173  | 1.3977          | 0.2118 | 0.4348 | 0.1743 | 0.0573    | 0.1632     | 0.3241    | 0.2316 | 0.4068 | 0.4213  | 0.1385    | 0.3542     | 0.6066    | 0.492        | 0.677            | 0.1317          | 0.3987              | 0.1563     | 0.3442         | 0.0329      | 0.3369          | 0.2461   | 0.3498       |
| 1.1005        | 40.0  | 4280  | 1.4000          | 0.2183 | 0.4578 | 0.1804 | 0.0648    | 0.1627     | 0.3479    | 0.234  | 0.4057 | 0.4236  | 0.1818    | 0.356      | 0.5934    | 0.496        | 0.6788           | 0.1287          | 0.3911              | 0.1675     | 0.3683         | 0.0411      | 0.32            | 0.2581   | 0.3596       |
| 1.1131        | 41.0  | 4387  | 1.3965          | 0.2196 | 0.4648 | 0.186  | 0.0615    | 0.1652     | 0.352     | 0.2429 | 0.4085 | 0.4233  | 0.1522    | 0.3668     | 0.5934    | 0.4985       | 0.6743           | 0.1333          | 0.3709              | 0.1737     | 0.3656         | 0.0434      | 0.3431          | 0.2492   | 0.3627       |
| 1.0952        | 42.0  | 4494  | 1.3614          | 0.2211 | 0.4568 | 0.1837 | 0.0791    | 0.1889     | 0.3373    | 0.236  | 0.4192 | 0.4331  | 0.18      | 0.3991     | 0.5683    | 0.5185       | 0.682            | 0.1322          | 0.4114              | 0.1665     | 0.3714         | 0.0418      | 0.3354          | 0.2466   | 0.3653       |
| 1.0869        | 43.0  | 4601  | 1.3947          | 0.214  | 0.4677 | 0.1768 | 0.0648    | 0.1666     | 0.3402    | 0.2263 | 0.4023 | 0.4138  | 0.1509    | 0.3593     | 0.5697    | 0.4982       | 0.6468           | 0.1428          | 0.4291              | 0.1653     | 0.3415         | 0.0417      | 0.3031          | 0.2222   | 0.3484       |
| 1.0787        | 44.0  | 4708  | 1.3556          | 0.2245 | 0.467  | 0.1869 | 0.0561    | 0.1729     | 0.3474    | 0.2474 | 0.4212 | 0.4368  | 0.1737    | 0.3889     | 0.6009    | 0.5125       | 0.6779           | 0.1332          | 0.4177              | 0.1801     | 0.3871         | 0.0402      | 0.32            | 0.2565   | 0.3813       |
| 1.0596        | 45.0  | 4815  | 1.3947          | 0.2369 | 0.4907 | 0.1976 | 0.0707    | 0.1735     | 0.3883    | 0.2502 | 0.4183 | 0.4325  | 0.1603    | 0.3719     | 0.6108    | 0.5126       | 0.6608           | 0.1574          | 0.4228              | 0.188      | 0.3638         | 0.066       | 0.3477          | 0.2602   | 0.3676       |
| 1.0826        | 46.0  | 4922  | 1.4612          | 0.208  | 0.4644 | 0.1612 | 0.0643    | 0.1703     | 0.3207    | 0.2345 | 0.3899 | 0.4046  | 0.1531    | 0.355      | 0.5565    | 0.4677       | 0.6315           | 0.12            | 0.3671              | 0.1762     | 0.3491         | 0.0452      | 0.3308          | 0.2308   | 0.3444       |
| 1.0805        | 47.0  | 5029  | 1.3511          | 0.2227 | 0.4615 | 0.1878 | 0.0642    | 0.1708     | 0.375     | 0.2433 | 0.4212 | 0.437   | 0.1386    | 0.3853     | 0.6146    | 0.5022       | 0.6739           | 0.1304          | 0.4253              | 0.1903     | 0.3821         | 0.0631      | 0.34            | 0.2275   | 0.3636       |
| 1.0771        | 48.0  | 5136  | 1.3661          | 0.2354 | 0.4877 | 0.2058 | 0.0745    | 0.1712     | 0.3831    | 0.2569 | 0.4247 | 0.437   | 0.1426    | 0.375      | 0.6206    | 0.508        | 0.6856           | 0.1561          | 0.4203              | 0.1792     | 0.3737         | 0.067       | 0.3369          | 0.2669   | 0.3684       |
| 1.0628        | 49.0  | 5243  | 1.3718          | 0.2257 | 0.4696 | 0.1882 | 0.0666    | 0.1704     | 0.3716    | 0.2495 | 0.4194 | 0.4389  | 0.1565    | 0.3915     | 0.6076    | 0.517        | 0.6856           | 0.1506          | 0.4468              | 0.1632     | 0.3812         | 0.0448      | 0.3046          | 0.2529   | 0.376        |
| 1.027         | 50.0  | 5350  | 1.3364          | 0.2191 | 0.4542 | 0.1799 | 0.0547    | 0.1651     | 0.3593    | 0.2381 | 0.4246 | 0.4389  | 0.1632    | 0.385      | 0.5987    | 0.522        | 0.6856           | 0.1332          | 0.443               | 0.1737     | 0.3955         | 0.0446      | 0.3138          | 0.2221   | 0.3564       |
| 1.0418        | 51.0  | 5457  | 1.3681          | 0.2369 | 0.4783 | 0.195  | 0.0641    | 0.1763     | 0.3895    | 0.2596 | 0.4307 | 0.4484  | 0.1748    | 0.3867     | 0.626     | 0.5177       | 0.6712           | 0.167           | 0.4278              | 0.1996     | 0.3826         | 0.0542      | 0.3846          | 0.2461   | 0.3756       |
| 1.0249        | 52.0  | 5564  | 1.3403          | 0.2343 | 0.4805 | 0.1894 | 0.0595    | 0.1842     | 0.3862    | 0.2507 | 0.4277 | 0.441   | 0.1404    | 0.3939     | 0.6093    | 0.511        | 0.6599           | 0.1725          | 0.4392              | 0.1738     | 0.354          | 0.0614      | 0.3692          | 0.2526   | 0.3827       |
| 1.0091        | 53.0  | 5671  | 1.3439          | 0.2291 | 0.4832 | 0.1974 | 0.0653    | 0.1841     | 0.3715    | 0.2557 | 0.4301 | 0.445   | 0.1686    | 0.4035     | 0.6129    | 0.5162       | 0.6784           | 0.142           | 0.4278              | 0.1797     | 0.3754         | 0.052       | 0.3477          | 0.2556   | 0.3956       |
| 1.0185        | 54.0  | 5778  | 1.3464          | 0.236  | 0.4899 | 0.1981 | 0.0784    | 0.1762     | 0.3833    | 0.2564 | 0.4278 | 0.4451  | 0.159     | 0.3862     | 0.6195    | 0.5223       | 0.6874           | 0.1754          | 0.4329              | 0.1766     | 0.3812         | 0.0477      | 0.3446          | 0.2577   | 0.3791       |
| 1.002         | 55.0  | 5885  | 1.3273          | 0.2397 | 0.5027 | 0.2123 | 0.0706    | 0.1783     | 0.4007    | 0.262  | 0.4312 | 0.4432  | 0.151     | 0.3825     | 0.6209    | 0.5223       | 0.6865           | 0.1774          | 0.443               | 0.1857     | 0.3741         | 0.0574      | 0.3262          | 0.2555   | 0.3862       |
| 0.9966        | 56.0  | 5992  | 1.3200          | 0.2411 | 0.5005 | 0.1882 | 0.0878    | 0.1812     | 0.4035    | 0.2553 | 0.4318 | 0.4459  | 0.2299    | 0.3699     | 0.6179    | 0.5224       | 0.677            | 0.1827          | 0.4456              | 0.1869     | 0.3884         | 0.0847      | 0.3554          | 0.2289   | 0.3631       |
| 0.9794        | 57.0  | 6099  | 1.3284          | 0.2498 | 0.5009 | 0.2216 | 0.0781    | 0.1934     | 0.4007    | 0.2653 | 0.4302 | 0.443   | 0.1738    | 0.3822     | 0.6232    | 0.5308       | 0.7018           | 0.19            | 0.4228              | 0.1929     | 0.3621         | 0.0746      | 0.3431          | 0.2607   | 0.3853       |
| 1.0153        | 58.0  | 6206  | 1.3197          | 0.2536 | 0.5145 | 0.2171 | 0.078     | 0.2042     | 0.4004    | 0.275  | 0.4442 | 0.4588  | 0.1375    | 0.397      | 0.657     | 0.5125       | 0.6856           | 0.1862          | 0.4506              | 0.1927     | 0.3875         | 0.1011      | 0.3738          | 0.2753   | 0.3964       |
| 0.9602        | 59.0  | 6313  | 1.2911          | 0.2552 | 0.5334 | 0.2117 | 0.0739    | 0.2123     | 0.4031    | 0.2659 | 0.435  | 0.4489  | 0.1789    | 0.4037     | 0.6197    | 0.531        | 0.686            | 0.1922          | 0.4291              | 0.1926     | 0.3705         | 0.099       | 0.3662          | 0.2611   | 0.3924       |
| 0.972         | 60.0  | 6420  | 1.2744          | 0.2603 | 0.5274 | 0.2143 | 0.0811    | 0.2118     | 0.4104    | 0.2669 | 0.4441 | 0.4606  | 0.2039    | 0.4078     | 0.6325    | 0.5301       | 0.6883           | 0.189           | 0.462               | 0.208      | 0.4045         | 0.1011      | 0.3492          | 0.2735   | 0.3991       |
| 0.9554        | 61.0  | 6527  | 1.3204          | 0.26   | 0.5405 | 0.222  | 0.0885    | 0.2028     | 0.4086    | 0.2648 | 0.4356 | 0.4484  | 0.1653    | 0.3894     | 0.6299    | 0.5376       | 0.6919           | 0.1997          | 0.4519              | 0.1799     | 0.3571         | 0.0969      | 0.3508          | 0.2858   | 0.3902       |
| 0.9409        | 62.0  | 6634  | 1.3063          | 0.2531 | 0.5388 | 0.2049 | 0.077     | 0.2004     | 0.4041    | 0.263  | 0.4347 | 0.4482  | 0.1751    | 0.3891     | 0.6224    | 0.5131       | 0.6743           | 0.1969          | 0.4456              | 0.1894     | 0.3732         | 0.0927      | 0.3508          | 0.2735   | 0.3969       |
| 0.9692        | 63.0  | 6741  | 1.3074          | 0.2522 | 0.5361 | 0.2037 | 0.0766    | 0.1991     | 0.4112    | 0.2517 | 0.4435 | 0.4561  | 0.176     | 0.3976     | 0.6311    | 0.5317       | 0.6914           | 0.1913          | 0.4532              | 0.2006     | 0.4            | 0.0854      | 0.3692          | 0.252    | 0.3667       |
| 0.9391        | 64.0  | 6848  | 1.3006          | 0.2571 | 0.5233 | 0.2144 | 0.0743    | 0.2098     | 0.4183    | 0.2613 | 0.4439 | 0.4579  | 0.1965    | 0.4005     | 0.6377    | 0.5309       | 0.6896           | 0.1905          | 0.4506              | 0.1945     | 0.3951         | 0.0973      | 0.3677          | 0.2724   | 0.3867       |
| 0.9332        | 65.0  | 6955  | 1.2621          | 0.2599 | 0.5177 | 0.2177 | 0.0728    | 0.2141     | 0.4172    | 0.2786 | 0.4613 | 0.4748  | 0.2141    | 0.4338     | 0.6329    | 0.5287       | 0.6892           | 0.2085          | 0.4709              | 0.1822     | 0.4085         | 0.1052      | 0.3938          | 0.2747   | 0.4116       |
| 0.9279        | 66.0  | 7062  | 1.2837          | 0.2539 | 0.5219 | 0.2076 | 0.077     | 0.2045     | 0.4055    | 0.2681 | 0.4441 | 0.459   | 0.173     | 0.3982     | 0.6455    | 0.5309       | 0.6937           | 0.1965          | 0.4608              | 0.1829     | 0.3879         | 0.0852      | 0.3569          | 0.2742   | 0.3956       |
| 0.9376        | 67.0  | 7169  | 1.2944          | 0.2589 | 0.5241 | 0.2166 | 0.0773    | 0.2102     | 0.4181    | 0.277  | 0.4434 | 0.4589  | 0.1887    | 0.4041     | 0.6343    | 0.5295       | 0.6793           | 0.2006          | 0.4519              | 0.1909     | 0.4054         | 0.101       | 0.3615          | 0.2726   | 0.3964       |
| 0.9361        | 68.0  | 7276  | 1.3035          | 0.2623 | 0.5402 | 0.2119 | 0.0789    | 0.2189     | 0.4159    | 0.2807 | 0.4494 | 0.4643  | 0.1988    | 0.4179     | 0.6294    | 0.5236       | 0.6734           | 0.1949          | 0.4494              | 0.2046     | 0.4161         | 0.1056      | 0.3769          | 0.2826   | 0.4058       |
| 0.921         | 69.0  | 7383  | 1.2813          | 0.2732 | 0.5391 | 0.2305 | 0.085     | 0.2224     | 0.4243    | 0.2703 | 0.4524 | 0.466   | 0.2096    | 0.4196     | 0.6282    | 0.5322       | 0.6797           | 0.2234          | 0.4633              | 0.209      | 0.4062         | 0.1064      | 0.3692          | 0.295    | 0.4116       |
| 0.9013        | 70.0  | 7490  | 1.3099          | 0.2688 | 0.5346 | 0.223  | 0.0741    | 0.2163     | 0.4203    | 0.2732 | 0.4447 | 0.4579  | 0.1724    | 0.4066     | 0.6318    | 0.5329       | 0.6748           | 0.2094          | 0.4481              | 0.215      | 0.4027         | 0.0994      | 0.3646          | 0.2873   | 0.3996       |
| 0.9154        | 71.0  | 7597  | 1.2681          | 0.2728 | 0.5379 | 0.2291 | 0.0808    | 0.2241     | 0.4265    | 0.2743 | 0.445  | 0.4563  | 0.1687    | 0.4044     | 0.633     | 0.535        | 0.6788           | 0.2228          | 0.4532              | 0.2104     | 0.3911         | 0.11        | 0.3615          | 0.286    | 0.3969       |
| 0.8979        | 72.0  | 7704  | 1.2593          | 0.269  | 0.5354 | 0.2264 | 0.0722    | 0.2152     | 0.4356    | 0.2752 | 0.4583 | 0.4686  | 0.1889    | 0.427      | 0.6399    | 0.5304       | 0.677            | 0.2063          | 0.4544              | 0.1968     | 0.4009         | 0.1263      | 0.4092          | 0.2852   | 0.4013       |
| 0.8901        | 73.0  | 7811  | 1.2819          | 0.2656 | 0.5447 | 0.2306 | 0.0831    | 0.2037     | 0.4385    | 0.2656 | 0.4402 | 0.4524  | 0.1725    | 0.3957     | 0.6449    | 0.5208       | 0.6878           | 0.2185          | 0.4443              | 0.1941     | 0.3942         | 0.1169      | 0.3477          | 0.2775   | 0.388        |
| 0.8943        | 74.0  | 7918  | 1.2786          | 0.268  | 0.5412 | 0.2261 | 0.0806    | 0.2127     | 0.4294    | 0.2696 | 0.4506 | 0.4598  | 0.1709    | 0.4042     | 0.6454    | 0.5438       | 0.6779           | 0.2051          | 0.4722              | 0.192      | 0.3915         | 0.1189      | 0.3631          | 0.2804   | 0.3942       |
| 0.8789        | 75.0  | 8025  | 1.2746          | 0.2772 | 0.5569 | 0.2291 | 0.0829    | 0.226      | 0.4355    | 0.276  | 0.4553 | 0.4666  | 0.1862    | 0.4155     | 0.6381    | 0.5432       | 0.6901           | 0.2387          | 0.4759              | 0.2011     | 0.3884         | 0.1214      | 0.3846          | 0.2817   | 0.3938       |
| 0.877         | 76.0  | 8132  | 1.2574          | 0.2757 | 0.5538 | 0.2251 | 0.0852    | 0.2285     | 0.4347    | 0.2706 | 0.4565 | 0.4684  | 0.1859    | 0.4177     | 0.6485    | 0.5329       | 0.6856           | 0.2301          | 0.4759              | 0.2069     | 0.3978         | 0.1224      | 0.3785          | 0.2865   | 0.4044       |
| 0.8764        | 77.0  | 8239  | 1.2568          | 0.2776 | 0.5465 | 0.2391 | 0.0777    | 0.2323     | 0.4377    | 0.2747 | 0.4574 | 0.4707  | 0.1812    | 0.4223     | 0.646     | 0.5331       | 0.6815           | 0.2196          | 0.4759              | 0.2148     | 0.3996         | 0.1202      | 0.3785          | 0.3001   | 0.4182       |
| 0.878         | 78.0  | 8346  | 1.2859          | 0.2726 | 0.5531 | 0.2368 | 0.0729    | 0.2235     | 0.4329    | 0.2742 | 0.4495 | 0.4608  | 0.1963    | 0.4066     | 0.6355    | 0.5247       | 0.6739           | 0.225           | 0.4557              | 0.2081     | 0.4071         | 0.1183      | 0.3631          | 0.287    | 0.404        |
| 0.8631        | 79.0  | 8453  | 1.2818          | 0.2792 | 0.5567 | 0.2261 | 0.0776    | 0.2267     | 0.4525    | 0.2842 | 0.4602 | 0.4716  | 0.1764    | 0.4229     | 0.6576    | 0.5324       | 0.6784           | 0.2282          | 0.4582              | 0.2063     | 0.4027         | 0.1381      | 0.4123          | 0.2911   | 0.4062       |
| 0.8718        | 80.0  | 8560  | 1.2793          | 0.2888 | 0.5613 | 0.2521 | 0.0779    | 0.2453     | 0.4497    | 0.2854 | 0.464  | 0.4748  | 0.1812    | 0.4356     | 0.6501    | 0.537        | 0.6734           | 0.2581          | 0.4861              | 0.2224     | 0.4125         | 0.1338      | 0.3985          | 0.2926   | 0.4036       |
| 0.8574        | 81.0  | 8667  | 1.2768          | 0.2853 | 0.5614 | 0.2534 | 0.085     | 0.2389     | 0.4454    | 0.2847 | 0.4614 | 0.4718  | 0.1953    | 0.4209     | 0.6534    | 0.5334       | 0.6815           | 0.2342          | 0.4595              | 0.2176     | 0.4165         | 0.15        | 0.3985          | 0.2913   | 0.4031       |
| 0.8564        | 82.0  | 8774  | 1.2782          | 0.2832 | 0.5646 | 0.2411 | 0.0917    | 0.2346     | 0.4385    | 0.284  | 0.4659 | 0.4774  | 0.2162    | 0.4213     | 0.6493    | 0.5293       | 0.6811           | 0.2323          | 0.4709              | 0.2203     | 0.4192         | 0.1401      | 0.4046          | 0.2941   | 0.4111       |
| 0.8492        | 83.0  | 8881  | 1.2697          | 0.2816 | 0.5515 | 0.2545 | 0.0855    | 0.236      | 0.4398    | 0.2908 | 0.4688 | 0.479   | 0.2011    | 0.4241     | 0.6596    | 0.5252       | 0.6793           | 0.2385          | 0.4861              | 0.2054     | 0.4205         | 0.1463      | 0.4046          | 0.2925   | 0.4044       |
| 0.8459        | 84.0  | 8988  | 1.2767          | 0.2863 | 0.5626 | 0.2473 | 0.0857    | 0.2386     | 0.4431    | 0.2897 | 0.4627 | 0.4723  | 0.1854    | 0.4164     | 0.6541    | 0.5434       | 0.6914           | 0.2267          | 0.4696              | 0.2308     | 0.4165         | 0.1434      | 0.3877          | 0.287    | 0.396        |
| 0.8295        | 85.0  | 9095  | 1.2625          | 0.2864 | 0.5699 | 0.2489 | 0.084     | 0.2389     | 0.4477    | 0.2889 | 0.4599 | 0.47    | 0.1786    | 0.4187     | 0.6499    | 0.5455       | 0.6923           | 0.2287          | 0.462               | 0.2252     | 0.421          | 0.1397      | 0.3754          | 0.2929   | 0.3991       |
| 0.8474        | 86.0  | 9202  | 1.2640          | 0.2925 | 0.572  | 0.2551 | 0.0931    | 0.2401     | 0.453     | 0.2922 | 0.4686 | 0.4778  | 0.1842    | 0.4289     | 0.6645    | 0.544        | 0.6914           | 0.2442          | 0.4886              | 0.2219     | 0.4071         | 0.1569      | 0.3969          | 0.2952   | 0.4049       |
| 0.8288        | 87.0  | 9309  | 1.2591          | 0.2863 | 0.563  | 0.2478 | 0.0803    | 0.2381     | 0.4456    | 0.2857 | 0.4635 | 0.4744  | 0.1918    | 0.425      | 0.6502    | 0.5464       | 0.6959           | 0.2381          | 0.4899              | 0.216      | 0.408          | 0.1411      | 0.3769          | 0.2897   | 0.4013       |
| 0.8408        | 88.0  | 9416  | 1.2432          | 0.2919 | 0.5713 | 0.2494 | 0.0926    | 0.2446     | 0.4512    | 0.2944 | 0.4682 | 0.4771  | 0.2127    | 0.4237     | 0.6558    | 0.5439       | 0.6869           | 0.2523          | 0.4823              | 0.2304     | 0.4138         | 0.1399      | 0.3938          | 0.2932   | 0.4084       |
| 0.835         | 89.0  | 9523  | 1.2472          | 0.2885 | 0.5652 | 0.2456 | 0.0925    | 0.241      | 0.4443    | 0.2892 | 0.4662 | 0.4773  | 0.2096    | 0.4296     | 0.6479    | 0.5483       | 0.6986           | 0.2465          | 0.4709              | 0.2226     | 0.4152         | 0.1322      | 0.3908          | 0.2928   | 0.4111       |
| 0.8299        | 90.0  | 9630  | 1.2481          | 0.2898 | 0.5648 | 0.2528 | 0.0972    | 0.239      | 0.4457    | 0.2939 | 0.463  | 0.4703  | 0.1948    | 0.4196     | 0.6457    | 0.5405       | 0.6829           | 0.2402          | 0.4646              | 0.2221     | 0.4022         | 0.1512      | 0.3892          | 0.295    | 0.4124       |
| 0.817         | 91.0  | 9737  | 1.2366          | 0.2924 | 0.576  | 0.2475 | 0.0951    | 0.2384     | 0.4528    | 0.2952 | 0.4674 | 0.4775  | 0.2033    | 0.4255     | 0.6498    | 0.5415       | 0.6914           | 0.2416          | 0.4696              | 0.2272     | 0.4089         | 0.1537      | 0.3985          | 0.2981   | 0.4191       |
| 0.8196        | 92.0  | 9844  | 1.2502          | 0.2943 | 0.5749 | 0.2597 | 0.089     | 0.2433     | 0.4536    | 0.2961 | 0.4633 | 0.4753  | 0.1969    | 0.423      | 0.6582    | 0.5436       | 0.6883           | 0.2408          | 0.4722              | 0.2311     | 0.4138         | 0.1565      | 0.3862          | 0.2993   | 0.416        |
| 0.8184        | 93.0  | 9951  | 1.2399          | 0.2955 | 0.5787 | 0.2571 | 0.0902    | 0.2481     | 0.4588    | 0.294  | 0.4652 | 0.4756  | 0.2001    | 0.4218     | 0.6572    | 0.5405       | 0.6869           | 0.2498          | 0.4722              | 0.2357     | 0.4254         | 0.158       | 0.3815          | 0.2936   | 0.412        |
| 0.8053        | 94.0  | 10058 | 1.2512          | 0.2964 | 0.5754 | 0.2633 | 0.0953    | 0.2468     | 0.4592    | 0.2955 | 0.4662 | 0.4786  | 0.1966    | 0.4229     | 0.6605    | 0.5436       | 0.6937           | 0.2502          | 0.4747              | 0.2288     | 0.4143         | 0.1627      | 0.3969          | 0.2964   | 0.4133       |
| 0.8152        | 95.0  | 10165 | 1.2426          | 0.2965 | 0.5709 | 0.2562 | 0.0884    | 0.2481     | 0.4587    | 0.2989 | 0.4688 | 0.4784  | 0.19      | 0.4268     | 0.6613    | 0.5405       | 0.6883           | 0.2481          | 0.4722              | 0.2282     | 0.4134         | 0.1713      | 0.4046          | 0.2945   | 0.4133       |
| 0.8115        | 96.0  | 10272 | 1.2396          | 0.2958 | 0.5727 | 0.2662 | 0.0912    | 0.2454     | 0.4651    | 0.3015 | 0.4677 | 0.4773  | 0.2023    | 0.421      | 0.6692    | 0.538        | 0.6838           | 0.2547          | 0.4671              | 0.228      | 0.4205         | 0.16        | 0.3954          | 0.2983   | 0.4196       |
| 0.7983        | 97.0  | 10379 | 1.2417          | 0.2936 | 0.5731 | 0.2486 | 0.0893    | 0.2465     | 0.4624    | 0.2996 | 0.4718 | 0.4819  | 0.2028    | 0.4284     | 0.6697    | 0.5382       | 0.6892           | 0.2593          | 0.4772              | 0.2267     | 0.4223         | 0.1469      | 0.4031          | 0.2969   | 0.4178       |
| 0.8217        | 98.0  | 10486 | 1.2373          | 0.2948 | 0.5722 | 0.257  | 0.0894    | 0.2455     | 0.4597    | 0.2974 | 0.4696 | 0.4801  | 0.2037    | 0.4225     | 0.6672    | 0.5365       | 0.6878           | 0.2612          | 0.481               | 0.2291     | 0.4237         | 0.1513      | 0.3892          | 0.2958   | 0.4187       |
| 0.7961        | 99.0  | 10593 | 1.2396          | 0.296  | 0.5758 | 0.2587 | 0.0911    | 0.2463     | 0.4624    | 0.2971 | 0.4705 | 0.4808  | 0.2004    | 0.4241     | 0.6697    | 0.5372       | 0.6883           | 0.2632          | 0.4797              | 0.228      | 0.421          | 0.1539      | 0.3908          | 0.2977   | 0.4244       |
| 0.8025        | 100.0 | 10700 | 1.2399          | 0.296  | 0.5758 | 0.258  | 0.0949    | 0.2452     | 0.4635    | 0.2979 | 0.4713 | 0.4813  | 0.2026    | 0.4228     | 0.6701    | 0.5371       | 0.6878           | 0.2634          | 0.4785              | 0.2261     | 0.4201         | 0.1544      | 0.3954          | 0.299    | 0.4249       |


### Framework versions

- Transformers 4.46.0.dev0
- Pytorch 2.4.1+cu118
- Datasets 3.0.1
- Tokenizers 0.20.1