File size: 25,666 Bytes
e75e8ff
b0b9fd5
5c95fb4
e75e8ff
 
 
 
 
 
 
 
 
 
 
 
 
 
b0b9fd5
 
425f466
b0b9fd5
e75e8ff
b0b9fd5
 
 
 
 
e75e8ff
b0b9fd5
 
 
 
 
 
e75e8ff
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5c95fb4
e75e8ff
 
 
 
5c95fb4
 
b0b9fd5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e75e8ff
 
 
 
 
155f78e
e75e8ff
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
---

license: apache-2.0
base_model: microsoft/conditional-detr-resnet-50
tags:
- generated_from_trainer
model-index:
- name: queue_detection
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# queue_detection



This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the None dataset.

It achieves the following results on the evaluation set:

- Loss: 0.1338

- Map: 0.953

- Map 50: 0.99

- Map 75: 0.9837

- Map Small: -1.0

- Map Medium: 0.2906

- Map Large: 0.9593

- Mar 1: 0.5028

- Mar 10: 0.9718

- Mar 100: 0.9723

- Mar Small: -1.0

- Mar Medium: 0.3308

- Mar Large: 0.9753

- Map Cashier: 0.9579

- Mar 100 Cashier: 0.9778

- Map Cx: 0.9481

- Mar 100 Cx: 0.9668



## Model description



More information needed



## Intended uses & limitations



More information needed



## Training and evaluation data



More information needed



## Training procedure



### Training hyperparameters



The following hyperparameters were used during training:

- learning_rate: 5e-05
- train_batch_size: 2
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- num_epochs: 100

- mixed_precision_training: Native AMP



### Training results



| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Cashier | Mar 100 Cashier | Map Cx | Mar 100 Cx |

|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-----------:|:---------------:|:------:|:----------:|

| No log        | 1.0   | 218   | 1.3222          | 0.2232 | 0.3751 | 0.2428 | -1.0      | 0.0        | 0.2245    | 0.2421 | 0.5567 | 0.7376  | -1.0      | 0.0        | 0.7425    | 0.2738      | 0.8178          | 0.1727 | 0.6574     |

| No log        | 2.0   | 436   | 0.9137          | 0.5996 | 0.8561 | 0.7026 | -1.0      | 0.0459     | 0.6043    | 0.356  | 0.7397 | 0.7888  | -1.0      | 0.05       | 0.7954    | 0.7021      | 0.833           | 0.4971 | 0.7447     |

| 2.8394        | 3.0   | 654   | 0.7633          | 0.6569 | 0.9114 | 0.7731 | -1.0      | 0.0345     | 0.6618    | 0.3787 | 0.741  | 0.7789  | -1.0      | 0.095      | 0.7833    | 0.7291      | 0.8184          | 0.5847 | 0.7395     |

| 2.8394        | 4.0   | 872   | 0.6643          | 0.6979 | 0.9409 | 0.8311 | -1.0      | 0.0269     | 0.703     | 0.3904 | 0.7711 | 0.7802  | -1.0      | 0.1231     | 0.7846    | 0.7663      | 0.8213          | 0.6296 | 0.7391     |

| 0.7548        | 5.0   | 1090  | 0.5994          | 0.7344 | 0.9543 | 0.8734 | -1.0      | 0.0539     | 0.7388    | 0.4059 | 0.8025 | 0.8117  | -1.0      | 0.0955     | 0.8161    | 0.7813      | 0.8509          | 0.6875 | 0.7725     |

| 0.7548        | 6.0   | 1308  | 0.5173          | 0.7707 | 0.9681 | 0.8979 | 0.0       | 0.0549     | 0.7763    | 0.4213 | 0.8226 | 0.8283  | 0.0       | 0.1154     | 0.8338    | 0.8118      | 0.8596          | 0.7297 | 0.797      |

| 0.6085        | 7.0   | 1526  | 0.5579          | 0.7471 | 0.9731 | 0.8741 | -1.0      | 0.0605     | 0.7516    | 0.4125 | 0.8035 | 0.8124  | -1.0      | 0.2        | 0.816     | 0.7947      | 0.8523          | 0.6995 | 0.7726     |

| 0.6085        | 8.0   | 1744  | 0.5245          | 0.7509 | 0.9751 | 0.9061 | -1.0      | 0.0791     | 0.7561    | 0.4131 | 0.7994 | 0.8042  | -1.0      | 0.1393     | 0.809     | 0.7765      | 0.8215          | 0.7254 | 0.7868     |

| 0.6085        | 9.0   | 1962  | 0.5536          | 0.7425 | 0.9686 | 0.9093 | -1.0      | 0.0565     | 0.7474    | 0.4162 | 0.7968 | 0.8004  | -1.0      | 0.1654     | 0.8044    | 0.7753      | 0.8306          | 0.7096 | 0.7702     |

| 0.5339        | 10.0  | 2180  | 0.4923          | 0.7603 | 0.9828 | 0.9262 | 0.0       | 0.0702     | 0.7644    | 0.4133 | 0.8054 | 0.8101  | 0.0       | 0.1278     | 0.814     | 0.7844      | 0.8319          | 0.7362 | 0.7884     |

| 0.5339        | 11.0  | 2398  | 0.4439          | 0.7974 | 0.9761 | 0.9421 | 0.0       | 0.0603     | 0.8059    | 0.4355 | 0.8456 | 0.8487  | 0.0       | 0.175      | 0.8567    | 0.8291      | 0.8795          | 0.7657 | 0.8179     |

| 0.4885        | 12.0  | 2616  | 0.4764          | 0.7736 | 0.9808 | 0.928  | 0.0       | 0.1004     | 0.778     | 0.4271 | 0.8172 | 0.8186  | 0.0       | 0.1708     | 0.8229    | 0.7978      | 0.8406          | 0.7494 | 0.7967     |

| 0.4885        | 13.0  | 2834  | 0.4206          | 0.7913 | 0.9858 | 0.9387 | -1.0      | 0.1192     | 0.7947    | 0.434  | 0.8388 | 0.8404  | -1.0      | 0.19       | 0.8436    | 0.8167      | 0.863           | 0.766  | 0.8178     |

| 0.4576        | 14.0  | 3052  | 0.4035          | 0.8124 | 0.9831 | 0.9425 | -1.0      | 0.1166     | 0.8182    | 0.442  | 0.8579 | 0.8606  | -1.0      | 0.1844     | 0.8656    | 0.8501      | 0.8928          | 0.7746 | 0.8283     |

| 0.4576        | 15.0  | 3270  | 0.4372          | 0.7949 | 0.9768 | 0.9347 | 0.0       | 0.063      | 0.8029    | 0.4393 | 0.8415 | 0.8446  | 0.0       | 0.1556     | 0.8517    | 0.8189      | 0.8718          | 0.7709 | 0.8174     |

| 0.4576        | 16.0  | 3488  | 0.3761          | 0.8206 | 0.9874 | 0.95   | -1.0      | 0.3495     | 0.8234    | 0.4501 | 0.863  | 0.8662  | -1.0      | 0.5214     | 0.869     | 0.8395      | 0.8855          | 0.8017 | 0.8469     |

| 0.4348        | 17.0  | 3706  | 0.3401          | 0.842  | 0.9884 | 0.9601 | -1.0      | 0.1317     | 0.8464    | 0.4556 | 0.8822 | 0.8835  | -1.0      | 0.2154     | 0.8874    | 0.8648      | 0.9088          | 0.8191 | 0.8582     |

| 0.4348        | 18.0  | 3924  | 0.3658          | 0.8191 | 0.9876 | 0.9518 | -1.0      | 0.1158     | 0.8214    | 0.4501 | 0.8657 | 0.8665  | -1.0      | 0.2278     | 0.8691    | 0.8467      | 0.8987          | 0.7916 | 0.8342     |

| 0.3957        | 19.0  | 4142  | 0.3534          | 0.828  | 0.9855 | 0.9583 | -1.0      | 0.2679     | 0.8333    | 0.4545 | 0.8676 | 0.8684  | -1.0      | 0.3        | 0.8737    | 0.86        | 0.9004          | 0.796  | 0.8364     |

| 0.3957        | 20.0  | 4360  | 0.3768          | 0.8087 | 0.9885 | 0.9589 | -1.0      | 0.1463     | 0.8123    | 0.4492 | 0.8562 | 0.8572  | -1.0      | 0.1833     | 0.8612    | 0.8292      | 0.8761          | 0.7881 | 0.8383     |

| 0.4105        | 21.0  | 4578  | 0.3539          | 0.8169 | 0.9869 | 0.9616 | -1.0      | 0.0973     | 0.8206    | 0.4481 | 0.8591 | 0.8601  | -1.0      | 0.1864     | 0.8636    | 0.8485      | 0.8944          | 0.7853 | 0.8257     |

| 0.4105        | 22.0  | 4796  | 0.3858          | 0.8221 | 0.9818 | 0.9509 | 0.0       | 0.1213     | 0.8302    | 0.4517 | 0.857  | 0.8588  | 0.0       | 0.2059     | 0.8663    | 0.8501      | 0.8858          | 0.7942 | 0.8318     |

| 0.3693        | 23.0  | 5014  | 0.3562          | 0.8258 | 0.9841 | 0.9571 | -1.0      | 0.1165     | 0.8311    | 0.4536 | 0.8668 | 0.8685  | -1.0      | 0.1679     | 0.8734    | 0.8502      | 0.8924          | 0.8015 | 0.8445     |

| 0.3693        | 24.0  | 5232  | 0.3512          | 0.8306 | 0.9879 | 0.9647 | -1.0      | 0.1015     | 0.8343    | 0.4547 | 0.8698 | 0.8712  | -1.0      | 0.1682     | 0.875     | 0.8766      | 0.9128          | 0.7846 | 0.8295     |

| 0.3693        | 25.0  | 5450  | 0.3211          | 0.8487 | 0.989  | 0.9592 | -1.0      | 0.1232     | 0.8531    | 0.4612 | 0.8821 | 0.883   | -1.0      | 0.2107     | 0.8873    | 0.8753      | 0.9093          | 0.8222 | 0.8567     |

| 0.3558        | 26.0  | 5668  | 0.3124          | 0.8542 | 0.9878 | 0.9718 | 0.0       | 0.2193     | 0.8587    | 0.4643 | 0.8922 | 0.8928  | 0.0       | 0.335      | 0.8958    | 0.8708      | 0.9061          | 0.8376 | 0.8795     |

| 0.3558        | 27.0  | 5886  | 0.3104          | 0.8521 | 0.9875 | 0.962  | -1.0      | 0.1322     | 0.8576    | 0.4635 | 0.8879 | 0.8887  | -1.0      | 0.16       | 0.8943    | 0.8733      | 0.9101          | 0.8308 | 0.8674     |

| 0.3385        | 28.0  | 6104  | 0.3139          | 0.8561 | 0.9878 | 0.9668 | -1.0      | 0.1602     | 0.8592    | 0.4625 | 0.8935 | 0.8953  | -1.0      | 0.2625     | 0.8984    | 0.881       | 0.9182          | 0.8312 | 0.8723     |

| 0.3385        | 29.0  | 6322  | 0.2996          | 0.8552 | 0.9897 | 0.9668 | -1.0      | 0.1056     | 0.8586    | 0.465  | 0.892  | 0.8927  | -1.0      | 0.15       | 0.8967    | 0.8743      | 0.9101          | 0.836  | 0.8752     |

| 0.3399        | 30.0  | 6540  | 0.2752          | 0.8683 | 0.9896 | 0.9736 | -1.0      | 0.2009     | 0.8728    | 0.4686 | 0.9039 | 0.9049  | -1.0      | 0.2654     | 0.9082    | 0.897       | 0.933           | 0.8396 | 0.8768     |

| 0.3399        | 31.0  | 6758  | 0.2941          | 0.8678 | 0.9889 | 0.9673 | 0.0       | 0.0985     | 0.873     | 0.4697 | 0.9019 | 0.9024  | 0.0       | 0.1538     | 0.9087    | 0.8924      | 0.9269          | 0.8431 | 0.878      |

| 0.3399        | 32.0  | 6976  | 0.2779          | 0.8662 | 0.9895 | 0.9685 | -1.0      | 0.1967     | 0.8707    | 0.4717 | 0.9031 | 0.9038  | -1.0      | 0.2429     | 0.9084    | 0.8858      | 0.9237          | 0.8465 | 0.884      |

| 0.3179        | 33.0  | 7194  | 0.2781          | 0.8705 | 0.9889 | 0.9705 | -1.0      | 0.1986     | 0.8745    | 0.4703 | 0.9078 | 0.9084  | -1.0      | 0.2364     | 0.9117    | 0.9023      | 0.9371          | 0.8387 | 0.8798     |

| 0.3179        | 34.0  | 7412  | 0.2776          | 0.8654 | 0.9896 | 0.9743 | -1.0      | 0.1549     | 0.8707    | 0.4704 | 0.8996 | 0.9003  | -1.0      | 0.1893     | 0.9051    | 0.8896      | 0.9237          | 0.8411 | 0.8769     |

| 0.3092        | 35.0  | 7630  | 0.2791          | 0.8744 | 0.9849 | 0.9689 | -1.0      | 0.1117     | 0.8806    | 0.4745 | 0.9038 | 0.9055  | -1.0      | 0.1778     | 0.9118    | 0.9079      | 0.9366          | 0.8409 | 0.8744     |

| 0.3092        | 36.0  | 7848  | 0.2734          | 0.8738 | 0.9893 | 0.9731 | -1.0      | 0.1253     | 0.877     | 0.4721 | 0.9105 | 0.9109  | -1.0      | 0.1864     | 0.915     | 0.9031      | 0.9389          | 0.8445 | 0.883      |

| 0.2975        | 37.0  | 8066  | 0.2620          | 0.8742 | 0.9898 | 0.9726 | 0.0       | 0.1405     | 0.8815    | 0.4751 | 0.9093 | 0.91    | 0.0       | 0.2067     | 0.9165    | 0.9101      | 0.9412          | 0.8383 | 0.8787     |

| 0.2975        | 38.0  | 8284  | 0.2394          | 0.8939 | 0.9897 | 0.9805 | -1.0      | 0.1562     | 0.8973    | 0.4813 | 0.9247 | 0.9257  | -1.0      | 0.2389     | 0.9286    | 0.9151      | 0.9444          | 0.8727 | 0.9069     |

| 0.272         | 39.0  | 8502  | 0.2769          | 0.8717 | 0.9895 | 0.9746 | -1.0      | 0.1595     | 0.8757    | 0.4752 | 0.9073 | 0.9082  | -1.0      | 0.2233     | 0.9127    | 0.9047      | 0.938           | 0.8387 | 0.8783     |

| 0.272         | 40.0  | 8720  | 0.2599          | 0.8838 | 0.9896 | 0.9776 | -1.0      | 0.2362     | 0.8888    | 0.4777 | 0.9176 | 0.9185  | -1.0      | 0.2812     | 0.9224    | 0.9114      | 0.9424          | 0.8563 | 0.8947     |

| 0.272         | 41.0  | 8938  | 0.2640          | 0.8689 | 0.9897 | 0.9646 | -1.0      | 0.1327     | 0.8744    | 0.4736 | 0.9056 | 0.9069  | -1.0      | 0.2344     | 0.9114    | 0.9053      | 0.9387          | 0.8326 | 0.875      |

| 0.2833        | 42.0  | 9156  | 0.2505          | 0.8826 | 0.9892 | 0.9793 | -1.0      | 0.3463     | 0.8866    | 0.476  | 0.9158 | 0.9161  | -1.0      | 0.3692     | 0.9205    | 0.9119      | 0.9423          | 0.8533 | 0.8899     |

| 0.2833        | 43.0  | 9374  | 0.2635          | 0.8773 | 0.9899 | 0.9821 | -1.0      | 0.223      | 0.8813    | 0.4725 | 0.9141 | 0.9143  | -1.0      | 0.2423     | 0.9182    | 0.8973      | 0.9315          | 0.8573 | 0.8972     |

| 0.2794        | 44.0  | 9592  | 0.2520          | 0.8818 | 0.9896 | 0.9778 | -1.0      | 0.1684     | 0.8858    | 0.4759 | 0.9146 | 0.915   | -1.0      | 0.1909     | 0.9191    | 0.8916      | 0.9277          | 0.872  | 0.9024     |

| 0.2794        | 45.0  | 9810  | 0.2459          | 0.8946 | 0.9896 | 0.9701 | 0.0       | 0.2655     | 0.8998    | 0.4815 | 0.9261 | 0.9272  | 0.0       | 0.3042     | 0.9323    | 0.9109      | 0.9423          | 0.8783 | 0.912      |

| 0.2582        | 46.0  | 10028 | 0.2549          | 0.8825 | 0.9891 | 0.9696 | 0.0       | 0.1167     | 0.8877    | 0.4809 | 0.9161 | 0.917   | 0.0       | 0.2115     | 0.9219    | 0.908       | 0.9428          | 0.8569 | 0.8912     |

| 0.2582        | 47.0  | 10246 | 0.2286          | 0.8959 | 0.9894 | 0.9773 | 0.0       | 0.1485     | 0.9007    | 0.4825 | 0.9267 | 0.9273  | 0.0       | 0.2292     | 0.9317    | 0.9183      | 0.9504          | 0.8734 | 0.9043     |

| 0.2582        | 48.0  | 10464 | 0.2219          | 0.8995 | 0.9898 | 0.9825 | -1.0      | 0.202      | 0.9046    | 0.4852 | 0.9325 | 0.9335  | -1.0      | 0.2409     | 0.937     | 0.9161      | 0.9484          | 0.8829 | 0.9186     |

| 0.2576        | 49.0  | 10682 | 0.2540          | 0.887  | 0.9898 | 0.9782 | 0.0       | 0.3753     | 0.8914    | 0.4802 | 0.9218 | 0.9221  | 0.0       | 0.4233     | 0.928     | 0.9021      | 0.9372          | 0.8719 | 0.9069     |

| 0.2576        | 50.0  | 10900 | 0.2434          | 0.8973 | 0.9893 | 0.9773 | -1.0      | 0.1759     | 0.9029    | 0.4795 | 0.9274 | 0.9289  | -1.0      | 0.3688     | 0.9339    | 0.9218      | 0.9481          | 0.8728 | 0.9097     |

| 0.2518        | 51.0  | 11118 | 0.2083          | 0.9099 | 0.9899 | 0.9832 | -1.0      | 0.215      | 0.9131    | 0.4894 | 0.9402 | 0.9404  | -1.0      | 0.2611     | 0.9432    | 0.9307      | 0.959           | 0.889  | 0.9218     |

| 0.2518        | 52.0  | 11336 | 0.2362          | 0.8965 | 0.9899 | 0.9742 | -1.0      | 0.2292     | 0.902     | 0.4834 | 0.9291 | 0.9296  | -1.0      | 0.2795     | 0.9352    | 0.9182      | 0.9499          | 0.8748 | 0.9094     |

| 0.2335        | 53.0  | 11554 | 0.2394          | 0.8943 | 0.9897 | 0.975  | -1.0      | 0.1762     | 0.9004    | 0.4831 | 0.9253 | 0.9271  | -1.0      | 0.245      | 0.9328    | 0.9139      | 0.946           | 0.8747 | 0.9082     |

| 0.2335        | 54.0  | 11772 | 0.2122          | 0.9067 | 0.99   | 0.9788 | -1.0      | 0.1806     | 0.9118    | 0.4875 | 0.9361 | 0.9369  | -1.0      | 0.25       | 0.9408    | 0.9247      | 0.9512          | 0.8888 | 0.9225     |

| 0.2335        | 55.0  | 11990 | 0.2102          | 0.9127 | 0.99   | 0.9834 | -1.0      | 0.3312     | 0.9161    | 0.488  | 0.9428 | 0.9429  | -1.0      | 0.3556     | 0.9447    | 0.9273      | 0.9552          | 0.8981 | 0.9305     |

| 0.2337        | 56.0  | 12208 | 0.2021          | 0.9172 | 0.9898 | 0.9792 | 0.0       | 0.1966     | 0.9226    | 0.4939 | 0.9432 | 0.9438  | 0.0       | 0.22       | 0.9488    | 0.9399      | 0.9634          | 0.8944 | 0.9242     |

| 0.2337        | 57.0  | 12426 | 0.2242          | 0.906  | 0.9874 | 0.9812 | -1.0      | 0.1802     | 0.9109    | 0.4889 | 0.9364 | 0.9369  | -1.0      | 0.2        | 0.9416    | 0.9256      | 0.9552          | 0.8864 | 0.9185     |

| 0.2206        | 58.0  | 12644 | 0.2087          | 0.9095 | 0.9899 | 0.9804 | -1.0      | 0.1752     | 0.9139    | 0.4889 | 0.9408 | 0.9412  | -1.0      | 0.2231     | 0.9456    | 0.9318      | 0.9601          | 0.8872 | 0.9223     |

| 0.2206        | 59.0  | 12862 | 0.1855          | 0.9265 | 0.99   | 0.9844 | 0.0       | 0.3123     | 0.9314    | 0.495  | 0.9517 | 0.9523  | 0.0       | 0.34       | 0.9557    | 0.9451      | 0.9665          | 0.9079 | 0.9382     |

| 0.2115        | 60.0  | 13080 | 0.1884          | 0.9239 | 0.99   | 0.9846 | -1.0      | 0.2547     | 0.9266    | 0.4937 | 0.9497 | 0.9498  | -1.0      | 0.275      | 0.9527    | 0.947       | 0.9689          | 0.9007 | 0.9307     |

| 0.2115        | 61.0  | 13298 | 0.1886          | 0.9205 | 0.99   | 0.9785 | -1.0      | 0.2443     | 0.9251    | 0.4943 | 0.9464 | 0.9467  | -1.0      | 0.2833     | 0.9506    | 0.9429      | 0.9672          | 0.8981 | 0.9263     |

| 0.2117        | 62.0  | 13516 | 0.1859          | 0.9249 | 0.99   | 0.9845 | 0.0       | 0.24       | 0.9288    | 0.4921 | 0.9503 | 0.9506  | 0.0       | 0.2458     | 0.9556    | 0.9418      | 0.9661          | 0.908  | 0.9352     |

| 0.2117        | 63.0  | 13734 | 0.1865          | 0.921  | 0.9901 | 0.9843 | -1.0      | 0.2654     | 0.9259    | 0.4938 | 0.9495 | 0.9499  | -1.0      | 0.28       | 0.9528    | 0.937       | 0.9654          | 0.9049 | 0.9344     |

| 0.2117        | 64.0  | 13952 | 0.1845          | 0.9269 | 0.9899 | 0.9841 | 0.0       | 0.2197     | 0.9319    | 0.496  | 0.9528 | 0.9534  | 0.0       | 0.2292     | 0.9586    | 0.9443      | 0.9682          | 0.9095 | 0.9385     |

| 0.2046        | 65.0  | 14170 | 0.1685          | 0.9329 | 0.9901 | 0.9891 | -1.0      | 0.2906     | 0.9365    | 0.4977 | 0.9581 | 0.9586  | -1.0      | 0.3273     | 0.9612    | 0.9448      | 0.9684          | 0.9211 | 0.9489     |

| 0.2046        | 66.0  | 14388 | 0.1730          | 0.9347 | 0.9899 | 0.9839 | 0.0       | 0.3175     | 0.9395    | 0.4985 | 0.9589 | 0.9592  | 0.0       | 0.3944     | 0.9633    | 0.9491      | 0.9722          | 0.9203 | 0.9462     |

| 0.1976        | 67.0  | 14606 | 0.1815          | 0.9277 | 0.9898 | 0.9799 | 0.0       | 0.2651     | 0.9338    | 0.4951 | 0.9529 | 0.9535  | 0.0       | 0.2846     | 0.9582    | 0.9459      | 0.9706          | 0.9094 | 0.9365     |

| 0.1976        | 68.0  | 14824 | 0.1803          | 0.9273 | 0.9899 | 0.984  | 0.0       | 0.2124     | 0.9326    | 0.4947 | 0.9525 | 0.9536  | 0.0       | 0.3133     | 0.9577    | 0.9413      | 0.9658          | 0.9133 | 0.9414     |

| 0.192         | 69.0  | 15042 | 0.1601          | 0.9422 | 0.99   | 0.9891 | -1.0      | 0.2813     | 0.9477    | 0.4994 | 0.9648 | 0.965   | -1.0      | 0.3071     | 0.9685    | 0.955       | 0.975           | 0.9295 | 0.9549     |

| 0.192         | 70.0  | 15260 | 0.1598          | 0.9376 | 0.9899 | 0.9846 | -1.0      | 0.2597     | 0.9413    | 0.4985 | 0.9595 | 0.9603  | -1.0      | 0.325      | 0.9635    | 0.9458      | 0.9689          | 0.9294 | 0.9517     |

| 0.192         | 71.0  | 15478 | 0.1535          | 0.9456 | 0.99   | 0.9844 | -1.0      | 0.2089     | 0.9525    | 0.502  | 0.9662 | 0.9666  | -1.0      | 0.2857     | 0.9712    | 0.9559      | 0.9758          | 0.9352 | 0.9575     |

| 0.1765        | 72.0  | 15696 | 0.1554          | 0.9462 | 0.99   | 0.9844 | -1.0      | 0.2743     | 0.9477    | 0.5001 | 0.9662 | 0.9665  | -1.0      | 0.3038     | 0.9699    | 0.9603      | 0.9776          | 0.9321 | 0.9553     |

| 0.1765        | 73.0  | 15914 | 0.1483          | 0.9427 | 0.9901 | 0.979  | 0.0       | 0.2381     | 0.9485    | 0.5013 | 0.9635 | 0.964   | 0.0       | 0.2833     | 0.9688    | 0.956       | 0.9739          | 0.9294 | 0.9541     |

| 0.1842        | 74.0  | 16132 | 0.1422          | 0.9472 | 0.995  | 0.9843 | -1.0      | 0.5574     | 0.9488    | 0.5018 | 0.967  | 0.967   | -1.0      | 0.6636     | 0.969     | 0.9626      | 0.9775          | 0.9318 | 0.9566     |

| 0.1842        | 75.0  | 16350 | 0.1664          | 0.9386 | 0.9901 | 0.9842 | -1.0      | 0.2193     | 0.9416    | 0.5005 | 0.9607 | 0.9616  | -1.0      | 0.3611     | 0.9644    | 0.9532      | 0.9726          | 0.924  | 0.9506     |

| 0.1734        | 76.0  | 16568 | 0.1566          | 0.9443 | 0.9898 | 0.9845 | -1.0      | 0.1834     | 0.9508    | 0.5021 | 0.9631 | 0.9639  | -1.0      | 0.2618     | 0.969     | 0.953       | 0.9715          | 0.9356 | 0.9562     |

| 0.1734        | 77.0  | 16786 | 0.1365          | 0.9528 | 0.9899 | 0.9846 | -1.0      | 0.2278     | 0.96      | 0.5047 | 0.971  | 0.9721  | -1.0      | 0.3147     | 0.9762    | 0.9637      | 0.9814          | 0.942  | 0.9629     |

| 0.1731        | 78.0  | 17004 | 0.1582          | 0.95   | 0.9898 | 0.9895 | 0.0       | 0.3414     | 0.9519    | 0.5044 | 0.969  | 0.9694  | 0.0       | 0.3667     | 0.9719    | 0.9601      | 0.9774          | 0.9399 | 0.9614     |

| 0.1731        | 79.0  | 17222 | 0.1559          | 0.9408 | 0.9949 | 0.9849 | -1.0      | 0.5289     | 0.9433    | 0.5014 | 0.9615 | 0.9618  | -1.0      | 0.6        | 0.9652    | 0.9519      | 0.9724          | 0.9296 | 0.9512     |

| 0.1731        | 80.0  | 17440 | 0.1496          | 0.9505 | 0.9898 | 0.9821 | -1.0      | 0.1917     | 0.9566    | 0.5041 | 0.9671 | 0.9683  | -1.0      | 0.2643     | 0.9726    | 0.9593      | 0.9777          | 0.9416 | 0.959      |

| 0.1628        | 81.0  | 17658 | 0.1373          | 0.9579 | 0.99   | 0.9871 | -1.0      | 0.2929     | 0.9598    | 0.5059 | 0.9731 | 0.9735  | -1.0      | 0.3958     | 0.9766    | 0.965       | 0.9791          | 0.9507 | 0.9678     |

| 0.1628        | 82.0  | 17876 | 0.1420          | 0.9512 | 0.99   | 0.9845 | -1.0      | 0.2549     | 0.9577    | 0.5049 | 0.9704 | 0.9711  | -1.0      | 0.3107     | 0.9746    | 0.9603      | 0.9793          | 0.9421 | 0.9629     |

| 0.1586        | 83.0  | 18094 | 0.1373          | 0.9557 | 0.99   | 0.9848 | -1.0      | 0.2539     | 0.959     | 0.5053 | 0.9727 | 0.9729  | -1.0      | 0.2875     | 0.9764    | 0.9629      | 0.9795          | 0.9485 | 0.9664     |

| 0.1586        | 84.0  | 18312 | 0.1291          | 0.957  | 0.9897 | 0.9842 | 0.0       | 0.2644     | 0.9632    | 0.5051 | 0.9743 | 0.9744  | 0.0       | 0.3036     | 0.9787    | 0.9643      | 0.9806          | 0.9498 | 0.9682     |

| 0.1482        | 85.0  | 18530 | 0.1488          | 0.9487 | 0.99   | 0.9843 | -1.0      | 0.2384     | 0.9529    | 0.5025 | 0.9662 | 0.967   | -1.0      | 0.2846     | 0.9707    | 0.9572      | 0.9747          | 0.9402 | 0.9592     |

| 0.1482        | 86.0  | 18748 | 0.1219          | 0.9524 | 0.99   | 0.9847 | -1.0      | 0.3259     | 0.9574    | 0.505  | 0.9721 | 0.9729  | -1.0      | 0.3682     | 0.9751    | 0.9616      | 0.9807          | 0.9433 | 0.9651     |

| 0.1482        | 87.0  | 18966 | 0.1250          | 0.9581 | 0.9899 | 0.9895 | 0.0       | 0.4347     | 0.9631    | 0.5056 | 0.9736 | 0.9744  | 0.0       | 0.4883     | 0.9789    | 0.9646      | 0.9802          | 0.9516 | 0.9685     |

| 0.1582        | 88.0  | 19184 | 0.1324          | 0.9539 | 0.99   | 0.9898 | 0.0       | 0.2573     | 0.9593    | 0.5061 | 0.9717 | 0.9722  | 0.0       | 0.2962     | 0.9764    | 0.9605      | 0.9789          | 0.9472 | 0.9656     |

| 0.1582        | 89.0  | 19402 | 0.1286          | 0.9532 | 0.99   | 0.9846 | -1.0      | 0.2523     | 0.958     | 0.504  | 0.9715 | 0.972   | -1.0      | 0.3333     | 0.9748    | 0.9603      | 0.9785          | 0.9462 | 0.9656     |

| 0.1484        | 90.0  | 19620 | 0.1252          | 0.9574 | 0.9901 | 0.989  | -1.0      | 0.5121     | 0.9588    | 0.5073 | 0.9764 | 0.9765  | -1.0      | 0.5312     | 0.9784    | 0.9623      | 0.9809          | 0.9526 | 0.9721     |

| 0.1484        | 91.0  | 19838 | 0.1378          | 0.9503 | 0.9901 | 0.9836 | 0.0       | 0.4968     | 0.952     | 0.5028 | 0.9705 | 0.9708  | 0.0       | 0.52       | 0.9737    | 0.9584      | 0.9778          | 0.9422 | 0.9639     |

| 0.1462        | 92.0  | 20056 | 0.1259          | 0.9563 | 0.99   | 0.9836 | -1.0      | 0.3464     | 0.9599    | 0.5064 | 0.9746 | 0.975   | -1.0      | 0.3833     | 0.9771    | 0.9609      | 0.9794          | 0.9518 | 0.9706     |

| 0.1462        | 93.0  | 20274 | 0.1306          | 0.9574 | 0.99   | 0.9844 | -1.0      | 0.2994     | 0.9596    | 0.5055 | 0.9737 | 0.9738  | -1.0      | 0.35       | 0.9762    | 0.9651      | 0.9815          | 0.9498 | 0.966      |

| 0.1462        | 94.0  | 20492 | 0.1343          | 0.9588 | 0.99   | 0.9844 | -1.0      | 0.314      | 0.9626    | 0.504  | 0.9747 | 0.9755  | -1.0      | 0.3583     | 0.9779    | 0.962       | 0.9802          | 0.9555 | 0.9707     |

| 0.1472        | 95.0  | 20710 | 0.1236          | 0.9544 | 0.99   | 0.9846 | 0.0       | 0.2797     | 0.961     | 0.5054 | 0.9741 | 0.9744  | 0.0       | 0.3083     | 0.9781    | 0.9622      | 0.981           | 0.9466 | 0.9677     |

| 0.1472        | 96.0  | 20928 | 0.1262          | 0.9622 | 0.99   | 0.9892 | 0.0       | 0.2968     | 0.9654    | 0.5076 | 0.9764 | 0.9766  | 0.0       | 0.3591     | 0.9795    | 0.9688      | 0.9836          | 0.9556 | 0.9695     |

| 0.1539        | 97.0  | 21146 | 0.1328          | 0.9529 | 0.99   | 0.9848 | -1.0      | 0.2533     | 0.9575    | 0.5038 | 0.9716 | 0.9717  | -1.0      | 0.3107     | 0.9753    | 0.9618      | 0.9795          | 0.9441 | 0.9639     |

| 0.1539        | 98.0  | 21364 | 0.1439          | 0.9494 | 0.9894 | 0.979  | 0.0       | 0.4037     | 0.955     | 0.5036 | 0.9678 | 0.9686  | 0.0       | 0.4958     | 0.972     | 0.9588      | 0.9785          | 0.9399 | 0.9588     |

| 0.1484        | 99.0  | 21582 | 0.1244          | 0.96   | 0.9899 | 0.9841 | -1.0      | 0.285      | 0.9628    | 0.5072 | 0.9762 | 0.9764  | -1.0      | 0.3333     | 0.9799    | 0.9689      | 0.9826          | 0.9511 | 0.9703     |

| 0.1484        | 100.0 | 21800 | 0.1338          | 0.953  | 0.99   | 0.9837 | -1.0      | 0.2906     | 0.9593    | 0.5028 | 0.9718 | 0.9723  | -1.0      | 0.3308     | 0.9753    | 0.9579      | 0.9778          | 0.9481 | 0.9668     |





### Framework versions



- Transformers 4.42.3

- Pytorch 2.3.1+cu121

- Datasets 2.20.0

- Tokenizers 0.19.1