--- base_model: microsoft/conditional-detr-resnet-50 tags: - generated_from_trainer model-index: - name: queue_detection results: [] --- # queue_detection This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.1272 - Map: 0.9568 - Map 50: 0.99 - Map 75: 0.9848 - Map Small: -1.0 - Map Medium: 0.3143 - Map Large: 0.9595 - Mar 1: 0.5045 - Mar 10: 0.9717 - Mar 100: 0.9726 - Mar Small: -1.0 - Mar Medium: 0.3385 - Mar Large: 0.9755 - Map Cashier: 0.9619 - Mar 100 Cashier: 0.9762 - Map Cx: 0.9517 - Mar 100 Cx: 0.9689 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 2 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: cosine - num_epochs: 100 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Cashier | Mar 100 Cashier | Map Cx | Mar 100 Cx | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-----------:|:---------------:|:------:|:----------:| | No log | 1.0 | 218 | 1.5947 | 0.1037 | 0.2081 | 0.0994 | -1.0 | 0.0 | 0.1045 | 0.1112 | 0.4448 | 0.653 | -1.0 | 0.0 | 0.6572 | 0.1294 | 0.7485 | 0.0781 | 0.5574 | | No log | 2.0 | 436 | 1.0934 | 0.4778 | 0.7426 | 0.5557 | -1.0 | 0.0229 | 0.4814 | 0.3004 | 0.6849 | 0.7512 | -1.0 | 0.0321 | 0.7576 | 0.601 | 0.7972 | 0.3545 | 0.7051 | | 3.1068 | 3.0 | 654 | 0.7608 | 0.6462 | 0.9281 | 0.7527 | -1.0 | 0.0299 | 0.6507 | 0.3721 | 0.7442 | 0.7711 | -1.0 | 0.135 | 0.775 | 0.6921 | 0.7955 | 0.6003 | 0.7467 | | 3.1068 | 4.0 | 872 | 0.6540 | 0.6954 | 0.9464 | 0.8364 | -1.0 | 0.0542 | 0.7002 | 0.388 | 0.775 | 0.7902 | -1.0 | 0.0692 | 0.7955 | 0.7573 | 0.8344 | 0.6336 | 0.746 | | 0.7588 | 5.0 | 1090 | 0.6223 | 0.7027 | 0.95 | 0.8391 | -1.0 | 0.0579 | 0.7069 | 0.3914 | 0.7837 | 0.7985 | -1.0 | 0.0909 | 0.8028 | 0.7656 | 0.8441 | 0.6397 | 0.7528 | | 0.7588 | 6.0 | 1308 | 0.5348 | 0.7501 | 0.9656 | 0.8984 | 0.0 | 0.0968 | 0.7554 | 0.4118 | 0.8153 | 0.8279 | 0.0 | 0.1731 | 0.8324 | 0.806 | 0.8711 | 0.6942 | 0.7846 | | 0.6174 | 7.0 | 1526 | 0.5323 | 0.7528 | 0.9746 | 0.886 | -1.0 | 0.0842 | 0.7577 | 0.4157 | 0.8095 | 0.8257 | -1.0 | 0.1886 | 0.8304 | 0.8005 | 0.8658 | 0.7051 | 0.7856 | | 0.6174 | 8.0 | 1744 | 0.5789 | 0.737 | 0.9678 | 0.887 | -1.0 | 0.0531 | 0.7425 | 0.4079 | 0.7946 | 0.8054 | -1.0 | 0.125 | 0.8104 | 0.7745 | 0.8372 | 0.6995 | 0.7737 | | 0.6174 | 9.0 | 1962 | 0.5023 | 0.7836 | 0.9714 | 0.9179 | -1.0 | 0.0266 | 0.7896 | 0.4282 | 0.8393 | 0.8508 | -1.0 | 0.0846 | 0.8564 | 0.8213 | 0.8846 | 0.7459 | 0.817 | | 0.5475 | 10.0 | 2180 | 0.5080 | 0.7568 | 0.981 | 0.9186 | 0.0 | 0.0688 | 0.7606 | 0.4136 | 0.8076 | 0.8229 | 0.0 | 0.1833 | 0.8263 | 0.7922 | 0.8499 | 0.7214 | 0.796 | | 0.5475 | 11.0 | 2398 | 0.4572 | 0.7963 | 0.9776 | 0.9388 | 0.0 | 0.0675 | 0.8052 | 0.4392 | 0.8446 | 0.8527 | 0.0 | 0.1029 | 0.8618 | 0.821 | 0.8758 | 0.7717 | 0.8297 | | 0.496 | 12.0 | 2616 | 0.4583 | 0.7857 | 0.982 | 0.9407 | 0.0 | 0.0544 | 0.7915 | 0.4294 | 0.8359 | 0.847 | 0.0 | 0.1458 | 0.8519 | 0.8104 | 0.8715 | 0.761 | 0.8225 | | 0.496 | 13.0 | 2834 | 0.4713 | 0.7798 | 0.9842 | 0.9263 | -1.0 | 0.0345 | 0.7841 | 0.4252 | 0.8336 | 0.8471 | -1.0 | 0.15 | 0.8509 | 0.809 | 0.8666 | 0.7506 | 0.8276 | | 0.4736 | 14.0 | 3052 | 0.4737 | 0.7981 | 0.9755 | 0.9349 | -1.0 | 0.0411 | 0.8053 | 0.4378 | 0.8461 | 0.8529 | -1.0 | 0.0969 | 0.8595 | 0.8479 | 0.8891 | 0.7483 | 0.8167 | | 0.4736 | 15.0 | 3270 | 0.4283 | 0.8069 | 0.9795 | 0.9315 | 0.0 | 0.0677 | 0.8154 | 0.4431 | 0.8546 | 0.864 | 0.0 | 0.1222 | 0.872 | 0.8486 | 0.9028 | 0.7651 | 0.8252 | | 0.4736 | 16.0 | 3488 | 0.3926 | 0.8155 | 0.9871 | 0.9422 | -1.0 | 0.2416 | 0.8196 | 0.4471 | 0.8586 | 0.8695 | -1.0 | 0.4643 | 0.8726 | 0.8548 | 0.8985 | 0.7762 | 0.8404 | | 0.4422 | 17.0 | 3706 | 0.3744 | 0.831 | 0.9837 | 0.9552 | -1.0 | 0.102 | 0.836 | 0.4535 | 0.872 | 0.8778 | -1.0 | 0.2192 | 0.8816 | 0.8738 | 0.9129 | 0.7882 | 0.8428 | | 0.4422 | 18.0 | 3924 | 0.3688 | 0.8199 | 0.9879 | 0.9515 | -1.0 | 0.0956 | 0.8244 | 0.4481 | 0.8655 | 0.8716 | -1.0 | 0.2444 | 0.8742 | 0.8532 | 0.8972 | 0.7866 | 0.8461 | | 0.3889 | 19.0 | 4142 | 0.3579 | 0.8291 | 0.9881 | 0.9546 | -1.0 | 0.1279 | 0.8348 | 0.4546 | 0.8706 | 0.8758 | -1.0 | 0.3321 | 0.8806 | 0.8664 | 0.9081 | 0.7918 | 0.8435 | | 0.3889 | 20.0 | 4360 | 0.3596 | 0.8268 | 0.9879 | 0.9539 | -1.0 | 0.0657 | 0.8319 | 0.452 | 0.8688 | 0.8757 | -1.0 | 0.1958 | 0.8796 | 0.8594 | 0.9077 | 0.7942 | 0.8437 | | 0.3854 | 21.0 | 4578 | 0.3641 | 0.8164 | 0.9883 | 0.957 | -1.0 | 0.1198 | 0.8209 | 0.4489 | 0.8648 | 0.87 | -1.0 | 0.25 | 0.8728 | 0.855 | 0.9016 | 0.7778 | 0.8384 | | 0.3854 | 22.0 | 4796 | 0.3602 | 0.8292 | 0.9825 | 0.9497 | 0.0 | 0.0718 | 0.8384 | 0.4579 | 0.8728 | 0.8773 | 0.0 | 0.1353 | 0.8865 | 0.8728 | 0.9142 | 0.7856 | 0.8404 | | 0.3614 | 23.0 | 5014 | 0.3371 | 0.8395 | 0.9884 | 0.9646 | -1.0 | 0.167 | 0.8439 | 0.4605 | 0.8805 | 0.8854 | -1.0 | 0.2571 | 0.8889 | 0.8739 | 0.9128 | 0.8052 | 0.8579 | | 0.3614 | 24.0 | 5232 | 0.3107 | 0.8562 | 0.9885 | 0.9709 | -1.0 | 0.1207 | 0.8597 | 0.4687 | 0.8921 | 0.8939 | -1.0 | 0.1864 | 0.8978 | 0.8872 | 0.9186 | 0.8252 | 0.8693 | | 0.3614 | 25.0 | 5450 | 0.3396 | 0.8385 | 0.9871 | 0.9637 | -1.0 | 0.1427 | 0.8446 | 0.4585 | 0.8829 | 0.8865 | -1.0 | 0.1929 | 0.8911 | 0.8617 | 0.9106 | 0.8154 | 0.8624 | | 0.3569 | 26.0 | 5668 | 0.3009 | 0.8623 | 0.9891 | 0.9698 | 0.0 | 0.2157 | 0.8663 | 0.4701 | 0.8983 | 0.9013 | 0.0 | 0.405 | 0.9044 | 0.884 | 0.923 | 0.8406 | 0.8795 | | 0.3569 | 27.0 | 5886 | 0.3325 | 0.8475 | 0.9884 | 0.9618 | -1.0 | 0.1365 | 0.8521 | 0.461 | 0.8847 | 0.8892 | -1.0 | 0.2 | 0.8941 | 0.874 | 0.9114 | 0.821 | 0.867 | | 0.3422 | 28.0 | 6104 | 0.3232 | 0.8492 | 0.9882 | 0.9698 | -1.0 | 0.1485 | 0.8529 | 0.4626 | 0.8872 | 0.8898 | -1.0 | 0.2167 | 0.8935 | 0.8748 | 0.9142 | 0.8235 | 0.8653 | | 0.3422 | 29.0 | 6322 | 0.2917 | 0.8636 | 0.9896 | 0.9683 | -1.0 | 0.1558 | 0.8685 | 0.4713 | 0.9005 | 0.9019 | -1.0 | 0.205 | 0.9053 | 0.8887 | 0.9265 | 0.8384 | 0.8773 | | 0.3347 | 30.0 | 6540 | 0.3121 | 0.8589 | 0.987 | 0.9639 | -1.0 | 0.1297 | 0.8645 | 0.4665 | 0.8955 | 0.9005 | -1.0 | 0.2077 | 0.9047 | 0.8978 | 0.9336 | 0.8201 | 0.8674 | | 0.3347 | 31.0 | 6758 | 0.2942 | 0.8659 | 0.9891 | 0.9767 | 0.0 | 0.1245 | 0.873 | 0.4677 | 0.8992 | 0.901 | 0.0 | 0.1942 | 0.9069 | 0.8982 | 0.9316 | 0.8336 | 0.8704 | | 0.3347 | 32.0 | 6976 | 0.3047 | 0.8557 | 0.9894 | 0.9691 | -1.0 | 0.1579 | 0.8609 | 0.465 | 0.8922 | 0.8946 | -1.0 | 0.2179 | 0.8995 | 0.8783 | 0.9157 | 0.8332 | 0.8736 | | 0.3228 | 33.0 | 7194 | 0.2833 | 0.8686 | 0.9897 | 0.9727 | -1.0 | 0.1756 | 0.8727 | 0.4723 | 0.9 | 0.9026 | -1.0 | 0.2545 | 0.9057 | 0.9023 | 0.934 | 0.8348 | 0.8712 | | 0.3228 | 34.0 | 7412 | 0.2995 | 0.8595 | 0.9887 | 0.9688 | -1.0 | 0.1737 | 0.8654 | 0.4676 | 0.8958 | 0.898 | -1.0 | 0.2357 | 0.902 | 0.89 | 0.9253 | 0.829 | 0.8708 | | 0.3032 | 35.0 | 7630 | 0.2869 | 0.8683 | 0.9881 | 0.9651 | -1.0 | 0.1214 | 0.8753 | 0.4693 | 0.9027 | 0.9053 | -1.0 | 0.1444 | 0.9123 | 0.9096 | 0.9398 | 0.8271 | 0.8708 | | 0.3032 | 36.0 | 7848 | 0.2804 | 0.8665 | 0.9894 | 0.9706 | -1.0 | 0.1528 | 0.8698 | 0.4694 | 0.9031 | 0.9062 | -1.0 | 0.1955 | 0.91 | 0.8954 | 0.9294 | 0.8377 | 0.8829 | | 0.3 | 37.0 | 8066 | 0.2992 | 0.866 | 0.9896 | 0.9782 | 0.0 | 0.1333 | 0.8738 | 0.4698 | 0.9035 | 0.9052 | 0.0 | 0.24 | 0.9112 | 0.8973 | 0.9305 | 0.8347 | 0.88 | | 0.3 | 38.0 | 8284 | 0.2562 | 0.8803 | 0.9898 | 0.9797 | -1.0 | 0.2173 | 0.8837 | 0.478 | 0.9142 | 0.9155 | -1.0 | 0.3056 | 0.9176 | 0.8977 | 0.9315 | 0.8629 | 0.8994 | | 0.2893 | 39.0 | 8502 | 0.2709 | 0.8733 | 0.9898 | 0.9719 | -1.0 | 0.1718 | 0.8776 | 0.4732 | 0.9073 | 0.9095 | -1.0 | 0.2567 | 0.9136 | 0.8913 | 0.927 | 0.8552 | 0.892 | | 0.2893 | 40.0 | 8720 | 0.2424 | 0.892 | 0.9897 | 0.979 | -1.0 | 0.1628 | 0.8979 | 0.4806 | 0.9225 | 0.9252 | -1.0 | 0.2469 | 0.9298 | 0.9231 | 0.9501 | 0.8608 | 0.9002 | | 0.2893 | 41.0 | 8938 | 0.2508 | 0.883 | 0.9898 | 0.9749 | -1.0 | 0.1155 | 0.889 | 0.4788 | 0.9133 | 0.9159 | -1.0 | 0.2188 | 0.9209 | 0.9115 | 0.9404 | 0.8545 | 0.8914 | | 0.2777 | 42.0 | 9156 | 0.2580 | 0.8793 | 0.9896 | 0.9776 | -1.0 | 0.3268 | 0.8838 | 0.4754 | 0.912 | 0.9133 | -1.0 | 0.3462 | 0.9181 | 0.9021 | 0.9334 | 0.8565 | 0.8932 | | 0.2777 | 43.0 | 9374 | 0.2493 | 0.8902 | 0.9898 | 0.9774 | -1.0 | 0.1308 | 0.8954 | 0.4786 | 0.9214 | 0.9236 | -1.0 | 0.2038 | 0.9281 | 0.9166 | 0.9459 | 0.8637 | 0.9013 | | 0.2668 | 44.0 | 9592 | 0.2427 | 0.8852 | 0.9896 | 0.9778 | -1.0 | 0.1606 | 0.8902 | 0.4796 | 0.9195 | 0.921 | -1.0 | 0.25 | 0.9243 | 0.9118 | 0.9421 | 0.8586 | 0.9 | | 0.2668 | 45.0 | 9810 | 0.2497 | 0.8915 | 0.9896 | 0.978 | 0.0 | 0.3372 | 0.8975 | 0.4804 | 0.9246 | 0.9265 | 0.0 | 0.4042 | 0.9314 | 0.9149 | 0.9473 | 0.8681 | 0.9058 | | 0.2583 | 46.0 | 10028 | 0.2478 | 0.885 | 0.9894 | 0.9717 | 0.0 | 0.175 | 0.8912 | 0.4832 | 0.92 | 0.9217 | 0.0 | 0.2192 | 0.9265 | 0.9051 | 0.942 | 0.8648 | 0.9014 | | 0.2583 | 47.0 | 10246 | 0.2415 | 0.8906 | 0.9897 | 0.977 | 0.0 | 0.2103 | 0.8947 | 0.4802 | 0.9215 | 0.9239 | 0.0 | 0.2917 | 0.9273 | 0.9163 | 0.948 | 0.8649 | 0.8998 | | 0.2583 | 48.0 | 10464 | 0.2188 | 0.9019 | 0.99 | 0.9842 | -1.0 | 0.2088 | 0.9075 | 0.4849 | 0.9323 | 0.9335 | -1.0 | 0.2318 | 0.9371 | 0.9253 | 0.9557 | 0.8784 | 0.9114 | | 0.2526 | 49.0 | 10682 | 0.2549 | 0.8903 | 0.9898 | 0.9762 | 0.0 | 0.3876 | 0.8955 | 0.4791 | 0.9225 | 0.9237 | 0.0 | 0.4367 | 0.9294 | 0.9192 | 0.9485 | 0.8614 | 0.8989 | | 0.2526 | 50.0 | 10900 | 0.2444 | 0.8909 | 0.9893 | 0.9728 | -1.0 | 0.1661 | 0.8968 | 0.4779 | 0.9229 | 0.9247 | -1.0 | 0.3313 | 0.9303 | 0.9109 | 0.9438 | 0.871 | 0.9056 | | 0.242 | 51.0 | 11118 | 0.2061 | 0.9086 | 0.9899 | 0.9841 | -1.0 | 0.2645 | 0.9143 | 0.4892 | 0.9393 | 0.9403 | -1.0 | 0.2944 | 0.9427 | 0.9296 | 0.9586 | 0.8875 | 0.9219 | | 0.242 | 52.0 | 11336 | 0.2277 | 0.9027 | 0.9899 | 0.977 | -1.0 | 0.2558 | 0.9091 | 0.4853 | 0.9342 | 0.9364 | -1.0 | 0.3218 | 0.9415 | 0.9225 | 0.9541 | 0.883 | 0.9188 | | 0.2273 | 53.0 | 11554 | 0.2193 | 0.9003 | 0.9899 | 0.9786 | -1.0 | 0.1985 | 0.9089 | 0.4863 | 0.9331 | 0.9336 | -1.0 | 0.2275 | 0.9399 | 0.9176 | 0.9497 | 0.883 | 0.9175 | | 0.2273 | 54.0 | 11772 | 0.2055 | 0.9067 | 0.99 | 0.9843 | -1.0 | 0.2164 | 0.9123 | 0.4885 | 0.9383 | 0.9395 | -1.0 | 0.25 | 0.9434 | 0.9294 | 0.9582 | 0.884 | 0.9208 | | 0.2273 | 55.0 | 11990 | 0.2014 | 0.9134 | 0.99 | 0.9861 | -1.0 | 0.3274 | 0.9161 | 0.4902 | 0.9436 | 0.9449 | -1.0 | 0.35 | 0.9468 | 0.9284 | 0.9572 | 0.8985 | 0.9327 | | 0.234 | 56.0 | 12208 | 0.1938 | 0.9136 | 0.9894 | 0.9798 | 0.0 | 0.1319 | 0.9192 | 0.4944 | 0.9414 | 0.9432 | 0.0 | 0.15 | 0.9488 | 0.9362 | 0.9618 | 0.891 | 0.9245 | | 0.234 | 57.0 | 12426 | 0.2148 | 0.9022 | 0.9899 | 0.9807 | -1.0 | 0.2163 | 0.9063 | 0.4852 | 0.934 | 0.9362 | -1.0 | 0.2269 | 0.9405 | 0.9152 | 0.9477 | 0.8891 | 0.9246 | | 0.2155 | 58.0 | 12644 | 0.2112 | 0.9039 | 0.99 | 0.9846 | -1.0 | 0.1787 | 0.909 | 0.4887 | 0.9346 | 0.9357 | -1.0 | 0.2038 | 0.9402 | 0.9321 | 0.9596 | 0.8756 | 0.9117 | | 0.2155 | 59.0 | 12862 | 0.1872 | 0.9218 | 0.99 | 0.9802 | 0.0 | 0.2209 | 0.9276 | 0.4941 | 0.9469 | 0.9484 | 0.0 | 0.255 | 0.9527 | 0.9366 | 0.9606 | 0.907 | 0.9362 | | 0.2083 | 60.0 | 13080 | 0.1816 | 0.9239 | 0.9898 | 0.9836 | -1.0 | 0.2794 | 0.9255 | 0.4935 | 0.9506 | 0.9512 | -1.0 | 0.3 | 0.9539 | 0.9487 | 0.9701 | 0.899 | 0.9324 | | 0.2083 | 61.0 | 13298 | 0.1873 | 0.9195 | 0.9899 | 0.9812 | -1.0 | 0.2767 | 0.9244 | 0.4946 | 0.9463 | 0.9476 | -1.0 | 0.3333 | 0.9506 | 0.9407 | 0.9636 | 0.8982 | 0.9316 | | 0.2119 | 62.0 | 13516 | 0.1796 | 0.9246 | 0.9897 | 0.9834 | 0.0 | 0.1997 | 0.9286 | 0.4955 | 0.9509 | 0.952 | 0.0 | 0.2458 | 0.957 | 0.9383 | 0.9645 | 0.9109 | 0.9395 | | 0.2119 | 63.0 | 13734 | 0.1725 | 0.9309 | 0.99 | 0.9843 | -1.0 | 0.2467 | 0.9362 | 0.4976 | 0.9557 | 0.9558 | -1.0 | 0.265 | 0.9589 | 0.9452 | 0.9678 | 0.9166 | 0.9438 | | 0.2119 | 64.0 | 13952 | 0.1780 | 0.9334 | 0.99 | 0.9848 | 0.0 | 0.2257 | 0.9383 | 0.4992 | 0.9562 | 0.9569 | 0.0 | 0.2708 | 0.9616 | 0.9515 | 0.9701 | 0.9153 | 0.9438 | | 0.1945 | 65.0 | 14170 | 0.1732 | 0.9324 | 0.99 | 0.9864 | -1.0 | 0.2813 | 0.9385 | 0.4984 | 0.9577 | 0.9582 | -1.0 | 0.3136 | 0.961 | 0.9476 | 0.9703 | 0.9173 | 0.9461 | | 0.1945 | 66.0 | 14388 | 0.1703 | 0.9388 | 0.99 | 0.9866 | 0.0 | 0.3105 | 0.944 | 0.5006 | 0.9618 | 0.9623 | 0.0 | 0.3222 | 0.9664 | 0.9518 | 0.9729 | 0.9258 | 0.9517 | | 0.1911 | 67.0 | 14606 | 0.1773 | 0.9314 | 0.9899 | 0.9791 | 0.0 | 0.2407 | 0.9368 | 0.4968 | 0.9523 | 0.9541 | 0.0 | 0.3385 | 0.958 | 0.9479 | 0.9673 | 0.9149 | 0.941 | | 0.1911 | 68.0 | 14824 | 0.1742 | 0.9309 | 0.99 | 0.9831 | 0.0 | 0.213 | 0.9385 | 0.4981 | 0.9554 | 0.9561 | 0.0 | 0.2767 | 0.9608 | 0.9422 | 0.9657 | 0.9195 | 0.9464 | | 0.1827 | 69.0 | 15042 | 0.1525 | 0.9428 | 0.99 | 0.9894 | -1.0 | 0.2571 | 0.9482 | 0.5015 | 0.9645 | 0.965 | -1.0 | 0.3 | 0.9687 | 0.9544 | 0.9751 | 0.9312 | 0.9549 | | 0.1827 | 70.0 | 15260 | 0.1644 | 0.9357 | 0.9899 | 0.9848 | -1.0 | 0.2394 | 0.9413 | 0.4985 | 0.9558 | 0.9574 | -1.0 | 0.2536 | 0.9617 | 0.9511 | 0.9709 | 0.9202 | 0.9439 | | 0.1827 | 71.0 | 15478 | 0.1531 | 0.9415 | 0.99 | 0.9845 | -1.0 | 0.2432 | 0.9481 | 0.503 | 0.9627 | 0.9636 | -1.0 | 0.3393 | 0.9679 | 0.9562 | 0.9749 | 0.9268 | 0.9524 | | 0.1777 | 72.0 | 15696 | 0.1636 | 0.9426 | 0.99 | 0.987 | -1.0 | 0.2772 | 0.9439 | 0.4987 | 0.9623 | 0.9631 | -1.0 | 0.2923 | 0.9667 | 0.9579 | 0.9732 | 0.9274 | 0.953 | | 0.1777 | 73.0 | 15914 | 0.1516 | 0.9423 | 0.99 | 0.9846 | 0.0 | 0.2665 | 0.9485 | 0.5022 | 0.9621 | 0.9627 | 0.0 | 0.29 | 0.9673 | 0.956 | 0.9731 | 0.9285 | 0.9523 | | 0.1838 | 74.0 | 16132 | 0.1448 | 0.9465 | 0.995 | 0.9846 | -1.0 | 0.5659 | 0.9492 | 0.503 | 0.9665 | 0.9668 | -1.0 | 0.6182 | 0.969 | 0.9629 | 0.9776 | 0.9301 | 0.956 | | 0.1838 | 75.0 | 16350 | 0.1681 | 0.9385 | 0.9897 | 0.9827 | -1.0 | 0.2587 | 0.9407 | 0.5007 | 0.9609 | 0.9617 | -1.0 | 0.4722 | 0.9642 | 0.9564 | 0.9743 | 0.9205 | 0.949 | | 0.1775 | 76.0 | 16568 | 0.1469 | 0.9461 | 0.9899 | 0.9817 | -1.0 | 0.1993 | 0.9536 | 0.5029 | 0.9631 | 0.9643 | -1.0 | 0.2706 | 0.9692 | 0.956 | 0.9722 | 0.9362 | 0.9564 | | 0.1775 | 77.0 | 16786 | 0.1396 | 0.953 | 0.99 | 0.9819 | -1.0 | 0.213 | 0.9618 | 0.5051 | 0.9699 | 0.971 | -1.0 | 0.2735 | 0.9759 | 0.9674 | 0.9805 | 0.9385 | 0.9615 | | 0.171 | 78.0 | 17004 | 0.1364 | 0.9536 | 0.9901 | 0.9896 | 0.0 | 0.3345 | 0.9582 | 0.5062 | 0.972 | 0.9723 | 0.0 | 0.3722 | 0.9747 | 0.9615 | 0.9783 | 0.9457 | 0.9663 | | 0.171 | 79.0 | 17222 | 0.1586 | 0.9394 | 0.9947 | 0.9835 | -1.0 | 0.5025 | 0.943 | 0.5013 | 0.9608 | 0.9623 | -1.0 | 0.5875 | 0.9658 | 0.9554 | 0.9731 | 0.9233 | 0.9515 | | 0.171 | 80.0 | 17440 | 0.1417 | 0.9494 | 0.9901 | 0.9805 | -1.0 | 0.2141 | 0.9565 | 0.5041 | 0.9656 | 0.9671 | -1.0 | 0.2429 | 0.9718 | 0.9601 | 0.9762 | 0.9386 | 0.9581 | | 0.1642 | 81.0 | 17658 | 0.1303 | 0.9573 | 0.9901 | 0.9847 | -1.0 | 0.2475 | 0.963 | 0.5064 | 0.9724 | 0.9729 | -1.0 | 0.2875 | 0.977 | 0.9656 | 0.9787 | 0.949 | 0.9671 | | 0.1642 | 82.0 | 17876 | 0.1348 | 0.9499 | 0.9901 | 0.9849 | -1.0 | 0.2481 | 0.9571 | 0.5046 | 0.9701 | 0.9702 | -1.0 | 0.2679 | 0.9745 | 0.9607 | 0.9787 | 0.9391 | 0.9618 | | 0.1573 | 83.0 | 18094 | 0.1325 | 0.9511 | 0.9901 | 0.9838 | -1.0 | 0.2714 | 0.9552 | 0.504 | 0.97 | 0.9705 | -1.0 | 0.3167 | 0.9735 | 0.9609 | 0.9786 | 0.9413 | 0.9623 | | 0.1573 | 84.0 | 18312 | 0.1255 | 0.9585 | 0.99 | 0.9849 | 0.0 | 0.2656 | 0.9656 | 0.5069 | 0.9733 | 0.9738 | 0.0 | 0.2929 | 0.9783 | 0.9668 | 0.9807 | 0.9502 | 0.9669 | | 0.1437 | 85.0 | 18530 | 0.1481 | 0.9479 | 0.99 | 0.9848 | -1.0 | 0.2646 | 0.9525 | 0.5027 | 0.9653 | 0.9663 | -1.0 | 0.2692 | 0.9702 | 0.9578 | 0.9738 | 0.938 | 0.9587 | | 0.1437 | 86.0 | 18748 | 0.1236 | 0.9539 | 0.99 | 0.985 | -1.0 | 0.3818 | 0.959 | 0.507 | 0.9717 | 0.9723 | -1.0 | 0.3955 | 0.9741 | 0.9652 | 0.9803 | 0.9425 | 0.9643 | | 0.1437 | 87.0 | 18966 | 0.1293 | 0.9595 | 0.99 | 0.9848 | 0.0 | 0.3046 | 0.9663 | 0.5059 | 0.9736 | 0.9745 | 0.0 | 0.43 | 0.9797 | 0.9698 | 0.9815 | 0.9492 | 0.9676 | | 0.1532 | 88.0 | 19184 | 0.1295 | 0.9525 | 0.9901 | 0.9891 | 0.0 | 0.3118 | 0.9579 | 0.5054 | 0.9727 | 0.9727 | 0.0 | 0.3385 | 0.9762 | 0.9591 | 0.9785 | 0.9458 | 0.9669 | | 0.1532 | 89.0 | 19402 | 0.1317 | 0.9556 | 0.99 | 0.9844 | -1.0 | 0.2569 | 0.9589 | 0.5052 | 0.9708 | 0.9714 | -1.0 | 0.2792 | 0.975 | 0.9644 | 0.9779 | 0.9468 | 0.965 | | 0.1465 | 90.0 | 19620 | 0.1216 | 0.9555 | 0.99 | 0.9855 | -1.0 | 0.4916 | 0.9614 | 0.5068 | 0.9751 | 0.9756 | -1.0 | 0.5125 | 0.9777 | 0.9625 | 0.9799 | 0.9484 | 0.9713 | | 0.1465 | 91.0 | 19838 | 0.1357 | 0.953 | 0.9901 | 0.985 | 0.0 | 0.3426 | 0.956 | 0.503 | 0.9694 | 0.9705 | 0.0 | 0.42 | 0.9738 | 0.9611 | 0.9757 | 0.945 | 0.9653 | | 0.145 | 92.0 | 20056 | 0.1242 | 0.9582 | 0.9901 | 0.9898 | -1.0 | 0.2929 | 0.9627 | 0.5062 | 0.9742 | 0.9751 | -1.0 | 0.3583 | 0.9776 | 0.9652 | 0.9783 | 0.9511 | 0.9718 | | 0.145 | 93.0 | 20274 | 0.1320 | 0.956 | 0.99 | 0.9843 | -1.0 | 0.2826 | 0.9601 | 0.505 | 0.9713 | 0.9724 | -1.0 | 0.3273 | 0.9751 | 0.9664 | 0.9801 | 0.9455 | 0.9647 | | 0.145 | 94.0 | 20492 | 0.1276 | 0.9608 | 0.9898 | 0.9819 | -1.0 | 0.3052 | 0.966 | 0.5045 | 0.9746 | 0.9759 | -1.0 | 0.3583 | 0.9784 | 0.9672 | 0.9805 | 0.9544 | 0.9713 | | 0.1454 | 95.0 | 20710 | 0.1237 | 0.957 | 0.99 | 0.9845 | 0.0 | 0.2527 | 0.9641 | 0.5058 | 0.9743 | 0.9744 | 0.0 | 0.275 | 0.9787 | 0.9628 | 0.9799 | 0.9512 | 0.9689 | | 0.1454 | 96.0 | 20928 | 0.1234 | 0.9622 | 0.99 | 0.9858 | 0.0 | 0.3156 | 0.9678 | 0.5072 | 0.977 | 0.9775 | 0.0 | 0.3318 | 0.9808 | 0.9721 | 0.984 | 0.9523 | 0.9709 | | 0.1517 | 97.0 | 21146 | 0.1255 | 0.9527 | 0.9901 | 0.9846 | -1.0 | 0.295 | 0.9576 | 0.505 | 0.9714 | 0.972 | -1.0 | 0.3036 | 0.9756 | 0.9634 | 0.9797 | 0.942 | 0.9643 | | 0.1517 | 98.0 | 21364 | 0.1348 | 0.9501 | 0.9897 | 0.9805 | 0.0 | 0.2548 | 0.9558 | 0.5031 | 0.9665 | 0.9677 | 0.0 | 0.3833 | 0.9716 | 0.9594 | 0.9753 | 0.9408 | 0.9601 | | 0.1435 | 99.0 | 21582 | 0.1255 | 0.9609 | 0.99 | 0.9855 | -1.0 | 0.3144 | 0.9644 | 0.5077 | 0.9749 | 0.9761 | -1.0 | 0.4125 | 0.9794 | 0.9688 | 0.9818 | 0.953 | 0.9705 | | 0.1435 | 100.0 | 21800 | 0.1272 | 0.9568 | 0.99 | 0.9848 | -1.0 | 0.3143 | 0.9595 | 0.5045 | 0.9717 | 0.9726 | -1.0 | 0.3385 | 0.9755 | 0.9619 | 0.9762 | 0.9517 | 0.9689 | ### Framework versions - Transformers 4.42.3 - Pytorch 2.3.1+cu121 - Datasets 2.20.0 - Tokenizers 0.19.1