vehicle_detection

This model is a fine-tuned version of microsoft/conditional-detr-resnet-50 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.2233
• Map: 0.9186
• Map 50: 0.9888
• Map 75: 0.9702
• Map Small: 0.0168
• Map Medium: 0.8326
• Map Large: 0.9267
• Mar 1: 0.39
• Mar 10: 0.9118
• Mar 100: 0.9461
• Mar Small: 0.0167
• Mar Medium: 0.883
• Mar Large: 0.953
• Map Car: 0.9208
• Mar 100 Car: 0.9447
• Map Twowheeler: 0.9227
• Mar 100 Twowheeler: 0.9476
• Map Auto: 0.8797
• Mar 100 Auto: 0.9232
• Map Bus: 0.93
• Mar 100 Bus: 0.9552
• Map Truck: 0.94
• Mar 100 Truck: 0.9599

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 4
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: cosine
• num_epochs: 100
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Map	Map 50	Map 75	Map Small	Map Medium	Map Large	Mar 1	Mar 10	Mar 100	Mar Small	Mar Medium	Mar Large	Map Car	Mar 100 Car	Map Twowheeler	Mar 100 Twowheeler	Map Auto	Mar 100 Auto	Map Bus	Mar 100 Bus	Map Truck	Mar 100 Truck
No log	1.0	229	1.9856	0.0192	0.0426	0.0169	0.0	0.0005	0.0205	0.0089	0.0398	0.106	0.0	0.0074	0.1124	0.0947	0.5102	0.0015	0.02	0.0	0.0	0.0	0.0	0.0	0.0
No log	2.0	458	1.6568	0.0551	0.1059	0.0545	0.0	0.0483	0.056	0.0427	0.1326	0.2109	0.0	0.1499	0.2097	0.1798	0.6435	0.0178	0.1473	0.0686	0.1522	0.0007	0.0325	0.0088	0.0787
3.2288	3.0	687	1.5186	0.1102	0.1976	0.1134	0.0	0.0914	0.1095	0.0734	0.238	0.3274	0.0	0.1826	0.3338	0.2763	0.6943	0.1158	0.4139	0.1317	0.271	0.0226	0.119	0.0046	0.1386
3.2288	4.0	916	1.3361	0.1499	0.2474	0.1617	0.0	0.1175	0.1508	0.0948	0.3171	0.4177	0.0	0.2566	0.4266	0.3726	0.7412	0.1597	0.579	0.1768	0.3913	0.0275	0.1867	0.0129	0.1906
1.4282	5.0	1145	1.2549	0.1958	0.326	0.2123	0.0	0.1189	0.2027	0.1253	0.4038	0.5086	0.0	0.2705	0.5279	0.4481	0.7446	0.2302	0.6364	0.1981	0.4741	0.0537	0.3586	0.0488	0.3292
1.4282	6.0	1374	1.1393	0.2589	0.398	0.2816	0.0	0.2273	0.2586	0.1605	0.5096	0.6228	0.0	0.4519	0.6371	0.5211	0.7628	0.3211	0.7083	0.2883	0.6504	0.0848	0.4807	0.0793	0.5119
1.172	7.0	1603	1.0888	0.3236	0.4901	0.3573	0.0	0.3587	0.3187	0.1885	0.5581	0.6591	0.0	0.5986	0.6641	0.5699	0.7709	0.393	0.7138	0.3439	0.661	0.1689	0.5467	0.1424	0.6031
1.172	8.0	1832	0.9997	0.3794	0.5421	0.4216	0.0	0.3792	0.3785	0.2154	0.6143	0.7034	0.0	0.6357	0.7102	0.6207	0.7971	0.47	0.7611	0.4082	0.6813	0.2144	0.6463	0.1835	0.6314
1.0361	9.0	2061	0.9796	0.424	0.6006	0.4761	0.0114	0.3865	0.43	0.2416	0.6314	0.717	0.0333	0.5976	0.7297	0.6461	0.7925	0.5229	0.7637	0.3866	0.6755	0.2786	0.6679	0.2857	0.6855
1.0361	10.0	2290	0.8782	0.5167	0.6937	0.5831	0.0	0.4704	0.524	0.2729	0.6941	0.7711	0.0	0.6556	0.7819	0.6851	0.8177	0.5872	0.7896	0.4967	0.7474	0.374	0.6988	0.4407	0.8018
0.9095	11.0	2519	0.8567	0.5329	0.7133	0.6079	0.0	0.4845	0.5393	0.2805	0.6993	0.773	0.0	0.6472	0.7856	0.6822	0.8049	0.599	0.7895	0.5309	0.7533	0.3702	0.7294	0.4825	0.7877
0.9095	12.0	2748	0.8288	0.5647	0.7448	0.6448	0.1347	0.489	0.5734	0.2862	0.7164	0.7853	0.1333	0.6483	0.7975	0.6904	0.8157	0.6037	0.7808	0.5581	0.7641	0.4403	0.7539	0.5308	0.8118
0.9095	13.0	2977	0.7847	0.5902	0.7746	0.674	0.0	0.5372	0.5951	0.2964	0.7264	0.7867	0.0	0.6727	0.7978	0.7096	0.8184	0.6454	0.8043	0.5636	0.7631	0.4959	0.7512	0.5364	0.7963
0.8129	14.0	3206	0.7430	0.6291	0.8117	0.7151	0.0	0.5248	0.6378	0.3103	0.7454	0.801	0.0	0.6606	0.8146	0.7295	0.8314	0.6656	0.8225	0.6015	0.7824	0.5479	0.7588	0.6009	0.81
0.8129	15.0	3435	0.7187	0.6398	0.8242	0.737	0.0	0.5326	0.6482	0.3083	0.7487	0.8027	0.0	0.672	0.8135	0.7392	0.8356	0.6817	0.8242	0.6307	0.7929	0.5222	0.7398	0.6251	0.821
0.748	16.0	3664	0.7008	0.6486	0.83	0.735	0.0	0.5434	0.6576	0.3076	0.7524	0.8049	0.0	0.6797	0.8164	0.7529	0.844	0.6859	0.8224	0.6329	0.7932	0.5457	0.7446	0.6255	0.8203
0.748	17.0	3893	0.7042	0.6523	0.8462	0.7542	0.0	0.5646	0.6612	0.3162	0.7525	0.806	0.0	0.679	0.8181	0.7367	0.826	0.6755	0.804	0.6157	0.7821	0.5825	0.788	0.651	0.83
0.6979	18.0	4122	0.6434	0.6987	0.8684	0.7936	0.0	0.5947	0.7073	0.3282	0.7857	0.8348	0.0	0.7175	0.8469	0.7767	0.8561	0.7213	0.8463	0.6801	0.8165	0.643	0.8022	0.6722	0.8529
0.6979	19.0	4351	0.6231	0.7049	0.8806	0.8131	0.0	0.607	0.7131	0.3297	0.7819	0.827	0.0	0.7175	0.8374	0.761	0.8424	0.7167	0.8383	0.7004	0.82	0.6527	0.7882	0.6936	0.8461
0.6589	20.0	4580	0.6284	0.7074	0.8836	0.8081	0.0	0.6173	0.7146	0.3324	0.785	0.8311	0.0	0.7258	0.8409	0.7747	0.8543	0.7168	0.8345	0.6881	0.8136	0.6575	0.8058	0.6997	0.8474
0.6589	21.0	4809	0.5998	0.7205	0.8955	0.8187	0.0	0.6133	0.7302	0.3325	0.7944	0.8427	0.0	0.7266	0.8543	0.7821	0.8565	0.7414	0.8484	0.6888	0.8175	0.6778	0.83	0.7125	0.861
0.6182	22.0	5038	0.6040	0.7196	0.888	0.8178	0.0	0.6161	0.7304	0.3288	0.7937	0.8427	0.0	0.7385	0.8538	0.7863	0.8609	0.745	0.8573	0.6975	0.8247	0.6467	0.8147	0.7227	0.8561
0.6182	23.0	5267	0.5959	0.7329	0.8994	0.8317	0.0	0.6189	0.7412	0.338	0.8018	0.8459	0.0	0.7299	0.8566	0.7921	0.864	0.7467	0.8585	0.7291	0.8403	0.6852	0.8164	0.7114	0.8506
0.6182	24.0	5496	0.5712	0.7374	0.9106	0.8392	0.0038	0.649	0.744	0.3395	0.802	0.8487	0.0583	0.7426	0.8587	0.7918	0.8633	0.7476	0.8527	0.7115	0.8233	0.6865	0.8282	0.7499	0.8761
0.6034	25.0	5725	0.5547	0.7488	0.9191	0.8456	0.0	0.6335	0.7602	0.3434	0.8077	0.8548	0.0	0.7327	0.8675	0.804	0.8697	0.7675	0.8616	0.7157	0.8413	0.722	0.847	0.7349	0.8542
0.6034	26.0	5954	0.5622	0.7466	0.9177	0.8593	0.0	0.62	0.7598	0.3441	0.8036	0.8473	0.0	0.7238	0.8588	0.7931	0.8637	0.749	0.8513	0.7233	0.8337	0.7156	0.822	0.7522	0.8657
0.5794	27.0	6183	0.5197	0.7662	0.9283	0.8704	0.0	0.6591	0.7743	0.3468	0.8152	0.8566	0.0	0.7497	0.8669	0.8087	0.8741	0.7721	0.8659	0.7519	0.8431	0.7331	0.8313	0.7652	0.8685
0.5794	28.0	6412	0.5260	0.7729	0.9325	0.8779	0.0	0.6734	0.7813	0.345	0.8214	0.866	0.0	0.7614	0.8768	0.8157	0.8773	0.773	0.8663	0.7612	0.8542	0.7359	0.8431	0.7787	0.889
0.5511	29.0	6641	0.5145	0.7624	0.9301	0.8628	0.0	0.6492	0.7709	0.3447	0.8096	0.8564	0.0	0.7421	0.8666	0.814	0.8736	0.7687	0.8607	0.7453	0.8426	0.725	0.8448	0.7592	0.8604
0.5511	30.0	6870	0.4996	0.7762	0.9407	0.8836	0.0257	0.6791	0.7816	0.3488	0.8238	0.8656	0.025	0.7691	0.8748	0.8188	0.8773	0.7721	0.8684	0.7494	0.8428	0.7624	0.8633	0.7785	0.8761
0.5377	31.0	7099	0.4853	0.7911	0.946	0.9015	0.0	0.6981	0.7972	0.3546	0.8273	0.8692	0.0	0.7815	0.8762	0.8236	0.8826	0.8004	0.8762	0.7789	0.8565	0.765	0.8597	0.7875	0.8709
0.5377	32.0	7328	0.4858	0.7869	0.941	0.8932	0.0	0.679	0.7969	0.3508	0.8262	0.8699	0.0	0.7711	0.8803	0.8251	0.8822	0.7992	0.8823	0.7576	0.8489	0.7519	0.8444	0.8006	0.8919
0.5134	33.0	7557	0.4781	0.7857	0.944	0.9	0.0	0.6941	0.794	0.3543	0.8231	0.8641	0.0	0.7822	0.8715	0.8221	0.8807	0.8036	0.8794	0.7642	0.8548	0.7576	0.8364	0.781	0.8691
0.5134	34.0	7786	0.4783	0.7923	0.9472	0.8978	0.0	0.677	0.8006	0.3537	0.8316	0.8722	0.0	0.7665	0.8818	0.8281	0.8854	0.8027	0.8829	0.7795	0.8617	0.7501	0.8466	0.8014	0.8842
0.5006	35.0	8015	0.4689	0.7943	0.9499	0.9028	0.0101	0.6986	0.8017	0.3551	0.8301	0.8698	0.05	0.7826	0.8783	0.8285	0.8846	0.8059	0.8816	0.7777	0.8613	0.7632	0.8477	0.7961	0.8735
0.5006	36.0	8244	0.4788	0.794	0.9477	0.9019	0.0	0.708	0.8004	0.3539	0.8292	0.8694	0.0	0.7749	0.8778	0.827	0.8839	0.8069	0.8811	0.7793	0.8541	0.7679	0.8477	0.7888	0.8803
0.5006	37.0	8473	0.4364	0.8171	0.9586	0.9214	0.0	0.7011	0.8249	0.3635	0.8448	0.8844	0.0	0.7808	0.8935	0.8447	0.8936	0.8148	0.8844	0.7914	0.8687	0.8181	0.8918	0.8164	0.8834
0.4862	38.0	8702	0.4287	0.8104	0.9598	0.9135	0.0	0.7261	0.8158	0.3582	0.8422	0.8806	0.0	0.8008	0.8879	0.843	0.8947	0.8215	0.8913	0.8011	0.8721	0.7848	0.8672	0.8015	0.8776
0.4862	39.0	8931	0.4381	0.8088	0.9565	0.9112	0.0	0.7092	0.8165	0.3586	0.8421	0.8833	0.0	0.7832	0.8931	0.842	0.8954	0.8195	0.8916	0.7791	0.8664	0.7898	0.8706	0.8134	0.8926
0.467	40.0	9160	0.4064	0.8247	0.9641	0.9272	0.0	0.7091	0.8334	0.3659	0.8506	0.8873	0.0	0.7813	0.8972	0.8478	0.8972	0.8326	0.8964	0.7952	0.8716	0.8167	0.8814	0.8313	0.8901
0.467	41.0	9389	0.4180	0.8301	0.9634	0.926	0.0284	0.7306	0.8379	0.3643	0.8528	0.8907	0.05	0.8049	0.8986	0.856	0.8991	0.8307	0.8949	0.812	0.8768	0.8181	0.8843	0.8336	0.8982
0.4425	42.0	9618	0.4123	0.8297	0.9644	0.9247	0.0	0.7309	0.8382	0.3647	0.8541	0.8903	0.0	0.8033	0.8985	0.8575	0.9011	0.8411	0.9026	0.8103	0.8795	0.8069	0.8672	0.8325	0.9011
0.4425	43.0	9847	0.3825	0.8389	0.9691	0.9398	0.0	0.7355	0.8473	0.3697	0.8586	0.8978	0.0	0.806	0.9065	0.8608	0.9044	0.8405	0.9065	0.8139	0.8834	0.8374	0.8913	0.8417	0.9033
0.4263	44.0	10076	0.3773	0.8377	0.9684	0.931	0.0	0.7218	0.8459	0.3644	0.856	0.8949	0.0	0.7984	0.9029	0.8612	0.9027	0.8361	0.8981	0.822	0.884	0.8272	0.8877	0.8418	0.9018
0.4263	45.0	10305	0.3904	0.824	0.9688	0.9284	0.0084	0.7317	0.8306	0.3598	0.8491	0.8863	0.0167	0.8004	0.894	0.8516	0.895	0.8268	0.8931	0.8067	0.8747	0.817	0.8841	0.8182	0.8847
0.4204	46.0	10534	0.3656	0.8462	0.974	0.9396	0.0	0.7568	0.8524	0.3682	0.8649	0.9007	0.0	0.8266	0.9073	0.8657	0.9099	0.8506	0.9074	0.8161	0.8809	0.8292	0.8877	0.8694	0.9175
0.4204	47.0	10763	0.3758	0.8349	0.9718	0.9392	0.0	0.7035	0.8459	0.368	0.855	0.8913	0.0	0.7802	0.9019	0.8541	0.8991	0.8451	0.8987	0.8029	0.8726	0.8283	0.886	0.8443	0.9
0.4204	48.0	10992	0.3809	0.8353	0.9678	0.9295	0.0118	0.7351	0.8425	0.3663	0.857	0.893	0.05	0.8026	0.9015	0.8607	0.9038	0.8356	0.8969	0.7936	0.8686	0.8459	0.8983	0.8406	0.8972
0.3935	49.0	11221	0.3698	0.8474	0.9735	0.9409	-1.0	0.7592	0.8521	0.3697	0.8651	0.9015	-1.0	0.8194	0.9087	0.8689	0.9079	0.858	0.9095	0.8152	0.8836	0.8403	0.8993	0.8546	0.9072
0.3935	50.0	11450	0.3514	0.8575	0.9736	0.9426	-1.0	0.7425	0.8654	0.374	0.8699	0.9073	-1.0	0.8195	0.9155	0.8727	0.911	0.8644	0.9151	0.8218	0.8843	0.8571	0.9039	0.8714	0.9225
0.3968	51.0	11679	0.3494	0.8593	0.9771	0.9505	0.0	0.7601	0.8679	0.3719	0.8711	0.9076	0.0	0.8205	0.9161	0.8777	0.914	0.861	0.9132	0.8315	0.8882	0.8538	0.9022	0.8727	0.9202
0.3968	52.0	11908	0.3445	0.8562	0.9765	0.9461	0.0	0.7603	0.8639	0.3721	0.8684	0.9052	0.0	0.8178	0.9136	0.8709	0.9081	0.8565	0.9057	0.8201	0.8807	0.8635	0.9106	0.8698	0.921
0.3821	53.0	12137	0.3250	0.8633	0.9803	0.9565	0.0	0.7553	0.873	0.3764	0.8752	0.9117	0.0	0.8214	0.9208	0.8715	0.9119	0.8656	0.9148	0.8328	0.893	0.8728	0.9166	0.8738	0.9221
0.3821	54.0	12366	0.3107	0.875	0.9819	0.9631	0.5	0.775	0.8823	0.3779	0.8859	0.9192	0.5	0.8342	0.9269	0.884	0.9199	0.8872	0.9289	0.8457	0.8988	0.8765	0.9205	0.8814	0.9279
0.3697	55.0	12595	0.3092	0.8724	0.9804	0.9569	0.0125	0.7686	0.8796	0.3769	0.8803	0.9152	0.05	0.8259	0.923	0.8804	0.9167	0.8782	0.9198	0.8347	0.8895	0.8778	0.9195	0.8907	0.9305
0.3697	56.0	12824	0.3221	0.865	0.9815	0.9558	0.0	0.7603	0.8733	0.3748	0.8764	0.9117	0.0	0.8283	0.9199	0.8776	0.9166	0.8651	0.9133	0.8387	0.8942	0.8605	0.9114	0.883	0.923
0.3658	57.0	13053	0.3189	0.8614	0.9765	0.952	0.0	0.744	0.8687	0.3718	0.8728	0.9055	0.0	0.7956	0.9155	0.883	0.9187	0.8745	0.9148	0.8342	0.8899	0.8478	0.8961	0.8672	0.9077
0.3658	58.0	13282	0.3202	0.8636	0.9787	0.9492	0.0167	0.7338	0.8732	0.3733	0.8727	0.9082	0.0333	0.8006	0.918	0.8787	0.9145	0.8703	0.9139	0.8363	0.8902	0.8577	0.9053	0.8747	0.9173
0.3469	59.0	13511	0.3084	0.8795	0.9815	0.957	0.0	0.7775	0.8865	0.3786	0.8846	0.9188	0.0	0.8365	0.9258	0.8897	0.9219	0.8825	0.9237	0.8477	0.8984	0.8844	0.9217	0.8933	0.928
0.3469	60.0	13740	0.3030	0.8802	0.982	0.9588	0.0269	0.7834	0.8881	0.3799	0.8839	0.9186	0.1333	0.8397	0.926	0.893	0.9249	0.8857	0.9241	0.8494	0.9001	0.8859	0.9195	0.8869	0.9243
0.3469	61.0	13969	0.3030	0.8778	0.983	0.964	0.0071	0.7856	0.8853	0.3808	0.8833	0.9177	0.05	0.8419	0.9246	0.884	0.9182	0.8816	0.9221	0.8455	0.8948	0.8868	0.9239	0.891	0.9298
0.3303	62.0	14198	0.3037	0.8785	0.9819	0.9582	0.0024	0.7757	0.8866	0.3783	0.8847	0.919	0.0333	0.8334	0.9269	0.8897	0.9227	0.8862	0.9257	0.8444	0.8991	0.8717	0.913	0.9007	0.9344
0.3303	63.0	14427	0.2819	0.8859	0.9829	0.9624	0.0	0.7911	0.8923	0.3813	0.8888	0.9229	0.0	0.847	0.9297	0.8949	0.925	0.8976	0.9325	0.8558	0.9084	0.8822	0.9164	0.8988	0.932
0.3278	64.0	14656	0.2771	0.8886	0.9878	0.9668	0.0	0.8116	0.8935	0.3804	0.8916	0.9256	0.0	0.8659	0.9311	0.8912	0.9234	0.8903	0.9275	0.8564	0.9065	0.8982	0.9316	0.9071	0.9388
0.3278	65.0	14885	0.2647	0.8869	0.9805	0.961	0.0	0.7776	0.8956	0.3814	0.8904	0.9236	0.0	0.8299	0.9323	0.8997	0.9306	0.9027	0.9357	0.8565	0.9077	0.8827	0.92	0.8928	0.9242
0.3251	66.0	15114	0.2738	0.8856	0.9815	0.9598	0.0	0.8047	0.893	0.3808	0.8898	0.9219	0.0	0.8593	0.9286	0.9009	0.9303	0.8936	0.9269	0.8504	0.9014	0.8972	0.9314	0.8858	0.9193
0.3251	67.0	15343	0.2822	0.892	0.9846	0.9658	0.0126	0.8003	0.9007	0.3816	0.8941	0.9282	0.0125	0.8611	0.9352	0.8977	0.9294	0.8929	0.9286	0.8681	0.915	0.8899	0.9265	0.9112	0.9417
0.3013	68.0	15572	0.2507	0.8976	0.9867	0.9696	0.0	0.8044	0.9054	0.3832	0.8975	0.9315	0.0	0.857	0.939	0.9076	0.9355	0.9059	0.9371	0.8672	0.9138	0.8885	0.9224	0.9187	0.9487
0.3013	69.0	15801	0.2612	0.893	0.9817	0.9624	0.0	0.7973	0.9006	0.3835	0.8937	0.9269	0.0	0.8556	0.934	0.9004	0.9302	0.9028	0.9359	0.8654	0.9148	0.9026	0.934	0.8935	0.9199
0.304	70.0	16030	0.2574	0.8952	0.9861	0.9674	0.0	0.8081	0.9022	0.3818	0.8942	0.9291	0.0	0.8607	0.9359	0.9026	0.9315	0.9017	0.9339	0.8629	0.91	0.8928	0.9267	0.9159	0.9432
0.304	71.0	16259	0.2560	0.9046	0.9867	0.9742	0.0	0.8298	0.9113	0.3859	0.9039	0.9375	0.0	0.8826	0.943	0.9075	0.9358	0.9111	0.9415	0.881	0.9258	0.9036	0.9376	0.9198	0.9467
0.304	72.0	16488	0.2442	0.903	0.987	0.9698	0.0034	0.8363	0.9081	0.3847	0.9018	0.9352	0.0167	0.8818	0.9404	0.9112	0.9385	0.9058	0.938	0.8752	0.9186	0.9004	0.9335	0.9226	0.9475
0.3017	73.0	16717	0.2676	0.8941	0.9846	0.9587	0.0084	0.8202	0.8994	0.3801	0.8937	0.9293	0.0083	0.87	0.9359	0.9087	0.937	0.8989	0.9333	0.8619	0.9114	0.884	0.9229	0.9169	0.9419
0.3017	74.0	16946	0.2373	0.903	0.9862	0.9702	0.0	0.7937	0.9116	0.3851	0.8997	0.9344	0.0	0.8474	0.9419	0.9126	0.9385	0.9112	0.9396	0.8675	0.9163	0.9068	0.9337	0.917	0.9439
0.2849	75.0	17175	0.2357	0.9066	0.987	0.9718	0.0	0.8228	0.9138	0.388	0.9034	0.9373	0.0	0.8698	0.9439	0.9141	0.9398	0.9108	0.9387	0.8752	0.9183	0.9063	0.9386	0.9265	0.9513
0.2849	76.0	17404	0.2351	0.9061	0.986	0.9681	0.1346	0.8157	0.9135	0.3849	0.9031	0.9369	0.325	0.8683	0.9434	0.91	0.9381	0.9141	0.9436	0.8761	0.9196	0.905	0.9299	0.9252	0.9531
0.2899	77.0	17633	0.2298	0.9137	0.9872	0.9734	0.0	0.8293	0.9202	0.3871	0.9096	0.9434	0.0	0.8766	0.9497	0.9192	0.9454	0.9188	0.9461	0.8862	0.9286	0.9181	0.9422	0.926	0.955
0.2899	78.0	17862	0.2373	0.9104	0.9886	0.9733	0.35	0.8262	0.9174	0.3891	0.9066	0.9403	0.35	0.8769	0.9464	0.9096	0.937	0.9154	0.9429	0.8764	0.9227	0.9166	0.9439	0.9342	0.9552
0.2693	79.0	18091	0.2322	0.9124	0.9879	0.9708	0.0	0.8266	0.9192	0.3883	0.9064	0.9413	0.0	0.8753	0.9479	0.9163	0.9405	0.9172	0.9445	0.872	0.9175	0.9235	0.9467	0.933	0.957
0.2693	80.0	18320	0.2238	0.9089	0.9866	0.9742	0.0	0.8083	0.917	0.3856	0.9059	0.9396	0.0	0.8627	0.947	0.9136	0.9396	0.9164	0.9438	0.8796	0.9245	0.9116	0.9402	0.9232	0.9498
0.2788	81.0	18549	0.2170	0.9152	0.9886	0.972	0.0	0.8325	0.9226	0.3876	0.9096	0.9429	0.0	0.8803	0.9496	0.9193	0.9439	0.9149	0.9416	0.8833	0.9238	0.9195	0.9448	0.9388	0.9605
0.2788	82.0	18778	0.2155	0.9176	0.989	0.9729	0.015	0.8253	0.9246	0.3904	0.9117	0.9457	0.0444	0.8758	0.9526	0.9229	0.9477	0.9203	0.9455	0.8828	0.9266	0.9315	0.953	0.9304	0.9554
0.2722	83.0	19007	0.2300	0.9146	0.9869	0.9712	0.0833	0.8085	0.9234	0.39	0.9095	0.9426	0.1667	0.8611	0.9506	0.9219	0.9469	0.9209	0.9486	0.8859	0.925	0.9125	0.9414	0.9317	0.951
0.2722	84.0	19236	0.2123	0.9149	0.9883	0.9744	0.0	0.8187	0.9234	0.3888	0.9085	0.9431	0.0	0.8665	0.9504	0.9188	0.9437	0.9197	0.9461	0.8905	0.9296	0.9228	0.9482	0.9228	0.9482
0.2722	85.0	19465	0.2406	0.9132	0.9883	0.9684	0.0	0.8322	0.9192	0.3888	0.9084	0.9419	0.0	0.8782	0.9479	0.9134	0.9384	0.9185	0.9455	0.8773	0.9221	0.9225	0.9473	0.9343	0.9562
0.2645	86.0	19694	0.2162	0.9146	0.9872	0.9708	0.0	0.8075	0.9233	0.3889	0.9099	0.9428	0.0	0.8611	0.9508	0.9178	0.9423	0.9216	0.9457	0.8741	0.9202	0.9291	0.9531	0.9305	0.9525
0.2645	87.0	19923	0.2313	0.9084	0.9867	0.9664	0.021	0.8051	0.9165	0.3869	0.9034	0.9375	0.0208	0.8589	0.9457	0.9137	0.9389	0.9103	0.9395	0.8742	0.9172	0.9104	0.9367	0.9335	0.9551
0.2632	88.0	20152	0.2140	0.9193	0.9901	0.9727	0.0	0.816	0.9281	0.3899	0.9123	0.9467	0.0	0.8733	0.9544	0.9199	0.9447	0.9223	0.9469	0.8829	0.9278	0.9297	0.9547	0.9416	0.9594
0.2632	89.0	20381	0.2108	0.9206	0.9908	0.976	0.0063	0.8369	0.9282	0.391	0.9129	0.947	0.05	0.8829	0.9536	0.9238	0.9483	0.9253	0.9497	0.8896	0.9292	0.9271	0.9495	0.937	0.9586
0.2558	90.0	20610	0.2074	0.9226	0.9892	0.9725	0.0	0.8464	0.928	0.3893	0.9148	0.9487	0.0	0.891	0.9539	0.9259	0.949	0.925	0.9484	0.8913	0.9325	0.9404	0.961	0.9306	0.9526
0.2558	91.0	20839	0.2065	0.9177	0.9878	0.9746	0.0	0.8105	0.9259	0.3885	0.9111	0.9445	0.0	0.8607	0.9517	0.9222	0.9467	0.9217	0.9486	0.8915	0.9302	0.9299	0.9499	0.9234	0.9473
0.265	92.0	21068	0.2300	0.9179	0.9868	0.9712	0.0097	0.8343	0.9248	0.389	0.9108	0.9445	0.0188	0.8792	0.9513	0.9164	0.9403	0.9173	0.9422	0.8884	0.9269	0.9373	0.9595	0.9301	0.9537
0.265	93.0	21297	0.2123	0.917	0.9855	0.971	0.0	0.8412	0.923	0.3896	0.9118	0.9435	0.0	0.8862	0.949	0.9235	0.9473	0.925	0.9516	0.8916	0.9309	0.9297	0.9518	0.9151	0.936
0.2552	94.0	21526	0.2158	0.9163	0.9871	0.9692	0.025	0.8201	0.9236	0.3899	0.9089	0.9439	0.1	0.873	0.9505	0.9188	0.9427	0.9236	0.9469	0.8851	0.9264	0.9271	0.9531	0.9271	0.9506
0.2552	95.0	21755	0.2067	0.9214	0.988	0.9719	0.0	0.8358	0.9286	0.39	0.9138	0.9476	0.0	0.8828	0.9537	0.9278	0.9507	0.9285	0.9518	0.8957	0.9347	0.9325	0.9538	0.9228	0.9471
0.2552	96.0	21984	0.2016	0.9214	0.9878	0.975	0.0	0.8237	0.9293	0.3906	0.9143	0.9484	0.0	0.8765	0.9548	0.926	0.9492	0.9283	0.9538	0.8922	0.9316	0.9259	0.9513	0.9345	0.9559
0.2594	97.0	22213	0.2237	0.9166	0.9877	0.972	0.0333	0.83	0.9224	0.3894	0.9092	0.9447	0.2	0.8798	0.9506	0.9183	0.9446	0.9215	0.9472	0.8878	0.9291	0.9204	0.9484	0.9348	0.9545
0.2594	98.0	22442	0.2155	0.9158	0.9867	0.9685	0.0	0.8188	0.9233	0.3865	0.9102	0.9434	0.0	0.8684	0.9503	0.9268	0.9478	0.9204	0.9479	0.885	0.9271	0.9187	0.9419	0.928	0.9523
0.2586	99.0	22671	0.2212	0.918	0.9888	0.9709	0.0333	0.833	0.9245	0.39	0.9105	0.9444	0.1	0.8802	0.9506	0.9185	0.9424	0.927	0.9502	0.8793	0.9223	0.9301	0.9513	0.9351	0.9558
0.2586	100.0	22900	0.2233	0.9186	0.9888	0.9702	0.0168	0.8326	0.9267	0.39	0.9118	0.9461	0.0167	0.883	0.953	0.9208	0.9447	0.9227	0.9476	0.8797	0.9232	0.93	0.9552	0.94	0.9599

Framework versions

• Transformers 4.42.3
• Pytorch 2.3.1+cu121
• Datasets 2.20.0
• Tokenizers 0.19.1