run_20240702210535

This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.3214
• Precision: 0.6028
• Recall: 0.6325
• F1: 0.6173
• Number: 237046
• Ageno Precision: 0.8230
• Ageno Recall: 0.8335
• Ageno F1: 0.8282
• Ageno Number: 8131
• Ank Account/bic Precision: 0.9559
• Ank Account/bic Recall: 0.9753
• Ank Account/bic F1: 0.9655
• Ank Account/bic Number: 50290
• Ank Account/iban Precision: 0.8894
• Ank Account/iban Recall: 0.9289
• Ank Account/iban F1: 0.9087
• Ank Account/iban Number: 84619
• Ank Account/bankinfo Precision: 0.7777
• Ank Account/bankinfo Recall: 0.8063
• Ank Account/bankinfo F1: 0.7917
• Ank Account/bankinfo Number: 36138
• Ank Account/currencycode Precision: 0.7507
• Ank Account/currencycode Recall: 0.3748
• Ank Account/currencycode F1: 0.5
• Ank Account/currencycode Number: 1374
• Ardnumber Precision: 0.3289
• Ardnumber Recall: 0.3175
• Ardnumber F1: 0.3231
• Ardnumber Number: 929
• Ardtype Precision: 0.5436
• Ardtype Recall: 0.5444
• Ardtype F1: 0.5440
• Ardtype Number: 3821
• Axamount Precision: 0.7977
• Axamount Recall: 0.7972
• Axamount F1: 0.7975
• Axamount Number: 5302
• Eservationnumber Precision: 0.4791
• Eservationnumber Recall: 0.5078
• Eservationnumber F1: 0.4930
• Eservationnumber Number: 2568
• Etamount Precision: 0.7795
• Etamount Recall: 0.7792
• Etamount F1: 0.7794
• Etamount Number: 6299
• Heckin Precision: 0.9099
• Heckin Recall: 0.9260
• Heckin F1: 0.9179
• Heckin Number: 17115
• Heckout Precision: 0.9203
• Heckout Recall: 0.9320
• Heckout F1: 0.9261
• Heckout Number: 17016
• Nvoicedate Precision: 0.9084
• Nvoicedate Recall: 0.9204
• Nvoicedate F1: 0.9144
• Nvoicedate Number: 14899
• Nvoicenumber Precision: 0.8595
• Nvoicenumber Recall: 0.8827
• Nvoicenumber F1: 0.8710
• Nvoicenumber Number: 14479
• Ocumenttype Precision: 0.7821
• Ocumenttype Recall: 0.8193
• Ocumenttype F1: 0.8003
• Ocumenttype Number: 13966
• Ompanyaddress Precision: 0.7657
• Ompanyaddress Recall: 0.7917
• Ompanyaddress F1: 0.7785
• Ompanyaddress Number: 15201
• Ompanycity Precision: 0.8504
• Ompanycity Recall: 0.8760
• Ompanycity F1: 0.8630
• Ompanycity Number: 14804
• Ompanycountry Precision: 0.8759
• Ompanycountry Recall: 0.8851
• Ompanycountry F1: 0.8805
• Ompanycountry Number: 9011
• Ompanyname Precision: 0.6986
• Ompanyname Recall: 0.7240
• Ompanyname F1: 0.7111
• Ompanyname Number: 15233
• Ompanyvatnumber Precision: 0.6079
• Ompanyvatnumber Recall: 0.6684
• Ompanyvatnumber F1: 0.6367
• Ompanyvatnumber Number: 3474
• Ompanyzipcode Precision: 0.9190
• Ompanyzipcode Recall: 0.9434
• Ompanyzipcode F1: 0.9310
• Ompanyzipcode Number: 14770
• Ookingnumber Precision: 0.4084
• Ookingnumber Recall: 0.3214
• Ookingnumber F1: 0.3597
• Ookingnumber Number: 2156
• Oomno Precision: 0.8351
• Oomno Recall: 0.8537
• Oomno F1: 0.8443
• Oomno Number: 17347
• Oteladdress Precision: 0.4710
• Oteladdress Recall: 0.5188
• Oteladdress F1: 0.4937
• Oteladdress Number: 14199
• Otelbankaccount Precision: 0.0
• Otelbankaccount Recall: 0.0
• Otelbankaccount F1: 0.0
• Otelbankaccount Number: 73
• Otelcity Precision: 0.6779
• Otelcity Recall: 0.7343
• Otelcity F1: 0.7050
• Otelcity Number: 13694
• Otelcountry Precision: 0.7598
• Otelcountry Recall: 0.7686
• Otelcountry F1: 0.7642
• Otelcountry Number: 3358
• Otelemail Precision: 0.8933
• Otelemail Recall: 0.9382
• Otelemail F1: 0.9152
• Otelemail Number: 10425
• Otelfaxnumber Precision: 0.8234
• Otelfaxnumber Recall: 0.8668
• Otelfaxnumber F1: 0.8446
• Otelfaxnumber Number: 7689
• Otelname Precision: 0.3599
• Otelname Recall: 0.3987
• Otelname F1: 0.3783
• Otelname Number: 14855
• Otelphonenumber Precision: 0.8023
• Otelphonenumber Recall: 0.8373
• Otelphonenumber F1: 0.8194
• Otelphonenumber Number: 11808
• Oteltaxcode Precision: 0.4169
• Oteltaxcode Recall: 0.4602
• Oteltaxcode F1: 0.4375
• Oteltaxcode Number: 2338
• Otelvatnumber Precision: 0.6870
• Otelvatnumber Recall: 0.7394
• Otelvatnumber F1: 0.7122
• Otelvatnumber Number: 9094
• Otelzipcode Precision: 0.7230
• Otelzipcode Recall: 0.7776
• Otelzipcode F1: 0.7493
• Otelzipcode Number: 13620
• Rafficdate Precision: 0.0
• Rafficdate Recall: 0.0
• Rafficdate F1: 0.0
• Rafficdate Number: 106
• Ravellername Precision: 0.5621
• Ravellername Recall: 0.5663
• Ravellername F1: 0.5642
• Ravellername Number: 17893
• Rewtype Precision: 0.0
• Rewtype Recall: 0.0
• Rewtype F1: 0.0
• Rewtype Number: 56
• Rossamount Precision: 0.7012
• Rossamount Recall: 0.7258
• Rossamount F1: 0.7133
• Rossamount Number: 12491
• Rrivaltrainno Precision: 0.1818
• Rrivaltrainno Recall: 0.0494
• Rrivaltrainno F1: 0.0777
• Rrivaltrainno Number: 81
• Urrencycode Precision: 0.5212
• Urrencycode Recall: 0.5927
• Urrencycode F1: 0.5547
• Urrencycode Number: 8510
• Xternalreservationnumber Precision: 0.3103
• Xternalreservationnumber Recall: 0.3205
• Xternalreservationnumber F1: 0.3153
• Xternalreservationnumber Number: 546
• Overall Precision: 0.7298
• Overall Recall: 0.7596
• Overall F1: 0.7444
• Overall Accuracy: 0.9298

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Number	Ageno Precision	Ageno Recall	Ageno F1	Ageno Number	Ank Account/bic Precision	Ank Account/bic Recall	Ank Account/bic F1	Ank Account/bic Number	Ank Account/iban Precision	Ank Account/iban Recall	Ank Account/iban F1	Ank Account/iban Number	Ank Account/bankinfo Precision	Ank Account/bankinfo Recall	Ank Account/bankinfo F1	Ank Account/bankinfo Number	Ank Account/currencycode Precision	Ank Account/currencycode Recall	Ank Account/currencycode F1	Ank Account/currencycode Number	Ardnumber Precision	Ardnumber Recall	Ardnumber F1	Ardnumber Number	Ardtype Precision	Ardtype Recall	Ardtype F1	Ardtype Number	Axamount Precision	Axamount Recall	Axamount F1	Axamount Number	Eservationnumber Precision	Eservationnumber Recall	Eservationnumber F1	Eservationnumber Number	Etamount Precision	Etamount Recall	Etamount F1	Etamount Number	Heckin Precision	Heckin Recall	Heckin F1	Heckin Number	Heckout Precision	Heckout Recall	Heckout F1	Heckout Number	Nvoicedate Precision	Nvoicedate Recall	Nvoicedate F1	Nvoicedate Number	Nvoicenumber Precision	Nvoicenumber Recall	Nvoicenumber F1	Nvoicenumber Number	Ocumenttype Precision	Ocumenttype Recall	Ocumenttype F1	Ocumenttype Number	Ompanyaddress Precision	Ompanyaddress Recall	Ompanyaddress F1	Ompanyaddress Number	Ompanycity Precision	Ompanycity Recall	Ompanycity F1	Ompanycity Number	Ompanycountry Precision	Ompanycountry Recall	Ompanycountry F1	Ompanycountry Number	Ompanyname Precision	Ompanyname Recall	Ompanyname F1	Ompanyname Number	Ompanyvatnumber Precision	Ompanyvatnumber Recall	Ompanyvatnumber F1	Ompanyvatnumber Number	Ompanyzipcode Precision	Ompanyzipcode Recall	Ompanyzipcode F1	Ompanyzipcode Number	Ookingnumber Precision	Ookingnumber Recall	Ookingnumber F1	Ookingnumber Number	Oomno Precision	Oomno Recall	Oomno F1	Oomno Number	Oteladdress Precision	Oteladdress Recall	Oteladdress F1	Oteladdress Number	Otelbankaccount Precision	Otelbankaccount Recall	Otelbankaccount F1	Otelbankaccount Number	Otelcity Precision	Otelcity Recall	Otelcity F1	Otelcity Number	Otelcountry Precision	Otelcountry Recall	Otelcountry F1	Otelcountry Number	Otelemail Precision	Otelemail Recall	Otelemail F1	Otelemail Number	Otelfaxnumber Precision	Otelfaxnumber Recall	Otelfaxnumber F1	Otelfaxnumber Number	Otelname Precision	Otelname Recall	Otelname F1	Otelname Number	Otelphonenumber Precision	Otelphonenumber Recall	Otelphonenumber F1	Otelphonenumber Number	Oteltaxcode Precision	Oteltaxcode Recall	Oteltaxcode F1	Oteltaxcode Number	Otelvatnumber Precision	Otelvatnumber Recall	Otelvatnumber F1	Otelvatnumber Number	Otelzipcode Precision	Otelzipcode Recall	Otelzipcode F1	Otelzipcode Number	Rafficdate Precision	Rafficdate Recall	Rafficdate F1	Rafficdate Number	Ravellername Precision	Ravellername Recall	Ravellername F1	Ravellername Number	Rewtype Precision	Rewtype Recall	Rewtype F1	Rewtype Number	Rossamount Precision	Rossamount Recall	Rossamount F1	Rossamount Number	Rrivaltrainno Precision	Rrivaltrainno Recall	Rrivaltrainno F1	Rrivaltrainno Number	Urrencycode Precision	Urrencycode Recall	Urrencycode F1	Urrencycode Number	Xternalreservationnumber Precision	Xternalreservationnumber Recall	Xternalreservationnumber F1	Xternalreservationnumber Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.1284	1.0	9028	0.2249	0.6051	0.6381	0.6212	237046	0.8298	0.8486	0.8391	8131	0.9500	0.9829	0.9661	50290	0.8675	0.9672	0.9147	84619	0.7426	0.8671	0.8000	36138	0.7634	0.2278	0.3509	1374	0.4002	0.4273	0.4133	929	0.4746	0.6053	0.5320	3821	0.7542	0.7993	0.7761	5302	0.5823	0.5234	0.5513	2568	0.7222	0.7484	0.7351	6299	0.8997	0.9417	0.9202	17115	0.8939	0.9516	0.9219	17016	0.9084	0.9411	0.9245	14899	0.8265	0.9056	0.8643	14479	0.7735	0.8466	0.8084	13966	0.7846	0.8053	0.7949	15201	0.8367	0.8781	0.8569	14804	0.8513	0.8905	0.8704	9011	0.7246	0.7488	0.7365	15233	0.5700	0.7029	0.6295	3474	0.9078	0.9416	0.9244	14770	0.4890	0.2880	0.3625	2156	0.8005	0.8676	0.8327	17347	0.5074	0.5322	0.5195	14199	0.0	0.0	0.0	73	0.6766	0.7324	0.7034	13694	0.7753	0.7335	0.7538	3358	0.8659	0.9431	0.9028	10425	0.8095	0.8758	0.8413	7689	0.3709	0.3988	0.3843	14855	0.8148	0.8661	0.8397	11808	0.4123	0.4808	0.4439	2338	0.6639	0.7497	0.7042	9094	0.7285	0.7670	0.7473	13620	0.0	0.0	0.0	106	0.5650	0.5714	0.5682	17893	0.0	0.0	0.0	56	0.6678	0.7477	0.7055	12491	0.0	0.0	0.0	81	0.5382	0.5533	0.5457	8510	0.2434	0.3370	0.2826	546	0.7255	0.7735	0.7487	0.9302
0.0949	2.0	18056	0.2538	0.6162	0.6452	0.6303	237046	0.8405	0.8458	0.8431	8131	0.9490	0.9812	0.9649	50290	0.8735	0.9649	0.9170	84619	0.7396	0.8769	0.8024	36138	0.6905	0.3719	0.4834	1374	0.4151	0.3897	0.4020	929	0.5313	0.5258	0.5285	3821	0.8081	0.7988	0.8034	5302	0.5410	0.5191	0.5298	2568	0.7758	0.7496	0.7625	6299	0.8919	0.9457	0.9180	17115	0.9044	0.9463	0.9249	17016	0.9129	0.9350	0.9238	14899	0.8430	0.8905	0.8661	14479	0.7821	0.8443	0.8120	13966	0.7772	0.8112	0.7938	15201	0.8387	0.8730	0.8555	14804	0.8723	0.8940	0.8830	9011	0.7337	0.7492	0.7414	15233	0.5927	0.7637	0.6674	3474	0.9079	0.9436	0.9254	14770	0.4455	0.3827	0.4117	2156	0.8238	0.8998	0.8601	17347	0.5073	0.5811	0.5417	14199	0.0	0.0	0.0	73	0.6748	0.7625	0.7159	13694	0.7798	0.7719	0.7758	3358	0.8900	0.9372	0.9130	10425	0.8245	0.8796	0.8511	7689	0.3752	0.4187	0.3958	14855	0.8101	0.8608	0.8347	11808	0.3970	0.3867	0.3918	2338	0.6857	0.7671	0.7241	9094	0.7172	0.8081	0.7600	13620	0.0	0.0	0.0	106	0.5803	0.6002	0.5901	17893	0.0	0.0	0.0	56	0.6878	0.7319	0.7091	12491	0.0	0.0	0.0	81	0.5058	0.6246	0.5589	8510	0.2834	0.2601	0.2713	546	0.7320	0.7803	0.7554	0.9309
0.0782	3.0	27084	0.2606	0.6117	0.6390	0.6250	237046	0.8184	0.8262	0.8223	8131	0.9502	0.9816	0.9657	50290	0.8877	0.9201	0.9036	84619	0.7477	0.8500	0.7955	36138	0.5903	0.3282	0.4219	1374	0.3621	0.4241	0.3907	929	0.5362	0.5972	0.5651	3821	0.8191	0.8059	0.8124	5302	0.4764	0.5350	0.5040	2568	0.7917	0.7520	0.7714	6299	0.9026	0.9322	0.9172	17115	0.9173	0.9306	0.9239	17016	0.9072	0.9280	0.9175	14899	0.8581	0.8802	0.8690	14479	0.7958	0.8043	0.8000	13966	0.7862	0.8067	0.7963	15201	0.8454	0.8715	0.8583	14804	0.8700	0.8935	0.8816	9011	0.7315	0.7457	0.7385	15233	0.6142	0.7260	0.6654	3474	0.9243	0.9458	0.9349	14770	0.4591	0.3200	0.3772	2156	0.8301	0.8991	0.8632	17347	0.5019	0.5571	0.5281	14199	0.0	0.0	0.0	73	0.6794	0.7505	0.7132	13694	0.7549	0.7731	0.7639	3358	0.8898	0.9406	0.9145	10425	0.8262	0.8744	0.8496	7689	0.3755	0.4342	0.4027	14855	0.8130	0.8565	0.8342	11808	0.4039	0.4880	0.4420	2338	0.6806	0.7690	0.7221	9094	0.7218	0.7937	0.7560	13620	0.0	0.0	0.0	106	0.5664	0.5833	0.5747	17893	0.0	0.0	0.0	56	0.7069	0.7203	0.7135	12491	0.0	0.0	0.0	81	0.5185	0.6040	0.5580	8510	0.2916	0.2985	0.2950	546	0.7324	0.7688	0.7501	0.9298
0.0694	4.0	36112	0.2742	0.6140	0.6404	0.6269	237046	0.8279	0.8427	0.8353	8131	0.9584	0.9779	0.9681	50290	0.8788	0.9550	0.9153	84619	0.7570	0.8489	0.8003	36138	0.6154	0.3726	0.4642	1374	0.3753	0.3079	0.3383	929	0.5500	0.5472	0.5486	3821	0.8143	0.8046	0.8094	5302	0.4958	0.5502	0.5216	2568	0.7635	0.7820	0.7726	6299	0.8950	0.9375	0.9158	17115	0.9195	0.9421	0.9307	17016	0.9184	0.9130	0.9157	14899	0.8473	0.8920	0.8691	14479	0.7910	0.8237	0.8070	13966	0.7911	0.8068	0.7989	15201	0.8482	0.8748	0.8613	14804	0.8821	0.8880	0.8850	9011	0.7338	0.7524	0.7430	15233	0.6135	0.7268	0.6653	3474	0.9229	0.9471	0.9348	14770	0.4395	0.3353	0.3804	2156	0.8377	0.8575	0.8475	17347	0.5023	0.5608	0.5299	14199	0.0	0.0	0.0	73	0.6818	0.7411	0.7102	13694	0.7758	0.7624	0.7690	3358	0.8859	0.9463	0.9151	10425	0.8254	0.8763	0.8501	7689	0.3629	0.4012	0.3811	14855	0.8099	0.8589	0.8337	11808	0.4079	0.4179	0.4128	2338	0.6814	0.7562	0.7168	9094	0.7155	0.7878	0.7499	13620	0.0	0.0	0.0	106	0.5795	0.5858	0.5826	17893	0.0	0.0	0.0	56	0.7074	0.7414	0.7240	12491	0.1667	0.0123	0.0230	81	0.5150	0.6221	0.5635	8510	0.3077	0.1832	0.2296	546	0.7348	0.7723	0.7531	0.9304
0.0611	5.0	45140	0.2882	0.6023	0.6380	0.6197	237046	0.8333	0.8466	0.8399	8131	0.9550	0.9796	0.9671	50290	0.8793	0.9514	0.9139	84619	0.7702	0.8053	0.7873	36138	0.6968	0.3362	0.4536	1374	0.3502	0.3423	0.3462	929	0.5616	0.5357	0.5484	3821	0.7968	0.8084	0.8025	5302	0.4867	0.5257	0.5054	2568	0.7753	0.7809	0.7781	6299	0.8936	0.9431	0.9177	17115	0.9145	0.9476	0.9307	17016	0.9093	0.9276	0.9184	14899	0.8563	0.8794	0.8677	14479	0.7865	0.8224	0.8041	13966	0.7796	0.8055	0.7924	15201	0.8437	0.8769	0.8600	14804	0.8774	0.8936	0.8854	9011	0.7129	0.7315	0.7221	15233	0.6146	0.6894	0.6498	3474	0.9177	0.9469	0.9320	14770	0.4048	0.3905	0.3975	2156	0.8147	0.8874	0.8495	17347	0.4697	0.5330	0.4993	14199	0.0167	0.0137	0.0150	73	0.6612	0.7259	0.6921	13694	0.7438	0.7832	0.7630	3358	0.8861	0.9432	0.9138	10425	0.8241	0.8813	0.8517	7689	0.3579	0.3929	0.3746	14855	0.8134	0.8595	0.8358	11808	0.4019	0.3888	0.3952	2338	0.6700	0.7726	0.7176	9094	0.7078	0.7703	0.7377	13620	0.0	0.0	0.0	106	0.5627	0.5884	0.5752	17893	0.0	0.0	0.0	56	0.6969	0.7388	0.7172	12491	0.0833	0.0123	0.0215	81	0.5232	0.5875	0.5535	8510	0.3384	0.2033	0.2540	546	0.7275	0.7683	0.7473	0.9289
0.0553	6.0	54168	0.3093	0.6089	0.6331	0.6207	237046	0.8358	0.8460	0.8409	8131	0.9535	0.9790	0.9660	50290	0.8810	0.9473	0.9130	84619	0.7619	0.8295	0.7942	36138	0.7952	0.3588	0.4945	1374	0.3539	0.3574	0.3557	929	0.5173	0.5708	0.5427	3821	0.7957	0.8005	0.7980	5302	0.4793	0.5549	0.5143	2568	0.7789	0.7742	0.7766	6299	0.9099	0.9173	0.9136	17115	0.9204	0.9266	0.9235	17016	0.9095	0.9170	0.9132	14899	0.8601	0.8832	0.8715	14479	0.7790	0.8266	0.8021	13966	0.7831	0.8054	0.7941	15201	0.8500	0.8801	0.8648	14804	0.8702	0.8956	0.8827	9011	0.7089	0.7308	0.7197	15233	0.6191	0.6635	0.6405	3474	0.9154	0.9443	0.9296	14770	0.3951	0.3660	0.3800	2156	0.8354	0.8543	0.8447	17347	0.4847	0.5319	0.5072	14199	0.0	0.0	0.0	73	0.6816	0.7360	0.7078	13694	0.7452	0.7707	0.7577	3358	0.8872	0.9373	0.9116	10425	0.8264	0.8736	0.8493	7689	0.3592	0.3978	0.3775	14855	0.8103	0.8536	0.8314	11808	0.4039	0.4196	0.4116	2338	0.6838	0.7559	0.7181	9094	0.7153	0.7747	0.7438	13620	0.0	0.0	0.0	106	0.5742	0.5826	0.5784	17893	0.0	0.0	0.0	56	0.7049	0.7295	0.7170	12491	0.125	0.0247	0.0412	81	0.5273	0.5794	0.5522	8510	0.3026	0.3187	0.3104	546	0.7317	0.7651	0.7480	0.9291
0.0479	7.0	63196	0.3174	0.6063	0.6329	0.6193	237046	0.8272	0.8409	0.8340	8131	0.9548	0.9760	0.9652	50290	0.8877	0.9305	0.9086	84619	0.7774	0.8091	0.7929	36138	0.7544	0.3755	0.5015	1374	0.3398	0.3402	0.3400	929	0.5445	0.5391	0.5418	3821	0.7955	0.7954	0.7954	5302	0.4725	0.5315	0.5003	2568	0.7750	0.7741	0.7745	6299	0.9077	0.9259	0.9167	17115	0.9165	0.9339	0.9252	17016	0.9098	0.9213	0.9155	14899	0.8606	0.8861	0.8732	14479	0.7805	0.8167	0.7982	13966	0.7704	0.7950	0.7825	15201	0.8509	0.8750	0.8628	14804	0.8754	0.8853	0.8803	9011	0.7043	0.7325	0.7181	15233	0.6016	0.6364	0.6185	3474	0.9171	0.9425	0.9296	14770	0.4277	0.2964	0.3501	2156	0.8348	0.8539	0.8442	17347	0.4832	0.5269	0.5041	14199	0.0	0.0	0.0	73	0.6770	0.7370	0.7057	13694	0.7586	0.7647	0.7617	3358	0.8926	0.9375	0.9145	10425	0.8242	0.8684	0.8457	7689	0.3697	0.3917	0.3803	14855	0.8084	0.8468	0.8271	11808	0.4032	0.4927	0.4435	2338	0.6847	0.7479	0.7149	9094	0.7230	0.7801	0.7505	13620	0.0	0.0	0.0	106	0.5682	0.5708	0.5695	17893	0.0	0.0	0.0	56	0.6910	0.7284	0.7092	12491	0.1667	0.0370	0.0606	81	0.5161	0.5920	0.5514	8510	0.2874	0.2747	0.2809	546	0.7316	0.7609	0.7460	0.9297
0.0436	8.0	72224	0.3214	0.6028	0.6325	0.6173	237046	0.8230	0.8335	0.8282	8131	0.9559	0.9753	0.9655	50290	0.8894	0.9289	0.9087	84619	0.7777	0.8063	0.7917	36138	0.7507	0.3748	0.5	1374	0.3289	0.3175	0.3231	929	0.5436	0.5444	0.5440	3821	0.7977	0.7972	0.7975	5302	0.4791	0.5078	0.4930	2568	0.7795	0.7792	0.7794	6299	0.9099	0.9260	0.9179	17115	0.9203	0.9320	0.9261	17016	0.9084	0.9204	0.9144	14899	0.8595	0.8827	0.8710	14479	0.7821	0.8193	0.8003	13966	0.7657	0.7917	0.7785	15201	0.8504	0.8760	0.8630	14804	0.8759	0.8851	0.8805	9011	0.6986	0.7240	0.7111	15233	0.6079	0.6684	0.6367	3474	0.9190	0.9434	0.9310	14770	0.4084	0.3214	0.3597	2156	0.8351	0.8537	0.8443	17347	0.4710	0.5188	0.4937	14199	0.0	0.0	0.0	73	0.6779	0.7343	0.7050	13694	0.7598	0.7686	0.7642	3358	0.8933	0.9382	0.9152	10425	0.8234	0.8668	0.8446	7689	0.3599	0.3987	0.3783	14855	0.8023	0.8373	0.8194	11808	0.4169	0.4602	0.4375	2338	0.6870	0.7394	0.7122	9094	0.7230	0.7776	0.7493	13620	0.0	0.0	0.0	106	0.5621	0.5663	0.5642	17893	0.0	0.0	0.0	56	0.7012	0.7258	0.7133	12491	0.1818	0.0494	0.0777	81	0.5212	0.5927	0.5547	8510	0.3103	0.3205	0.3153	546	0.7298	0.7596	0.7444	0.9298

Framework versions

• Transformers 4.40.2
• Pytorch 2.3.1+cu121
• Datasets 2.20.0
• Tokenizers 0.19.1