nerugm-base-2

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.4080
• Location Precision: 0.8026
• Location Recall: 0.8472
• Location F1: 0.8243
• Location Number: 72
• Organization Precision: 0.7791
• Organization Recall: 0.8933
• Organization F1: 0.8323
• Organization Number: 75
• Person Precision: 0.8839
• Person Recall: 0.9580
• Person F1: 0.9195
• Person Number: 143
• Quantity Precision: 0.6296
• Quantity Recall: 0.7391
• Quantity F1: 0.68
• Quantity Number: 23
• Time Precision: 0.7931
• Time Recall: 0.8846
• Time F1: 0.8364
• Time Number: 26
• Overall Precision: 0.8177
• Overall Recall: 0.8997
• Overall F1: 0.8567
• Overall Accuracy: 0.9615

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Quantity Precision	Quantity Recall	Quantity F1	Quantity Number	Time Precision	Time Recall	Time F1	Time Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.3629	1.0	106	0.1599	0.7692	0.8333	0.8	72	0.6211	0.7867	0.6941	75	0.8344	0.9510	0.8889	143	0.425	0.7391	0.5397	23	0.6286	0.8462	0.7213	26	0.7153	0.8673	0.7840	0.9482
0.128	2.0	212	0.1368	0.7439	0.8472	0.7922	72	0.6731	0.9333	0.7821	75	0.8645	0.9371	0.8993	143	0.5625	0.7826	0.6545	23	0.8077	0.8077	0.8077	26	0.7619	0.8968	0.8238	0.9567
0.0841	3.0	318	0.1551	0.8143	0.7917	0.8028	72	0.7021	0.88	0.7811	75	0.8395	0.9510	0.8918	143	0.5667	0.7391	0.6415	23	0.9091	0.7692	0.8333	26	0.7831	0.8732	0.8257	0.9547
0.0533	4.0	424	0.1720	0.7792	0.8333	0.8054	72	0.6875	0.88	0.7719	75	0.8313	0.9301	0.8779	143	0.5806	0.7826	0.6667	23	0.6571	0.8846	0.7541	26	0.7519	0.8850	0.8130	0.9552
0.0359	5.0	530	0.2084	0.7722	0.8472	0.8079	72	0.7065	0.8667	0.7784	75	0.8519	0.9650	0.9049	143	0.5758	0.8261	0.6786	23	0.7586	0.8462	0.8	26	0.7722	0.8997	0.8311	0.9565
0.0256	6.0	636	0.2403	0.8	0.8333	0.8163	72	0.6538	0.9067	0.7598	75	0.8553	0.9510	0.9007	143	0.5588	0.8261	0.6667	23	0.6774	0.8077	0.7368	26	0.7543	0.8968	0.8194	0.9540
0.0188	7.0	742	0.2266	0.7821	0.8472	0.8133	72	0.6509	0.92	0.7624	75	0.8581	0.9301	0.8926	143	0.6207	0.7826	0.6923	23	0.6364	0.8077	0.7119	26	0.7531	0.8909	0.8162	0.9570
0.0134	8.0	848	0.2462	0.7733	0.8056	0.7891	72	0.7011	0.8133	0.7531	75	0.8662	0.9510	0.9067	143	0.5667	0.7391	0.6415	23	0.7097	0.8462	0.7719	26	0.7737	0.8673	0.8178	0.9572
0.0135	9.0	954	0.2375	0.8028	0.7917	0.7972	72	0.75	0.88	0.8098	75	0.8462	0.9231	0.8829	143	0.6207	0.7826	0.6923	23	0.7857	0.8462	0.8148	26	0.7930	0.8702	0.8298	0.9592
0.0082	10.0	1060	0.2711	0.7531	0.8472	0.7974	72	0.7174	0.88	0.7904	75	0.8535	0.9371	0.8933	143	0.5667	0.7391	0.6415	23	0.7931	0.8846	0.8364	26	0.7738	0.8879	0.8269	0.9575
0.0079	11.0	1166	0.2778	0.7632	0.8056	0.7838	72	0.7222	0.8667	0.7879	75	0.8654	0.9441	0.9030	143	0.6	0.7826	0.6792	23	0.7241	0.8077	0.7636	26	0.7795	0.8761	0.825	0.9575
0.0105	12.0	1272	0.2845	0.7917	0.7917	0.7917	72	0.7711	0.8533	0.8101	75	0.8654	0.9441	0.9030	143	0.6667	0.7826	0.72	23	0.7333	0.8462	0.7857	26	0.8043	0.8732	0.8373	0.9612
0.0103	13.0	1378	0.2690	0.7733	0.8056	0.7891	72	0.7528	0.8933	0.8171	75	0.8581	0.9301	0.8926	143	0.6129	0.8261	0.7037	23	0.92	0.8846	0.9020	26	0.8	0.8850	0.8403	0.9602
0.0045	14.0	1484	0.3048	0.8	0.7778	0.7887	72	0.7143	0.9333	0.8092	75	0.8535	0.9371	0.8933	143	0.5625	0.7826	0.6545	23	0.7241	0.8077	0.7636	26	0.7746	0.8820	0.8248	0.9580
0.005	15.0	1590	0.2786	0.8	0.8333	0.8163	72	0.775	0.8267	0.8000	75	0.8758	0.9371	0.9054	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.8087	0.8732	0.8397	0.9597
0.0041	16.0	1696	0.3064	0.7564	0.8194	0.7867	72	0.7528	0.8933	0.8171	75	0.8481	0.9371	0.8904	143	0.6333	0.8261	0.7170	23	0.8148	0.8462	0.8302	26	0.7880	0.8879	0.8350	0.9572
0.0061	17.0	1802	0.3008	0.7436	0.8056	0.7733	72	0.7209	0.8267	0.7702	75	0.8438	0.9441	0.8911	143	0.6429	0.7826	0.7059	23	0.7857	0.8462	0.8148	26	0.7763	0.8702	0.8206	0.9575
0.0036	18.0	1908	0.2975	0.7821	0.8472	0.8133	72	0.7875	0.84	0.8129	75	0.8645	0.9371	0.8993	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.8081	0.8820	0.8434	0.9627
0.0025	19.0	2014	0.3172	0.8289	0.875	0.8514	72	0.7727	0.9067	0.8344	75	0.8544	0.9441	0.8970	143	0.7037	0.8261	0.76	23	0.8462	0.8462	0.8462	26	0.8187	0.9056	0.8599	0.9622
0.0039	20.0	2120	0.3097	0.7922	0.8472	0.8188	72	0.75	0.88	0.8098	75	0.8544	0.9441	0.8970	143	0.7037	0.8261	0.76	23	0.8462	0.8462	0.8462	26	0.8059	0.8938	0.8476	0.9622
0.0031	21.0	2226	0.3249	0.7468	0.8194	0.7815	72	0.7590	0.84	0.7975	75	0.8491	0.9441	0.8940	143	0.6552	0.8261	0.7308	23	0.7586	0.8462	0.8	26	0.7863	0.8791	0.8301	0.9597
0.0037	22.0	2332	0.3309	0.7763	0.8194	0.7973	72	0.75	0.92	0.8263	75	0.8438	0.9441	0.8911	143	0.6552	0.8261	0.7308	23	0.7586	0.8462	0.8	26	0.7876	0.8968	0.8386	0.9602
0.0015	23.0	2438	0.3277	0.7722	0.8472	0.8079	72	0.7738	0.8667	0.8176	75	0.8535	0.9371	0.8933	143	0.6897	0.8696	0.7692	23	0.7586	0.8462	0.8	26	0.7989	0.8909	0.8424	0.9610
0.0027	24.0	2544	0.3232	0.7632	0.8056	0.7838	72	0.7778	0.84	0.8077	75	0.8535	0.9371	0.8933	143	0.6667	0.7826	0.72	23	0.8148	0.8462	0.8302	26	0.8016	0.8702	0.8345	0.9610
0.0035	25.0	2650	0.3514	0.7590	0.875	0.8129	72	0.7831	0.8667	0.8228	75	0.8581	0.9301	0.8926	143	0.5455	0.7826	0.6429	23	0.7586	0.8462	0.8	26	0.7859	0.8879	0.8338	0.9580
0.0028	26.0	2756	0.3200	0.7590	0.875	0.8129	72	0.7143	0.8667	0.7831	75	0.8742	0.9231	0.8980	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.7895	0.8850	0.8345	0.9602
0.0023	27.0	2862	0.3429	0.7895	0.8333	0.8108	72	0.7143	0.8667	0.7831	75	0.8418	0.9301	0.8837	143	0.5862	0.7391	0.6538	23	0.7857	0.8462	0.8148	26	0.7775	0.8761	0.8239	0.9570
0.0031	28.0	2968	0.3219	0.7625	0.8472	0.8026	72	0.7241	0.84	0.7778	75	0.8457	0.9580	0.8984	143	0.6071	0.7391	0.6667	23	0.7419	0.8846	0.8070	26	0.7758	0.8879	0.8281	0.9600
0.0028	29.0	3074	0.3581	0.8358	0.7778	0.8058	72	0.7778	0.84	0.8077	75	0.8408	0.9231	0.8800	143	0.5667	0.7391	0.6415	23	0.8148	0.8462	0.8302	26	0.8011	0.8555	0.8274	0.9562
0.0031	30.0	3180	0.3134	0.7692	0.8333	0.8	72	0.7857	0.88	0.8302	75	0.8782	0.9580	0.9164	143	0.6552	0.8261	0.7308	23	0.7586	0.8462	0.8	26	0.8085	0.8968	0.8503	0.9620
0.0035	31.0	3286	0.3133	0.6941	0.8194	0.7516	72	0.8125	0.8667	0.8387	75	0.8726	0.9580	0.9133	143	0.6	0.7826	0.6792	23	0.7857	0.8462	0.8148	26	0.7921	0.8879	0.8373	0.9615
0.0028	32.0	3392	0.3202	0.7867	0.8194	0.8027	72	0.7419	0.92	0.8214	75	0.8599	0.9441	0.9	143	0.7308	0.8261	0.7755	23	0.8462	0.8462	0.8462	26	0.8064	0.8968	0.8492	0.9612
0.0013	33.0	3498	0.3316	0.8108	0.8333	0.8219	72	0.7561	0.8267	0.7898	75	0.8581	0.9301	0.8926	143	0.6207	0.7826	0.6923	23	0.8462	0.8462	0.8462	26	0.8060	0.8702	0.8369	0.9612
0.0018	34.0	3604	0.3669	0.84	0.875	0.8571	72	0.7416	0.88	0.8049	75	0.8544	0.9441	0.8970	143	0.6333	0.8261	0.7170	23	0.8148	0.8462	0.8302	26	0.8047	0.8997	0.8496	0.9622
0.0022	35.0	3710	0.3101	0.8158	0.8611	0.8378	72	0.7674	0.88	0.8199	75	0.8874	0.9371	0.9116	143	0.6552	0.8261	0.7308	23	0.9231	0.9231	0.9231	26	0.8288	0.8997	0.8628	0.9650
0.002	36.0	3816	0.3521	0.7949	0.8611	0.8267	72	0.7674	0.88	0.8199	75	0.8535	0.9371	0.8933	143	0.6207	0.7826	0.6923	23	0.8148	0.8462	0.8302	26	0.8011	0.8909	0.8436	0.9592
0.0019	37.0	3922	0.3424	0.7848	0.8611	0.8212	72	0.7586	0.88	0.8148	75	0.8636	0.9301	0.8956	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.8011	0.8909	0.8436	0.9587
0.0012	38.0	4028	0.3519	0.7654	0.8611	0.8105	72	0.7765	0.88	0.825	75	0.8581	0.9301	0.8926	143	0.6207	0.7826	0.6923	23	0.7857	0.8462	0.8148	26	0.7963	0.8879	0.8396	0.9580
0.0012	39.0	4134	0.3655	0.7949	0.8611	0.8267	72	0.7765	0.88	0.825	75	0.8581	0.9301	0.8926	143	0.6333	0.8261	0.7170	23	0.75	0.8077	0.7778	26	0.8005	0.8879	0.8420	0.9587
0.001	40.0	4240	0.3408	0.7945	0.8056	0.8	72	0.7654	0.8267	0.7949	75	0.8766	0.9441	0.9091	143	0.7308	0.8261	0.7755	23	0.8148	0.8462	0.8302	26	0.8199	0.8732	0.8457	0.9612
0.0025	41.0	4346	0.3410	0.775	0.8611	0.8158	72	0.7561	0.8267	0.7898	75	0.8774	0.9510	0.9128	143	0.6429	0.7826	0.7059	23	0.7586	0.8462	0.8	26	0.8021	0.8850	0.8415	0.9615
0.0012	42.0	4452	0.3626	0.8052	0.8611	0.8322	72	0.7683	0.84	0.8025	75	0.8654	0.9441	0.9030	143	0.7037	0.8261	0.76	23	0.8077	0.8077	0.8077	26	0.8152	0.8850	0.8487	0.9615
0.003	43.0	4558	0.3544	0.8	0.8333	0.8163	72	0.7253	0.88	0.7952	75	0.8710	0.9441	0.9060	143	0.6429	0.7826	0.7059	23	0.7778	0.8077	0.7925	26	0.7979	0.8850	0.8392	0.9587
0.0027	44.0	4664	0.3703	0.7625	0.8472	0.8026	72	0.7158	0.9067	0.8000	75	0.8491	0.9441	0.8940	143	0.6552	0.8261	0.7308	23	0.7857	0.8462	0.8148	26	0.7801	0.8997	0.8356	0.9587
0.0015	45.0	4770	0.3453	0.7895	0.8333	0.8108	72	0.7952	0.88	0.8354	75	0.8438	0.9441	0.8911	143	0.6667	0.7826	0.72	23	0.8077	0.8077	0.8077	26	0.8065	0.8850	0.8439	0.9605
0.0018	46.0	4876	0.3449	0.8	0.8333	0.8163	72	0.7528	0.8933	0.8171	75	0.8710	0.9441	0.9060	143	0.6538	0.7391	0.6939	23	0.84	0.8077	0.8235	26	0.8108	0.8850	0.8463	0.9612
0.0028	47.0	4982	0.3711	0.8082	0.8194	0.8138	72	0.7586	0.88	0.8148	75	0.8710	0.9441	0.9060	143	0.6667	0.7826	0.72	23	0.8148	0.8462	0.8302	26	0.8130	0.8850	0.8475	0.9597
0.0014	48.0	5088	0.3521	0.8310	0.8194	0.8252	72	0.7674	0.88	0.8199	75	0.8766	0.9441	0.9091	143	0.6667	0.7826	0.72	23	0.8148	0.8462	0.8302	26	0.8219	0.8850	0.8523	0.9632
0.0023	49.0	5194	0.3651	0.7922	0.8472	0.8188	72	0.7875	0.84	0.8129	75	0.8428	0.9371	0.8874	143	0.6667	0.7826	0.72	23	0.7857	0.8462	0.8148	26	0.8032	0.8791	0.8394	0.9592
0.0027	50.0	5300	0.3327	0.7922	0.8472	0.8188	72	0.7791	0.8933	0.8323	75	0.8718	0.9510	0.9097	143	0.6667	0.7826	0.72	23	0.9231	0.9231	0.9231	26	0.8226	0.9027	0.8608	0.9615
0.0009	51.0	5406	0.3315	0.8082	0.8194	0.8138	72	0.8125	0.8667	0.8387	75	0.8774	0.9510	0.9128	143	0.68	0.7391	0.7083	23	0.9231	0.9231	0.9231	26	0.8384	0.8879	0.8625	0.9660
0.001	52.0	5512	0.3466	0.7838	0.8056	0.7945	72	0.7791	0.8933	0.8323	75	0.8774	0.9510	0.9128	143	0.6296	0.7391	0.68	23	0.8889	0.9231	0.9057	26	0.8184	0.8909	0.8531	0.9607
0.0014	53.0	5618	0.3278	0.7895	0.8333	0.8108	72	0.7701	0.8933	0.8272	75	0.8726	0.9580	0.9133	143	0.6296	0.7391	0.68	23	0.8214	0.8846	0.8519	26	0.8107	0.8968	0.8515	0.9610
0.0007	54.0	5724	0.3647	0.7875	0.875	0.8289	72	0.7204	0.8933	0.7976	75	0.8438	0.9441	0.8911	143	0.6667	0.7826	0.72	23	0.7931	0.8846	0.8364	26	0.7866	0.9027	0.8407	0.9590
0.0017	55.0	5830	0.3636	0.7595	0.8333	0.7947	72	0.7654	0.8267	0.7949	75	0.8616	0.9580	0.9073	143	0.5714	0.6957	0.6275	23	0.7333	0.8462	0.7857	26	0.7878	0.8761	0.8296	0.9602
0.0004	56.0	5936	0.3733	0.7532	0.8056	0.7785	72	0.825	0.88	0.8516	75	0.8562	0.9580	0.9043	143	0.6	0.7826	0.6792	23	0.84	0.8077	0.8235	26	0.8065	0.8850	0.8439	0.9597
0.0009	57.0	6042	0.3640	0.7722	0.8472	0.8079	72	0.8272	0.8933	0.8590	75	0.8544	0.9441	0.8970	143	0.6429	0.7826	0.7059	23	0.7857	0.8462	0.8148	26	0.8102	0.8938	0.8499	0.9612
0.0003	58.0	6148	0.3814	0.7531	0.8472	0.7974	72	0.7614	0.8933	0.8221	75	0.8701	0.9371	0.9024	143	0.6429	0.7826	0.7059	23	0.8214	0.8846	0.8519	26	0.7995	0.8938	0.8440	0.9582
0.0005	59.0	6254	0.3739	0.7867	0.8194	0.8027	72	0.8228	0.8667	0.8442	75	0.8718	0.9510	0.9097	143	0.6429	0.7826	0.7059	23	0.8571	0.9231	0.8889	26	0.8251	0.8909	0.8567	0.9620
0.0005	60.0	6360	0.3767	0.8108	0.8333	0.8219	72	0.7952	0.88	0.8354	75	0.8553	0.9510	0.9007	143	0.6667	0.7826	0.72	23	0.8519	0.8846	0.8679	26	0.8189	0.8938	0.8547	0.9605
0.0008	61.0	6466	0.3699	0.8	0.8333	0.8163	72	0.8025	0.8667	0.8333	75	0.8608	0.9510	0.9037	143	0.6429	0.7826	0.7059	23	0.7667	0.8846	0.8214	26	0.8118	0.8909	0.8495	0.9622
0.0016	62.0	6572	0.3497	0.7922	0.8472	0.8188	72	0.7765	0.88	0.825	75	0.8204	0.9580	0.8839	143	0.6429	0.7826	0.7059	23	0.8519	0.8846	0.8679	26	0.7943	0.8997	0.8437	0.9612
0.0004	63.0	6678	0.3624	0.8133	0.8472	0.8299	72	0.7727	0.9067	0.8344	75	0.8696	0.9790	0.9211	143	0.6429	0.7826	0.7059	23	0.6970	0.8846	0.7797	26	0.8052	0.9145	0.8564	0.9617
0.0009	64.0	6784	0.3704	0.8267	0.8611	0.8435	72	0.7882	0.8933	0.8375	75	0.8553	0.9510	0.9007	143	0.6667	0.7826	0.72	23	0.8214	0.8846	0.8519	26	0.8182	0.9027	0.8583	0.9602
0.001	65.0	6890	0.3583	0.7949	0.8611	0.8267	72	0.7614	0.8933	0.8221	75	0.8634	0.9720	0.9145	143	0.6667	0.7826	0.72	23	0.8519	0.8846	0.8679	26	0.8110	0.9115	0.8583	0.9635
0.0001	66.0	6996	0.3525	0.75	0.8333	0.7895	72	0.8125	0.8667	0.8387	75	0.8679	0.9650	0.9139	143	0.6667	0.7826	0.72	23	0.8462	0.8462	0.8462	26	0.8145	0.8938	0.8523	0.9627
0.0015	67.0	7102	0.3764	0.7778	0.875	0.8235	72	0.7444	0.8933	0.8121	75	0.8571	0.9650	0.9079	143	0.6667	0.7826	0.72	23	0.8519	0.8846	0.8679	26	0.8005	0.9115	0.8524	0.9602
0.0006	68.0	7208	0.3496	0.8243	0.8472	0.8356	72	0.7222	0.8667	0.7879	75	0.8726	0.9580	0.9133	143	0.6429	0.7826	0.7059	23	0.8148	0.8462	0.8302	26	0.8059	0.8938	0.8476	0.9595
0.0008	69.0	7314	0.3475	0.7922	0.8472	0.8188	72	0.775	0.8267	0.8000	75	0.8544	0.9441	0.8970	143	0.6538	0.7391	0.6939	23	0.8148	0.8462	0.8302	26	0.8071	0.8761	0.8402	0.9595
0.0	70.0	7420	0.3663	0.8243	0.8472	0.8356	72	0.7444	0.8933	0.8121	75	0.8375	0.9371	0.8845	143	0.6296	0.7391	0.68	23	0.7667	0.8846	0.8214	26	0.7927	0.8909	0.8389	0.9592
0.0002	71.0	7526	0.3715	0.8056	0.8056	0.8056	72	0.7528	0.8933	0.8171	75	0.8839	0.9580	0.9195	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8118	0.8909	0.8495	0.9597
0.0001	72.0	7632	0.3853	0.8267	0.8611	0.8435	72	0.7363	0.8933	0.8072	75	0.8782	0.9580	0.9164	143	0.6296	0.7391	0.68	23	0.7667	0.8846	0.8214	26	0.8074	0.9027	0.8524	0.9587
0.0007	73.0	7738	0.3506	0.8219	0.8333	0.8276	72	0.7674	0.88	0.8199	75	0.8710	0.9441	0.9060	143	0.6296	0.7391	0.68	23	0.8462	0.8462	0.8462	26	0.8174	0.8850	0.8499	0.9600
0.0002	74.0	7844	0.4028	0.8052	0.8611	0.8322	72	0.7312	0.9067	0.8095	75	0.8782	0.9580	0.9164	143	0.5862	0.7391	0.6538	23	0.7857	0.8462	0.8148	26	0.7990	0.9027	0.8476	0.9585
0.0	75.0	7950	0.3929	0.8	0.8333	0.8163	72	0.7765	0.88	0.825	75	0.8718	0.9510	0.9097	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8113	0.8879	0.8479	0.9607
0.0002	76.0	8056	0.4091	0.7683	0.875	0.8182	72	0.7701	0.8933	0.8272	75	0.8839	0.9580	0.9195	143	0.6071	0.7391	0.6667	23	0.7931	0.8846	0.8364	26	0.8058	0.9056	0.8528	0.9607
0.0	77.0	8162	0.3996	0.7975	0.875	0.8344	72	0.7701	0.8933	0.8272	75	0.8654	0.9441	0.9030	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8064	0.8968	0.8492	0.9602
0.0	78.0	8268	0.3973	0.7949	0.8611	0.8267	72	0.7674	0.88	0.8199	75	0.8599	0.9441	0.9	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8032	0.8909	0.8448	0.9597
0.0	79.0	8374	0.3981	0.7848	0.8611	0.8212	72	0.7765	0.88	0.825	75	0.8654	0.9441	0.9030	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8053	0.8909	0.8459	0.9602
0.0	80.0	8480	0.4012	0.7975	0.875	0.8344	72	0.7674	0.88	0.8199	75	0.8654	0.9441	0.9030	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8059	0.8938	0.8476	0.9602
0.0006	81.0	8586	0.4144	0.7949	0.8611	0.8267	72	0.7701	0.8933	0.8272	75	0.8599	0.9441	0.9	143	0.5862	0.7391	0.6538	23	0.8214	0.8846	0.8519	26	0.8021	0.8968	0.8468	0.9597
0.0	82.0	8692	0.4051	0.7848	0.8611	0.8212	72	0.7831	0.8667	0.8228	75	0.8599	0.9441	0.9	143	0.6296	0.7391	0.68	23	0.8148	0.8462	0.8302	26	0.8070	0.8879	0.8455	0.9595
0.0006	83.0	8798	0.4077	0.7654	0.8611	0.8105	72	0.7416	0.88	0.8049	75	0.8544	0.9441	0.8970	143	0.6071	0.7391	0.6667	23	0.8214	0.8846	0.8519	26	0.7891	0.8938	0.8382	0.9602
0.0004	84.0	8904	0.3962	0.7922	0.8472	0.8188	72	0.7927	0.8667	0.8280	75	0.8654	0.9441	0.9030	143	0.6296	0.7391	0.68	23	0.8148	0.8462	0.8302	26	0.8130	0.8850	0.8475	0.9607
0.0005	85.0	9010	0.3861	0.8026	0.8472	0.8243	72	0.8077	0.84	0.8235	75	0.8831	0.9510	0.9158	143	0.6296	0.7391	0.68	23	0.8462	0.8462	0.8462	26	0.8283	0.8820	0.8543	0.9617
0.0	86.0	9116	0.3953	0.7922	0.8472	0.8188	72	0.7738	0.8667	0.8176	75	0.8718	0.9510	0.9097	143	0.6538	0.7391	0.6939	23	0.8148	0.8462	0.8302	26	0.8135	0.8879	0.8491	0.9610
0.0003	87.0	9222	0.4130	0.7848	0.8611	0.8212	72	0.7614	0.8933	0.8221	75	0.8562	0.9580	0.9043	143	0.6071	0.7391	0.6667	23	0.7778	0.8077	0.7925	26	0.7958	0.8968	0.8433	0.9602
0.0004	88.0	9328	0.4155	0.7848	0.8611	0.8212	72	0.7614	0.8933	0.8221	75	0.8553	0.9510	0.9007	143	0.6071	0.7391	0.6667	23	0.7778	0.8077	0.7925	26	0.7953	0.8938	0.8417	0.9602
0.0	89.0	9434	0.4156	0.7848	0.8611	0.8212	72	0.7614	0.8933	0.8221	75	0.8553	0.9510	0.9007	143	0.6071	0.7391	0.6667	23	0.7778	0.8077	0.7925	26	0.7953	0.8938	0.8417	0.9602
0.0002	90.0	9540	0.4041	0.7949	0.8611	0.8267	72	0.7674	0.88	0.8199	75	0.8766	0.9441	0.9091	143	0.6296	0.7391	0.68	23	0.8148	0.8462	0.8302	26	0.8118	0.8909	0.8495	0.9615
0.0002	91.0	9646	0.3981	0.8052	0.8611	0.8322	72	0.7791	0.8933	0.8323	75	0.8831	0.9510	0.9158	143	0.6071	0.7391	0.6667	23	0.8148	0.8462	0.8302	26	0.8172	0.8968	0.8551	0.9617
0.0	92.0	9752	0.3971	0.8052	0.8611	0.8322	72	0.7791	0.8933	0.8323	75	0.8831	0.9510	0.9158	143	0.6538	0.7391	0.6939	23	0.8148	0.8462	0.8302	26	0.8216	0.8968	0.8575	0.9617
0.0	93.0	9858	0.4024	0.7949	0.8611	0.8267	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6071	0.7391	0.6667	23	0.7931	0.8846	0.8364	26	0.8138	0.9027	0.8559	0.9615
0.0	94.0	9964	0.3985	0.8052	0.8611	0.8322	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8182	0.9027	0.8583	0.9620
0.0	95.0	10070	0.3994	0.8052	0.8611	0.8322	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6071	0.7391	0.6667	23	0.7931	0.8846	0.8364	26	0.816	0.9027	0.8571	0.9617
0.0003	96.0	10176	0.3951	0.8026	0.8472	0.8243	72	0.7791	0.8933	0.8323	75	0.8774	0.9510	0.9128	143	0.6538	0.7391	0.6939	23	0.7931	0.8846	0.8364	26	0.8172	0.8968	0.8551	0.9612
0.0005	97.0	10282	0.4083	0.8026	0.8472	0.8243	72	0.7791	0.8933	0.8323	75	0.8726	0.9580	0.9133	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8133	0.8997	0.8543	0.9610
0.0	98.0	10388	0.4074	0.8026	0.8472	0.8243	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8177	0.8997	0.8567	0.9615
0.0	99.0	10494	0.4077	0.8026	0.8472	0.8243	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8177	0.8997	0.8567	0.9615
0.0001	100.0	10600	0.4080	0.8026	0.8472	0.8243	72	0.7791	0.8933	0.8323	75	0.8839	0.9580	0.9195	143	0.6296	0.7391	0.68	23	0.7931	0.8846	0.8364	26	0.8177	0.8997	0.8567	0.9615

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2