finetune-led-thousanddata

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 1.9539
• Rouge1 Precision: 0.2722
• Rouge1 Recall: 0.3458
• Rouge1 Fmeasure: 0.3011

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• gradient_accumulation_steps: 4
• total_train_batch_size: 32
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 4
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Rouge1 Fmeasure	Rouge1 Precision	Rouge1 Recall
2.0529	0.13	10	2.6191	0.3014	0.2948	0.324
1.778	0.26	20	2.4690	0.2947	0.2802	0.3213
1.7425	0.38	30	2.3989	0.3037	0.2734	0.3524
1.7006	0.51	40	2.3216	0.2941	0.2665	0.3386
1.6751	0.64	50	2.3027	0.3101	0.282	0.3551
1.6887	0.77	60	2.2911	0.3058	0.2731	0.3577
1.6008	0.89	70	2.2476	0.3016	0.272	0.3487
1.5767	1.02	80	2.2167	0.3043	0.2775	0.3465
1.5046	1.15	90	2.2185	0.3004	0.2721	0.3458
1.5394	1.28	100	2.1977	0.2991	0.2696	0.3463
1.5449	1.41	110	2.1823	0.2978	0.2704	0.341
1.5073	1.53	120	2.1832	0.3057	0.276	0.3527
1.5232	0.42	130	2.2091	0.2955	0.2664	0.3424
1.4896	0.45	140	2.2069	0.2905	0.2574	0.3424
1.4848	0.48	150	2.1913	0.2868	0.2567	0.3356
1.5084	0.51	160	2.1826	0.3006	0.2755	0.3406
1.4322	0.54	170	2.2525	0.3049	0.2716	0.3582
1.4672	0.58	180	2.1890	0.2919	0.2663	0.3322
1.4543	0.61	190	2.1487	0.3022	0.276	0.344
1.5446	0.64	200	2.1496	0.2993	0.273	0.3418
1.412	0.67	210	2.1837	0.2976	0.268	0.3439
1.5241	0.7	220	2.1423	0.2913	0.2665	0.3305
1.4806	0.74	230	2.1303	0.2997	0.2736	0.3411
1.5405	0.77	240	2.1205	0.2966	0.2668	0.3428
1.4287	0.8	250	2.1322	0.2976	0.268	0.3442
1.4977	0.83	260	2.1334	0.2979	0.2665	0.3477
1.4171	0.86	270	2.1184	0.3043	0.2741	0.3509
1.4491	0.9	280	2.1038	0.2868	0.2628	0.3253
1.4316	0.93	290	2.1254	0.2958	0.2678	0.3393
1.4689	0.96	300	2.1052	0.299	0.2685	0.3471
1.4347	0.99	310	2.0815	0.3019	0.273	0.3476
1.3285	1.02	320	2.0877	0.2981	0.2695	0.3427
1.2636	1.06	330	2.0740	0.2933	0.2645	0.3382
1.32	1.09	340	2.0755	0.2997	0.2689	0.3487
1.357	1.12	350	2.0594	0.301	0.2743	0.3434
1.3412	1.15	360	2.0660	0.2961	0.2677	0.3405
1.327	1.18	370	2.0649	0.2912	0.263	0.335
1.3193	1.22	380	2.0842	0.2952	0.2673	0.3392
1.2961	1.25	390	2.0749	0.2957	0.2705	0.3342
1.3093	1.28	400	2.0715	0.2997	0.272	0.3441
1.3403	1.31	410	2.0671	0.3119	0.2823	0.3584
1.3685	1.34	420	2.0580	0.2973	0.2695	0.3409
1.2913	1.38	430	2.0685	0.2926	0.2632	0.339
1.3796	1.41	440	2.0339	0.2962	0.2697	0.3387
1.354	1.44	450	2.0371	0.2953	0.2665	0.3412
1.3268	1.47	460	2.0309	0.2957	0.2681	0.3395
1.3706	1.5	470	2.0215	0.2932	0.2685	0.3315
1.3288	1.54	480	2.0044	0.2948	0.2674	0.3374
1.4102	1.57	490	2.0046	0.2998	0.271	0.3446
1.3952	1.6	500	2.0044	0.3063	0.2794	0.3487
1.2994	1.63	510	1.9993	0.3052	0.2787	0.3461
1.2948	1.66	520	2.0168	0.3	0.2743	0.3406
1.2972	1.7	530	2.0290	0.3003	0.2734	0.342
1.3181	1.73	540	2.0234	0.2949	0.2676	0.338
1.3505	1.76	550	1.9942	0.301	0.2737	0.3436
1.3163	1.79	560	1.9983	0.2963	0.2705	0.3366
1.2876	1.82	570	2.0206	0.303	0.2739	0.3486
1.2895	1.86	580	2.0131	0.2958	0.2652	0.3443
1.3257	1.89	590	1.9888	0.3022	0.2743	0.3455
1.2891	1.92	600	1.9928	0.2972	0.2694	0.3408
1.3152	1.95	610	1.9785	0.292	0.2653	0.334
1.2834	1.98	620	2.0105	0.3039	0.2735	0.3511
1.2373	2.02	630	2.0023	0.3019	0.2735	0.346
1.2569	2.05	640	2.0006	0.3029	0.2753	0.3463
1.2337	2.08	650	1.9919	0.3006	0.2746	0.3416
1.1274	2.11	660	2.0095	0.3015	0.2732	0.3457
1.2178	2.14	670	1.9974	0.3031	0.275	0.3475
1.22	2.18	680	1.9924	0.3059	0.2777	0.3501
1.2913	2.21	690	1.9880	0.3044	0.2745	0.351
1.2441	2.24	700	1.9886	0.299	0.2721	0.3412
1.3258	2.27	710	1.9772	0.2956	0.2686	0.3377
1.158	2.3	720	2.0003	0.2983	0.2702	0.3424
1.1908	2.34	730	1.9845	0.2975	0.2705	0.3398
1.2411	2.37	740	1.9768	0.304	0.275	0.3493
1.1936	2.4	750	2.0065	0.293	0.2628	0.3403
1.1578	2.44	760	2.0199	0.301	0.2713	0.3473
1.2086	2.47	770	1.9949	0.2921	0.2664	0.3323
1.2574	2.5	780	1.9806	0.297	0.2693	0.3405
1.2331	2.53	790	2.0100	0.3012	0.2733	0.3446
1.2522	2.56	800	1.9969	0.301	0.2716	0.3468
1.2508	2.6	810	1.9931	0.3016	0.2719	0.3471
1.1558	2.63	820	1.9873	0.2986	0.2725	0.3402
1.2721	2.66	830	1.9763	0.2988	0.2671	0.348
1.2817	2.69	840	1.9713	0.2961	0.2688	0.3388
1.2183	2.72	850	1.9783	0.2985	0.2709	0.3416
1.2278	2.76	860	1.9757	0.2964	0.2681	0.3402
1.2087	2.79	870	1.9818	0.304	0.2735	0.3516
1.1838	2.82	880	1.9845	0.2916	0.2659	0.3312
1.1185	2.85	890	1.9912	0.3044	0.2759	0.3492
1.1214	2.88	900	1.9838	0.2995	0.2692	0.3468
1.2341	2.92	910	1.9685	0.296	0.2713	0.3344
1.1808	2.95	920	1.9803	0.3008	0.2725	0.345
1.2843	2.98	930	1.9645	0.3041	0.2745	0.3504
1.1824	3.01	940	1.9750	0.2985	0.2713	0.3412
1.1399	3.04	950	1.9762	0.2943	0.264	0.3416
1.1347	3.08	960	1.9841	0.2971	0.2685	0.3419
1.2298	3.11	970	1.9526	0.2993	0.2701	0.3448
1.1731	3.14	980	1.9787	0.304	0.2726	0.3531
1.1819	3.17	990	1.9570	0.2995	0.2715	0.3437
1.2072	3.2	1000	1.9613	0.3004	0.2705	0.3472
1.1214	3.24	1010	1.9670	0.3	0.2723	0.3432
1.226	3.27	1020	1.9676	0.2945	0.2639	0.3422
1.1956	3.3	1030	1.9721	0.2949	0.2657	0.3406
1.2286	3.33	1040	1.9572	0.3046	0.2759	0.3489
1.1786	3.36	1050	1.9549	0.3009	0.2728	0.3448
1.1512	3.4	1060	1.9609	0.2989	0.2699	0.3441
1.1897	3.43	1070	1.9626	0.2983	0.2697	0.3427
1.187	3.46	1080	1.9612	0.3016	0.2731	0.3457
1.1394	3.49	1090	1.9519	0.3015	0.2746	0.3431
1.1088	3.52	1100	1.9674	0.301	0.2709	0.3477
1.1787	3.56	1110	1.9549	0.3009	0.2728	0.3449
1.1961	3.59	1120	1.9545	0.3016	0.2722	0.3476
1.1194	3.62	1130	1.9693	0.3028	0.2735	0.3484
1.1991	3.65	1140	1.9538	0.3002	0.2706	0.3461
1.2109	3.68	1150	1.9428	0.3018	0.2729	0.3465
1.1389	3.72	1160	1.9578	0.3008	0.2723	0.3452
1.1922	3.75	1170	1.9576	0.2992	0.2701	0.3446
1.1002	3.78	1180	1.9571	0.299	0.2696	0.3445
1.1407	3.81	1190	1.9530	0.2979	0.2692	0.3422
1.1882	3.84	1200	1.9491	0.3009	0.2725	0.345
1.1755	3.88	1210	1.9562	0.3024	0.2735	0.3468
1.062	3.91	1220	1.9577	0.302	0.2722	0.3478
1.1965	3.94	1230	1.9575	0.3013	0.2716	0.3472
1.1255	3.97	1240	1.9550	0.3014	0.272	0.3466

Framework versions

• Transformers 4.35.2
• Pytorch 2.1.1+cu121
• Datasets 2.14.5
• Tokenizers 0.15.1