ALM-AHME commited on
Commit
bec82ee
1 Parent(s): c38a652

End of training

Browse files
Files changed (4) hide show
  1. all_results.json +13 -0
  2. eval_results.json +8 -0
  3. train_results.json +8 -0
  4. trainer_state.json +2215 -0
all_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 14.93,
3
+ "eval_accuracy": 0.9893267651888341,
4
+ "eval_loss": 0.06719201803207397,
5
+ "eval_runtime": 14.1249,
6
+ "eval_samples_per_second": 86.231,
7
+ "eval_steps_per_second": 5.451,
8
+ "total_flos": 9.675577376037974e+18,
9
+ "train_loss": 0.806596442168219,
10
+ "train_runtime": 3496.1772,
11
+ "train_samples_per_second": 15.664,
12
+ "train_steps_per_second": 0.489
13
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 14.93,
3
+ "eval_accuracy": 0.9893267651888341,
4
+ "eval_loss": 0.06719201803207397,
5
+ "eval_runtime": 14.1249,
6
+ "eval_samples_per_second": 86.231,
7
+ "eval_steps_per_second": 5.451
8
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 14.93,
3
+ "total_flos": 9.675577376037974e+18,
4
+ "train_loss": 0.806596442168219,
5
+ "train_runtime": 3496.1772,
6
+ "train_samples_per_second": 15.664,
7
+ "train_steps_per_second": 0.489
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,2215 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.9893267651888341,
3
+ "best_model_checkpoint": "convnextv2-large-1k-224-finetuned-Lesion-Classification-HAM10000-AH-60-20-20-Shuffled-3rd/checkpoint-1710",
4
+ "epoch": 14.934497816593886,
5
+ "eval_steps": 500,
6
+ "global_step": 1710,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.04,
13
+ "learning_rate": 1.6244314489928526e-07,
14
+ "loss": 1.9525,
15
+ "step": 5
16
+ },
17
+ {
18
+ "epoch": 0.09,
19
+ "learning_rate": 3.248862897985705e-07,
20
+ "loss": 1.9512,
21
+ "step": 10
22
+ },
23
+ {
24
+ "epoch": 0.13,
25
+ "learning_rate": 4.873294346978557e-07,
26
+ "loss": 1.9512,
27
+ "step": 15
28
+ },
29
+ {
30
+ "epoch": 0.17,
31
+ "learning_rate": 6.49772579597141e-07,
32
+ "loss": 1.9484,
33
+ "step": 20
34
+ },
35
+ {
36
+ "epoch": 0.22,
37
+ "learning_rate": 8.122157244964262e-07,
38
+ "loss": 1.9582,
39
+ "step": 25
40
+ },
41
+ {
42
+ "epoch": 0.26,
43
+ "learning_rate": 9.746588693957115e-07,
44
+ "loss": 1.9481,
45
+ "step": 30
46
+ },
47
+ {
48
+ "epoch": 0.31,
49
+ "learning_rate": 1.1371020142949968e-06,
50
+ "loss": 1.9428,
51
+ "step": 35
52
+ },
53
+ {
54
+ "epoch": 0.35,
55
+ "learning_rate": 1.299545159194282e-06,
56
+ "loss": 1.9426,
57
+ "step": 40
58
+ },
59
+ {
60
+ "epoch": 0.39,
61
+ "learning_rate": 1.4619883040935671e-06,
62
+ "loss": 1.949,
63
+ "step": 45
64
+ },
65
+ {
66
+ "epoch": 0.44,
67
+ "learning_rate": 1.6244314489928524e-06,
68
+ "loss": 1.9452,
69
+ "step": 50
70
+ },
71
+ {
72
+ "epoch": 0.48,
73
+ "learning_rate": 1.7868745938921377e-06,
74
+ "loss": 1.9423,
75
+ "step": 55
76
+ },
77
+ {
78
+ "epoch": 0.52,
79
+ "learning_rate": 1.949317738791423e-06,
80
+ "loss": 1.9445,
81
+ "step": 60
82
+ },
83
+ {
84
+ "epoch": 0.57,
85
+ "learning_rate": 2.1117608836907083e-06,
86
+ "loss": 1.9363,
87
+ "step": 65
88
+ },
89
+ {
90
+ "epoch": 0.61,
91
+ "learning_rate": 2.2742040285899936e-06,
92
+ "loss": 1.9339,
93
+ "step": 70
94
+ },
95
+ {
96
+ "epoch": 0.66,
97
+ "learning_rate": 2.436647173489279e-06,
98
+ "loss": 1.9354,
99
+ "step": 75
100
+ },
101
+ {
102
+ "epoch": 0.7,
103
+ "learning_rate": 2.599090318388564e-06,
104
+ "loss": 1.9331,
105
+ "step": 80
106
+ },
107
+ {
108
+ "epoch": 0.74,
109
+ "learning_rate": 2.7615334632878494e-06,
110
+ "loss": 1.9369,
111
+ "step": 85
112
+ },
113
+ {
114
+ "epoch": 0.79,
115
+ "learning_rate": 2.9239766081871343e-06,
116
+ "loss": 1.9274,
117
+ "step": 90
118
+ },
119
+ {
120
+ "epoch": 0.83,
121
+ "learning_rate": 3.0864197530864196e-06,
122
+ "loss": 1.9253,
123
+ "step": 95
124
+ },
125
+ {
126
+ "epoch": 0.87,
127
+ "learning_rate": 3.248862897985705e-06,
128
+ "loss": 1.915,
129
+ "step": 100
130
+ },
131
+ {
132
+ "epoch": 0.92,
133
+ "learning_rate": 3.41130604288499e-06,
134
+ "loss": 1.927,
135
+ "step": 105
136
+ },
137
+ {
138
+ "epoch": 0.96,
139
+ "learning_rate": 3.5737491877842754e-06,
140
+ "loss": 1.9123,
141
+ "step": 110
142
+ },
143
+ {
144
+ "epoch": 1.0,
145
+ "eval_accuracy": 0.22413793103448276,
146
+ "eval_loss": 1.914461374282837,
147
+ "eval_runtime": 377.1313,
148
+ "eval_samples_per_second": 3.23,
149
+ "eval_steps_per_second": 0.204,
150
+ "step": 114
151
+ },
152
+ {
153
+ "epoch": 1.0,
154
+ "learning_rate": 3.7361923326835607e-06,
155
+ "loss": 1.9076,
156
+ "step": 115
157
+ },
158
+ {
159
+ "epoch": 1.05,
160
+ "learning_rate": 3.898635477582846e-06,
161
+ "loss": 1.9081,
162
+ "step": 120
163
+ },
164
+ {
165
+ "epoch": 1.09,
166
+ "learning_rate": 4.061078622482131e-06,
167
+ "loss": 1.8984,
168
+ "step": 125
169
+ },
170
+ {
171
+ "epoch": 1.14,
172
+ "learning_rate": 4.2235217673814166e-06,
173
+ "loss": 1.8989,
174
+ "step": 130
175
+ },
176
+ {
177
+ "epoch": 1.18,
178
+ "learning_rate": 4.3859649122807014e-06,
179
+ "loss": 1.8838,
180
+ "step": 135
181
+ },
182
+ {
183
+ "epoch": 1.22,
184
+ "learning_rate": 4.548408057179987e-06,
185
+ "loss": 1.879,
186
+ "step": 140
187
+ },
188
+ {
189
+ "epoch": 1.27,
190
+ "learning_rate": 4.710851202079272e-06,
191
+ "loss": 1.885,
192
+ "step": 145
193
+ },
194
+ {
195
+ "epoch": 1.31,
196
+ "learning_rate": 4.873294346978558e-06,
197
+ "loss": 1.8768,
198
+ "step": 150
199
+ },
200
+ {
201
+ "epoch": 1.35,
202
+ "learning_rate": 5.0357374918778426e-06,
203
+ "loss": 1.8656,
204
+ "step": 155
205
+ },
206
+ {
207
+ "epoch": 1.4,
208
+ "learning_rate": 5.198180636777128e-06,
209
+ "loss": 1.859,
210
+ "step": 160
211
+ },
212
+ {
213
+ "epoch": 1.44,
214
+ "learning_rate": 5.360623781676413e-06,
215
+ "loss": 1.8556,
216
+ "step": 165
217
+ },
218
+ {
219
+ "epoch": 1.48,
220
+ "learning_rate": 5.523066926575699e-06,
221
+ "loss": 1.8514,
222
+ "step": 170
223
+ },
224
+ {
225
+ "epoch": 1.53,
226
+ "learning_rate": 5.685510071474984e-06,
227
+ "loss": 1.842,
228
+ "step": 175
229
+ },
230
+ {
231
+ "epoch": 1.57,
232
+ "learning_rate": 5.8479532163742686e-06,
233
+ "loss": 1.8187,
234
+ "step": 180
235
+ },
236
+ {
237
+ "epoch": 1.62,
238
+ "learning_rate": 6.010396361273554e-06,
239
+ "loss": 1.8254,
240
+ "step": 185
241
+ },
242
+ {
243
+ "epoch": 1.66,
244
+ "learning_rate": 6.172839506172839e-06,
245
+ "loss": 1.8086,
246
+ "step": 190
247
+ },
248
+ {
249
+ "epoch": 1.7,
250
+ "learning_rate": 6.335282651072125e-06,
251
+ "loss": 1.7918,
252
+ "step": 195
253
+ },
254
+ {
255
+ "epoch": 1.75,
256
+ "learning_rate": 6.49772579597141e-06,
257
+ "loss": 1.7671,
258
+ "step": 200
259
+ },
260
+ {
261
+ "epoch": 1.79,
262
+ "learning_rate": 6.660168940870695e-06,
263
+ "loss": 1.7675,
264
+ "step": 205
265
+ },
266
+ {
267
+ "epoch": 1.83,
268
+ "learning_rate": 6.82261208576998e-06,
269
+ "loss": 1.7677,
270
+ "step": 210
271
+ },
272
+ {
273
+ "epoch": 1.88,
274
+ "learning_rate": 6.985055230669266e-06,
275
+ "loss": 1.7123,
276
+ "step": 215
277
+ },
278
+ {
279
+ "epoch": 1.92,
280
+ "learning_rate": 7.147498375568551e-06,
281
+ "loss": 1.7342,
282
+ "step": 220
283
+ },
284
+ {
285
+ "epoch": 1.97,
286
+ "learning_rate": 7.3099415204678366e-06,
287
+ "loss": 1.7059,
288
+ "step": 225
289
+ },
290
+ {
291
+ "epoch": 2.0,
292
+ "eval_accuracy": 0.5599343185550082,
293
+ "eval_loss": 1.6894936561584473,
294
+ "eval_runtime": 14.2791,
295
+ "eval_samples_per_second": 85.299,
296
+ "eval_steps_per_second": 5.392,
297
+ "step": 229
298
+ },
299
+ {
300
+ "epoch": 2.01,
301
+ "learning_rate": 7.4723846653671214e-06,
302
+ "loss": 1.671,
303
+ "step": 230
304
+ },
305
+ {
306
+ "epoch": 2.05,
307
+ "learning_rate": 7.634827810266407e-06,
308
+ "loss": 1.6611,
309
+ "step": 235
310
+ },
311
+ {
312
+ "epoch": 2.1,
313
+ "learning_rate": 7.797270955165692e-06,
314
+ "loss": 1.6648,
315
+ "step": 240
316
+ },
317
+ {
318
+ "epoch": 2.14,
319
+ "learning_rate": 7.959714100064977e-06,
320
+ "loss": 1.6345,
321
+ "step": 245
322
+ },
323
+ {
324
+ "epoch": 2.18,
325
+ "learning_rate": 8.122157244964262e-06,
326
+ "loss": 1.6003,
327
+ "step": 250
328
+ },
329
+ {
330
+ "epoch": 2.23,
331
+ "learning_rate": 8.284600389863548e-06,
332
+ "loss": 1.6394,
333
+ "step": 255
334
+ },
335
+ {
336
+ "epoch": 2.27,
337
+ "learning_rate": 8.447043534762833e-06,
338
+ "loss": 1.6096,
339
+ "step": 260
340
+ },
341
+ {
342
+ "epoch": 2.31,
343
+ "learning_rate": 8.609486679662118e-06,
344
+ "loss": 1.5623,
345
+ "step": 265
346
+ },
347
+ {
348
+ "epoch": 2.36,
349
+ "learning_rate": 8.771929824561403e-06,
350
+ "loss": 1.5776,
351
+ "step": 270
352
+ },
353
+ {
354
+ "epoch": 2.4,
355
+ "learning_rate": 8.93437296946069e-06,
356
+ "loss": 1.5345,
357
+ "step": 275
358
+ },
359
+ {
360
+ "epoch": 2.45,
361
+ "learning_rate": 9.096816114359974e-06,
362
+ "loss": 1.5747,
363
+ "step": 280
364
+ },
365
+ {
366
+ "epoch": 2.49,
367
+ "learning_rate": 9.259259259259259e-06,
368
+ "loss": 1.5132,
369
+ "step": 285
370
+ },
371
+ {
372
+ "epoch": 2.53,
373
+ "learning_rate": 9.421702404158544e-06,
374
+ "loss": 1.4826,
375
+ "step": 290
376
+ },
377
+ {
378
+ "epoch": 2.58,
379
+ "learning_rate": 9.584145549057829e-06,
380
+ "loss": 1.5075,
381
+ "step": 295
382
+ },
383
+ {
384
+ "epoch": 2.62,
385
+ "learning_rate": 9.746588693957115e-06,
386
+ "loss": 1.4527,
387
+ "step": 300
388
+ },
389
+ {
390
+ "epoch": 2.66,
391
+ "learning_rate": 9.9090318388564e-06,
392
+ "loss": 1.4805,
393
+ "step": 305
394
+ },
395
+ {
396
+ "epoch": 2.71,
397
+ "learning_rate": 1.0071474983755685e-05,
398
+ "loss": 1.4585,
399
+ "step": 310
400
+ },
401
+ {
402
+ "epoch": 2.75,
403
+ "learning_rate": 1.023391812865497e-05,
404
+ "loss": 1.4536,
405
+ "step": 315
406
+ },
407
+ {
408
+ "epoch": 2.79,
409
+ "learning_rate": 1.0396361273554257e-05,
410
+ "loss": 1.3963,
411
+ "step": 320
412
+ },
413
+ {
414
+ "epoch": 2.84,
415
+ "learning_rate": 1.0558804418453541e-05,
416
+ "loss": 1.405,
417
+ "step": 325
418
+ },
419
+ {
420
+ "epoch": 2.88,
421
+ "learning_rate": 1.0721247563352826e-05,
422
+ "loss": 1.4295,
423
+ "step": 330
424
+ },
425
+ {
426
+ "epoch": 2.93,
427
+ "learning_rate": 1.0883690708252111e-05,
428
+ "loss": 1.3754,
429
+ "step": 335
430
+ },
431
+ {
432
+ "epoch": 2.97,
433
+ "learning_rate": 1.1046133853151398e-05,
434
+ "loss": 1.3919,
435
+ "step": 340
436
+ },
437
+ {
438
+ "epoch": 3.0,
439
+ "eval_accuracy": 0.6633825944170771,
440
+ "eval_loss": 1.319370985031128,
441
+ "eval_runtime": 13.9747,
442
+ "eval_samples_per_second": 87.158,
443
+ "eval_steps_per_second": 5.51,
444
+ "step": 343
445
+ },
446
+ {
447
+ "epoch": 3.01,
448
+ "learning_rate": 1.1208576998050683e-05,
449
+ "loss": 1.3057,
450
+ "step": 345
451
+ },
452
+ {
453
+ "epoch": 3.06,
454
+ "learning_rate": 1.1371020142949967e-05,
455
+ "loss": 1.2981,
456
+ "step": 350
457
+ },
458
+ {
459
+ "epoch": 3.1,
460
+ "learning_rate": 1.1533463287849252e-05,
461
+ "loss": 1.3214,
462
+ "step": 355
463
+ },
464
+ {
465
+ "epoch": 3.14,
466
+ "learning_rate": 1.1695906432748537e-05,
467
+ "loss": 1.3028,
468
+ "step": 360
469
+ },
470
+ {
471
+ "epoch": 3.19,
472
+ "learning_rate": 1.1858349577647824e-05,
473
+ "loss": 1.2512,
474
+ "step": 365
475
+ },
476
+ {
477
+ "epoch": 3.23,
478
+ "learning_rate": 1.2020792722547109e-05,
479
+ "loss": 1.2558,
480
+ "step": 370
481
+ },
482
+ {
483
+ "epoch": 3.28,
484
+ "learning_rate": 1.2183235867446393e-05,
485
+ "loss": 1.2195,
486
+ "step": 375
487
+ },
488
+ {
489
+ "epoch": 3.32,
490
+ "learning_rate": 1.2345679012345678e-05,
491
+ "loss": 1.2963,
492
+ "step": 380
493
+ },
494
+ {
495
+ "epoch": 3.36,
496
+ "learning_rate": 1.2508122157244965e-05,
497
+ "loss": 1.2549,
498
+ "step": 385
499
+ },
500
+ {
501
+ "epoch": 3.41,
502
+ "learning_rate": 1.267056530214425e-05,
503
+ "loss": 1.2753,
504
+ "step": 390
505
+ },
506
+ {
507
+ "epoch": 3.45,
508
+ "learning_rate": 1.2833008447043535e-05,
509
+ "loss": 1.2366,
510
+ "step": 395
511
+ },
512
+ {
513
+ "epoch": 3.49,
514
+ "learning_rate": 1.299545159194282e-05,
515
+ "loss": 1.1684,
516
+ "step": 400
517
+ },
518
+ {
519
+ "epoch": 3.54,
520
+ "learning_rate": 1.3157894736842106e-05,
521
+ "loss": 1.1474,
522
+ "step": 405
523
+ },
524
+ {
525
+ "epoch": 3.58,
526
+ "learning_rate": 1.332033788174139e-05,
527
+ "loss": 1.2366,
528
+ "step": 410
529
+ },
530
+ {
531
+ "epoch": 3.62,
532
+ "learning_rate": 1.3482781026640676e-05,
533
+ "loss": 1.1156,
534
+ "step": 415
535
+ },
536
+ {
537
+ "epoch": 3.67,
538
+ "learning_rate": 1.364522417153996e-05,
539
+ "loss": 1.0825,
540
+ "step": 420
541
+ },
542
+ {
543
+ "epoch": 3.71,
544
+ "learning_rate": 1.3807667316439245e-05,
545
+ "loss": 1.1678,
546
+ "step": 425
547
+ },
548
+ {
549
+ "epoch": 3.76,
550
+ "learning_rate": 1.3970110461338532e-05,
551
+ "loss": 1.1521,
552
+ "step": 430
553
+ },
554
+ {
555
+ "epoch": 3.8,
556
+ "learning_rate": 1.4132553606237817e-05,
557
+ "loss": 1.0757,
558
+ "step": 435
559
+ },
560
+ {
561
+ "epoch": 3.84,
562
+ "learning_rate": 1.4294996751137102e-05,
563
+ "loss": 1.1882,
564
+ "step": 440
565
+ },
566
+ {
567
+ "epoch": 3.89,
568
+ "learning_rate": 1.4457439896036387e-05,
569
+ "loss": 1.0494,
570
+ "step": 445
571
+ },
572
+ {
573
+ "epoch": 3.93,
574
+ "learning_rate": 1.4619883040935673e-05,
575
+ "loss": 1.0706,
576
+ "step": 450
577
+ },
578
+ {
579
+ "epoch": 3.97,
580
+ "learning_rate": 1.4782326185834958e-05,
581
+ "loss": 1.0811,
582
+ "step": 455
583
+ },
584
+ {
585
+ "epoch": 4.0,
586
+ "eval_accuracy": 0.7151067323481116,
587
+ "eval_loss": 1.030263066291809,
588
+ "eval_runtime": 14.185,
589
+ "eval_samples_per_second": 85.865,
590
+ "eval_steps_per_second": 5.428,
591
+ "step": 458
592
+ },
593
+ {
594
+ "epoch": 4.02,
595
+ "learning_rate": 1.4944769330734243e-05,
596
+ "loss": 1.087,
597
+ "step": 460
598
+ },
599
+ {
600
+ "epoch": 4.06,
601
+ "learning_rate": 1.5107212475633528e-05,
602
+ "loss": 1.048,
603
+ "step": 465
604
+ },
605
+ {
606
+ "epoch": 4.1,
607
+ "learning_rate": 1.5269655620532814e-05,
608
+ "loss": 0.9958,
609
+ "step": 470
610
+ },
611
+ {
612
+ "epoch": 4.15,
613
+ "learning_rate": 1.54320987654321e-05,
614
+ "loss": 0.9875,
615
+ "step": 475
616
+ },
617
+ {
618
+ "epoch": 4.19,
619
+ "learning_rate": 1.5594541910331384e-05,
620
+ "loss": 0.974,
621
+ "step": 480
622
+ },
623
+ {
624
+ "epoch": 4.24,
625
+ "learning_rate": 1.575698505523067e-05,
626
+ "loss": 1.0003,
627
+ "step": 485
628
+ },
629
+ {
630
+ "epoch": 4.28,
631
+ "learning_rate": 1.5919428200129954e-05,
632
+ "loss": 1.1908,
633
+ "step": 490
634
+ },
635
+ {
636
+ "epoch": 4.32,
637
+ "learning_rate": 1.608187134502924e-05,
638
+ "loss": 0.9534,
639
+ "step": 495
640
+ },
641
+ {
642
+ "epoch": 4.37,
643
+ "learning_rate": 1.6244314489928523e-05,
644
+ "loss": 0.9967,
645
+ "step": 500
646
+ },
647
+ {
648
+ "epoch": 4.41,
649
+ "learning_rate": 1.640675763482781e-05,
650
+ "loss": 0.9369,
651
+ "step": 505
652
+ },
653
+ {
654
+ "epoch": 4.45,
655
+ "learning_rate": 1.6569200779727097e-05,
656
+ "loss": 0.923,
657
+ "step": 510
658
+ },
659
+ {
660
+ "epoch": 4.5,
661
+ "learning_rate": 1.673164392462638e-05,
662
+ "loss": 0.9534,
663
+ "step": 515
664
+ },
665
+ {
666
+ "epoch": 4.54,
667
+ "learning_rate": 1.6894087069525666e-05,
668
+ "loss": 0.8914,
669
+ "step": 520
670
+ },
671
+ {
672
+ "epoch": 4.59,
673
+ "learning_rate": 1.705653021442495e-05,
674
+ "loss": 0.9275,
675
+ "step": 525
676
+ },
677
+ {
678
+ "epoch": 4.63,
679
+ "learning_rate": 1.7218973359324236e-05,
680
+ "loss": 0.9442,
681
+ "step": 530
682
+ },
683
+ {
684
+ "epoch": 4.67,
685
+ "learning_rate": 1.738141650422352e-05,
686
+ "loss": 0.9798,
687
+ "step": 535
688
+ },
689
+ {
690
+ "epoch": 4.72,
691
+ "learning_rate": 1.7543859649122806e-05,
692
+ "loss": 0.9844,
693
+ "step": 540
694
+ },
695
+ {
696
+ "epoch": 4.76,
697
+ "learning_rate": 1.770630279402209e-05,
698
+ "loss": 0.9517,
699
+ "step": 545
700
+ },
701
+ {
702
+ "epoch": 4.8,
703
+ "learning_rate": 1.786874593892138e-05,
704
+ "loss": 0.8746,
705
+ "step": 550
706
+ },
707
+ {
708
+ "epoch": 4.85,
709
+ "learning_rate": 1.8031189083820664e-05,
710
+ "loss": 0.9737,
711
+ "step": 555
712
+ },
713
+ {
714
+ "epoch": 4.89,
715
+ "learning_rate": 1.819363222871995e-05,
716
+ "loss": 1.0315,
717
+ "step": 560
718
+ },
719
+ {
720
+ "epoch": 4.93,
721
+ "learning_rate": 1.8356075373619233e-05,
722
+ "loss": 0.9309,
723
+ "step": 565
724
+ },
725
+ {
726
+ "epoch": 4.98,
727
+ "learning_rate": 1.8518518518518518e-05,
728
+ "loss": 0.9301,
729
+ "step": 570
730
+ },
731
+ {
732
+ "epoch": 5.0,
733
+ "eval_accuracy": 0.7561576354679803,
734
+ "eval_loss": 0.8376412987709045,
735
+ "eval_runtime": 14.173,
736
+ "eval_samples_per_second": 85.938,
737
+ "eval_steps_per_second": 5.433,
738
+ "step": 572
739
+ },
740
+ {
741
+ "epoch": 5.02,
742
+ "learning_rate": 1.8680961663417803e-05,
743
+ "loss": 0.9062,
744
+ "step": 575
745
+ },
746
+ {
747
+ "epoch": 5.07,
748
+ "learning_rate": 1.8843404808317088e-05,
749
+ "loss": 0.9207,
750
+ "step": 580
751
+ },
752
+ {
753
+ "epoch": 5.11,
754
+ "learning_rate": 1.9005847953216373e-05,
755
+ "loss": 0.9726,
756
+ "step": 585
757
+ },
758
+ {
759
+ "epoch": 5.15,
760
+ "learning_rate": 1.9168291098115658e-05,
761
+ "loss": 1.001,
762
+ "step": 590
763
+ },
764
+ {
765
+ "epoch": 5.2,
766
+ "learning_rate": 1.9330734243014946e-05,
767
+ "loss": 0.9216,
768
+ "step": 595
769
+ },
770
+ {
771
+ "epoch": 5.24,
772
+ "learning_rate": 1.949317738791423e-05,
773
+ "loss": 0.8762,
774
+ "step": 600
775
+ },
776
+ {
777
+ "epoch": 5.28,
778
+ "learning_rate": 1.9655620532813516e-05,
779
+ "loss": 0.9166,
780
+ "step": 605
781
+ },
782
+ {
783
+ "epoch": 5.33,
784
+ "learning_rate": 1.98180636777128e-05,
785
+ "loss": 0.8569,
786
+ "step": 610
787
+ },
788
+ {
789
+ "epoch": 5.37,
790
+ "learning_rate": 1.9980506822612085e-05,
791
+ "loss": 0.7795,
792
+ "step": 615
793
+ },
794
+ {
795
+ "epoch": 5.41,
796
+ "learning_rate": 2.014294996751137e-05,
797
+ "loss": 0.826,
798
+ "step": 620
799
+ },
800
+ {
801
+ "epoch": 5.46,
802
+ "learning_rate": 2.0305393112410655e-05,
803
+ "loss": 0.8161,
804
+ "step": 625
805
+ },
806
+ {
807
+ "epoch": 5.5,
808
+ "learning_rate": 2.046783625730994e-05,
809
+ "loss": 0.7988,
810
+ "step": 630
811
+ },
812
+ {
813
+ "epoch": 5.55,
814
+ "learning_rate": 2.0630279402209228e-05,
815
+ "loss": 0.8475,
816
+ "step": 635
817
+ },
818
+ {
819
+ "epoch": 5.59,
820
+ "learning_rate": 2.0792722547108513e-05,
821
+ "loss": 0.7824,
822
+ "step": 640
823
+ },
824
+ {
825
+ "epoch": 5.63,
826
+ "learning_rate": 2.0955165692007798e-05,
827
+ "loss": 0.7193,
828
+ "step": 645
829
+ },
830
+ {
831
+ "epoch": 5.68,
832
+ "learning_rate": 2.1117608836907083e-05,
833
+ "loss": 0.828,
834
+ "step": 650
835
+ },
836
+ {
837
+ "epoch": 5.72,
838
+ "learning_rate": 2.1280051981806368e-05,
839
+ "loss": 0.7638,
840
+ "step": 655
841
+ },
842
+ {
843
+ "epoch": 5.76,
844
+ "learning_rate": 2.1442495126705653e-05,
845
+ "loss": 0.8164,
846
+ "step": 660
847
+ },
848
+ {
849
+ "epoch": 5.81,
850
+ "learning_rate": 2.1604938271604937e-05,
851
+ "loss": 0.6875,
852
+ "step": 665
853
+ },
854
+ {
855
+ "epoch": 5.85,
856
+ "learning_rate": 2.1767381416504222e-05,
857
+ "loss": 0.6429,
858
+ "step": 670
859
+ },
860
+ {
861
+ "epoch": 5.9,
862
+ "learning_rate": 2.1929824561403507e-05,
863
+ "loss": 0.6859,
864
+ "step": 675
865
+ },
866
+ {
867
+ "epoch": 5.94,
868
+ "learning_rate": 2.2092267706302795e-05,
869
+ "loss": 0.7012,
870
+ "step": 680
871
+ },
872
+ {
873
+ "epoch": 5.98,
874
+ "learning_rate": 2.225471085120208e-05,
875
+ "loss": 0.7336,
876
+ "step": 685
877
+ },
878
+ {
879
+ "epoch": 6.0,
880
+ "eval_accuracy": 0.8374384236453202,
881
+ "eval_loss": 0.6449394226074219,
882
+ "eval_runtime": 14.2954,
883
+ "eval_samples_per_second": 85.202,
884
+ "eval_steps_per_second": 5.386,
885
+ "step": 687
886
+ },
887
+ {
888
+ "epoch": 6.03,
889
+ "learning_rate": 2.2417153996101365e-05,
890
+ "loss": 0.7113,
891
+ "step": 690
892
+ },
893
+ {
894
+ "epoch": 6.07,
895
+ "learning_rate": 2.257959714100065e-05,
896
+ "loss": 0.6328,
897
+ "step": 695
898
+ },
899
+ {
900
+ "epoch": 6.11,
901
+ "learning_rate": 2.2742040285899935e-05,
902
+ "loss": 0.7496,
903
+ "step": 700
904
+ },
905
+ {
906
+ "epoch": 6.16,
907
+ "learning_rate": 2.290448343079922e-05,
908
+ "loss": 0.8733,
909
+ "step": 705
910
+ },
911
+ {
912
+ "epoch": 6.2,
913
+ "learning_rate": 2.3066926575698505e-05,
914
+ "loss": 0.7935,
915
+ "step": 710
916
+ },
917
+ {
918
+ "epoch": 6.24,
919
+ "learning_rate": 2.322936972059779e-05,
920
+ "loss": 0.8732,
921
+ "step": 715
922
+ },
923
+ {
924
+ "epoch": 6.29,
925
+ "learning_rate": 2.3391812865497074e-05,
926
+ "loss": 0.7589,
927
+ "step": 720
928
+ },
929
+ {
930
+ "epoch": 6.33,
931
+ "learning_rate": 2.3554256010396363e-05,
932
+ "loss": 0.6315,
933
+ "step": 725
934
+ },
935
+ {
936
+ "epoch": 6.38,
937
+ "learning_rate": 2.3716699155295647e-05,
938
+ "loss": 0.7392,
939
+ "step": 730
940
+ },
941
+ {
942
+ "epoch": 6.42,
943
+ "learning_rate": 2.3879142300194932e-05,
944
+ "loss": 0.672,
945
+ "step": 735
946
+ },
947
+ {
948
+ "epoch": 6.46,
949
+ "learning_rate": 2.4041585445094217e-05,
950
+ "loss": 0.6742,
951
+ "step": 740
952
+ },
953
+ {
954
+ "epoch": 6.51,
955
+ "learning_rate": 2.4204028589993502e-05,
956
+ "loss": 0.5929,
957
+ "step": 745
958
+ },
959
+ {
960
+ "epoch": 6.55,
961
+ "learning_rate": 2.4366471734892787e-05,
962
+ "loss": 0.6387,
963
+ "step": 750
964
+ },
965
+ {
966
+ "epoch": 6.59,
967
+ "learning_rate": 2.4528914879792072e-05,
968
+ "loss": 0.6444,
969
+ "step": 755
970
+ },
971
+ {
972
+ "epoch": 6.64,
973
+ "learning_rate": 2.4691358024691357e-05,
974
+ "loss": 0.6301,
975
+ "step": 760
976
+ },
977
+ {
978
+ "epoch": 6.68,
979
+ "learning_rate": 2.485380116959064e-05,
980
+ "loss": 0.66,
981
+ "step": 765
982
+ },
983
+ {
984
+ "epoch": 6.72,
985
+ "learning_rate": 2.501624431448993e-05,
986
+ "loss": 0.6949,
987
+ "step": 770
988
+ },
989
+ {
990
+ "epoch": 6.77,
991
+ "learning_rate": 2.5178687459389218e-05,
992
+ "loss": 0.6736,
993
+ "step": 775
994
+ },
995
+ {
996
+ "epoch": 6.81,
997
+ "learning_rate": 2.53411306042885e-05,
998
+ "loss": 0.8662,
999
+ "step": 780
1000
+ },
1001
+ {
1002
+ "epoch": 6.86,
1003
+ "learning_rate": 2.5503573749187788e-05,
1004
+ "loss": 0.5951,
1005
+ "step": 785
1006
+ },
1007
+ {
1008
+ "epoch": 6.9,
1009
+ "learning_rate": 2.566601689408707e-05,
1010
+ "loss": 0.671,
1011
+ "step": 790
1012
+ },
1013
+ {
1014
+ "epoch": 6.94,
1015
+ "learning_rate": 2.5828460038986357e-05,
1016
+ "loss": 0.5656,
1017
+ "step": 795
1018
+ },
1019
+ {
1020
+ "epoch": 6.99,
1021
+ "learning_rate": 2.599090318388564e-05,
1022
+ "loss": 0.5805,
1023
+ "step": 800
1024
+ },
1025
+ {
1026
+ "epoch": 7.0,
1027
+ "eval_accuracy": 0.8735632183908046,
1028
+ "eval_loss": 0.5090786814689636,
1029
+ "eval_runtime": 14.2885,
1030
+ "eval_samples_per_second": 85.243,
1031
+ "eval_steps_per_second": 5.389,
1032
+ "step": 801
1033
+ },
1034
+ {
1035
+ "epoch": 7.03,
1036
+ "learning_rate": 2.6153346328784927e-05,
1037
+ "loss": 0.5979,
1038
+ "step": 805
1039
+ },
1040
+ {
1041
+ "epoch": 7.07,
1042
+ "learning_rate": 2.6315789473684212e-05,
1043
+ "loss": 0.6142,
1044
+ "step": 810
1045
+ },
1046
+ {
1047
+ "epoch": 7.12,
1048
+ "learning_rate": 2.6478232618583497e-05,
1049
+ "loss": 0.5754,
1050
+ "step": 815
1051
+ },
1052
+ {
1053
+ "epoch": 7.16,
1054
+ "learning_rate": 2.664067576348278e-05,
1055
+ "loss": 0.6194,
1056
+ "step": 820
1057
+ },
1058
+ {
1059
+ "epoch": 7.21,
1060
+ "learning_rate": 2.680311890838207e-05,
1061
+ "loss": 0.7505,
1062
+ "step": 825
1063
+ },
1064
+ {
1065
+ "epoch": 7.25,
1066
+ "learning_rate": 2.696556205328135e-05,
1067
+ "loss": 0.6599,
1068
+ "step": 830
1069
+ },
1070
+ {
1071
+ "epoch": 7.29,
1072
+ "learning_rate": 2.712800519818064e-05,
1073
+ "loss": 0.6005,
1074
+ "step": 835
1075
+ },
1076
+ {
1077
+ "epoch": 7.34,
1078
+ "learning_rate": 2.729044834307992e-05,
1079
+ "loss": 0.5826,
1080
+ "step": 840
1081
+ },
1082
+ {
1083
+ "epoch": 7.38,
1084
+ "learning_rate": 2.745289148797921e-05,
1085
+ "loss": 0.4662,
1086
+ "step": 845
1087
+ },
1088
+ {
1089
+ "epoch": 7.42,
1090
+ "learning_rate": 2.761533463287849e-05,
1091
+ "loss": 0.4749,
1092
+ "step": 850
1093
+ },
1094
+ {
1095
+ "epoch": 7.47,
1096
+ "learning_rate": 2.777777777777778e-05,
1097
+ "loss": 0.5808,
1098
+ "step": 855
1099
+ },
1100
+ {
1101
+ "epoch": 7.51,
1102
+ "learning_rate": 2.7940220922677064e-05,
1103
+ "loss": 0.5508,
1104
+ "step": 860
1105
+ },
1106
+ {
1107
+ "epoch": 7.55,
1108
+ "learning_rate": 2.8102664067576352e-05,
1109
+ "loss": 0.562,
1110
+ "step": 865
1111
+ },
1112
+ {
1113
+ "epoch": 7.6,
1114
+ "learning_rate": 2.8265107212475634e-05,
1115
+ "loss": 0.4951,
1116
+ "step": 870
1117
+ },
1118
+ {
1119
+ "epoch": 7.64,
1120
+ "learning_rate": 2.8427550357374922e-05,
1121
+ "loss": 0.8779,
1122
+ "step": 875
1123
+ },
1124
+ {
1125
+ "epoch": 7.69,
1126
+ "learning_rate": 2.8589993502274203e-05,
1127
+ "loss": 0.6447,
1128
+ "step": 880
1129
+ },
1130
+ {
1131
+ "epoch": 7.73,
1132
+ "learning_rate": 2.875243664717349e-05,
1133
+ "loss": 0.6258,
1134
+ "step": 885
1135
+ },
1136
+ {
1137
+ "epoch": 7.77,
1138
+ "learning_rate": 2.8914879792072773e-05,
1139
+ "loss": 0.6469,
1140
+ "step": 890
1141
+ },
1142
+ {
1143
+ "epoch": 7.82,
1144
+ "learning_rate": 2.907732293697206e-05,
1145
+ "loss": 0.5322,
1146
+ "step": 895
1147
+ },
1148
+ {
1149
+ "epoch": 7.86,
1150
+ "learning_rate": 2.9239766081871346e-05,
1151
+ "loss": 0.5236,
1152
+ "step": 900
1153
+ },
1154
+ {
1155
+ "epoch": 7.9,
1156
+ "learning_rate": 2.9402209226770635e-05,
1157
+ "loss": 0.6151,
1158
+ "step": 905
1159
+ },
1160
+ {
1161
+ "epoch": 7.95,
1162
+ "learning_rate": 2.9564652371669916e-05,
1163
+ "loss": 0.5125,
1164
+ "step": 910
1165
+ },
1166
+ {
1167
+ "epoch": 7.99,
1168
+ "learning_rate": 2.9727095516569204e-05,
1169
+ "loss": 0.5982,
1170
+ "step": 915
1171
+ },
1172
+ {
1173
+ "epoch": 8.0,
1174
+ "eval_accuracy": 0.8825944170771757,
1175
+ "eval_loss": 0.4677470922470093,
1176
+ "eval_runtime": 14.3782,
1177
+ "eval_samples_per_second": 84.711,
1178
+ "eval_steps_per_second": 5.355,
1179
+ "step": 916
1180
+ },
1181
+ {
1182
+ "epoch": 8.03,
1183
+ "learning_rate": 2.9889538661468486e-05,
1184
+ "loss": 0.5948,
1185
+ "step": 920
1186
+ },
1187
+ {
1188
+ "epoch": 8.08,
1189
+ "learning_rate": 3.0051981806367774e-05,
1190
+ "loss": 0.6046,
1191
+ "step": 925
1192
+ },
1193
+ {
1194
+ "epoch": 8.12,
1195
+ "learning_rate": 3.0214424951267055e-05,
1196
+ "loss": 0.7253,
1197
+ "step": 930
1198
+ },
1199
+ {
1200
+ "epoch": 8.17,
1201
+ "learning_rate": 3.0376868096166344e-05,
1202
+ "loss": 0.5269,
1203
+ "step": 935
1204
+ },
1205
+ {
1206
+ "epoch": 8.21,
1207
+ "learning_rate": 3.053931124106563e-05,
1208
+ "loss": 0.665,
1209
+ "step": 940
1210
+ },
1211
+ {
1212
+ "epoch": 8.25,
1213
+ "learning_rate": 3.0701754385964913e-05,
1214
+ "loss": 0.4819,
1215
+ "step": 945
1216
+ },
1217
+ {
1218
+ "epoch": 8.3,
1219
+ "learning_rate": 3.08641975308642e-05,
1220
+ "loss": 0.558,
1221
+ "step": 950
1222
+ },
1223
+ {
1224
+ "epoch": 8.34,
1225
+ "learning_rate": 3.102664067576348e-05,
1226
+ "loss": 0.5623,
1227
+ "step": 955
1228
+ },
1229
+ {
1230
+ "epoch": 8.38,
1231
+ "learning_rate": 3.118908382066277e-05,
1232
+ "loss": 0.6116,
1233
+ "step": 960
1234
+ },
1235
+ {
1236
+ "epoch": 8.43,
1237
+ "learning_rate": 3.135152696556205e-05,
1238
+ "loss": 0.5544,
1239
+ "step": 965
1240
+ },
1241
+ {
1242
+ "epoch": 8.47,
1243
+ "learning_rate": 3.151397011046134e-05,
1244
+ "loss": 0.4559,
1245
+ "step": 970
1246
+ },
1247
+ {
1248
+ "epoch": 8.52,
1249
+ "learning_rate": 3.167641325536063e-05,
1250
+ "loss": 0.5572,
1251
+ "step": 975
1252
+ },
1253
+ {
1254
+ "epoch": 8.56,
1255
+ "learning_rate": 3.183885640025991e-05,
1256
+ "loss": 0.5206,
1257
+ "step": 980
1258
+ },
1259
+ {
1260
+ "epoch": 8.6,
1261
+ "learning_rate": 3.20012995451592e-05,
1262
+ "loss": 0.5465,
1263
+ "step": 985
1264
+ },
1265
+ {
1266
+ "epoch": 8.65,
1267
+ "learning_rate": 3.216374269005848e-05,
1268
+ "loss": 0.5293,
1269
+ "step": 990
1270
+ },
1271
+ {
1272
+ "epoch": 8.69,
1273
+ "learning_rate": 3.232618583495777e-05,
1274
+ "loss": 0.4627,
1275
+ "step": 995
1276
+ },
1277
+ {
1278
+ "epoch": 8.73,
1279
+ "learning_rate": 3.248862897985705e-05,
1280
+ "loss": 0.6437,
1281
+ "step": 1000
1282
+ },
1283
+ {
1284
+ "epoch": 8.78,
1285
+ "learning_rate": 3.265107212475634e-05,
1286
+ "loss": 0.4954,
1287
+ "step": 1005
1288
+ },
1289
+ {
1290
+ "epoch": 8.82,
1291
+ "learning_rate": 3.281351526965562e-05,
1292
+ "loss": 0.5089,
1293
+ "step": 1010
1294
+ },
1295
+ {
1296
+ "epoch": 8.86,
1297
+ "learning_rate": 3.297595841455491e-05,
1298
+ "loss": 0.5259,
1299
+ "step": 1015
1300
+ },
1301
+ {
1302
+ "epoch": 8.91,
1303
+ "learning_rate": 3.313840155945419e-05,
1304
+ "loss": 0.4522,
1305
+ "step": 1020
1306
+ },
1307
+ {
1308
+ "epoch": 8.95,
1309
+ "learning_rate": 3.330084470435348e-05,
1310
+ "loss": 0.5106,
1311
+ "step": 1025
1312
+ },
1313
+ {
1314
+ "epoch": 9.0,
1315
+ "learning_rate": 3.346328784925276e-05,
1316
+ "loss": 0.4939,
1317
+ "step": 1030
1318
+ },
1319
+ {
1320
+ "epoch": 9.0,
1321
+ "eval_accuracy": 0.8842364532019704,
1322
+ "eval_loss": 0.4029363989830017,
1323
+ "eval_runtime": 14.153,
1324
+ "eval_samples_per_second": 86.059,
1325
+ "eval_steps_per_second": 5.441,
1326
+ "step": 1030
1327
+ },
1328
+ {
1329
+ "epoch": 9.04,
1330
+ "learning_rate": 3.362573099415205e-05,
1331
+ "loss": 0.4433,
1332
+ "step": 1035
1333
+ },
1334
+ {
1335
+ "epoch": 9.08,
1336
+ "learning_rate": 3.378817413905133e-05,
1337
+ "loss": 0.3981,
1338
+ "step": 1040
1339
+ },
1340
+ {
1341
+ "epoch": 9.13,
1342
+ "learning_rate": 3.395061728395062e-05,
1343
+ "loss": 0.3883,
1344
+ "step": 1045
1345
+ },
1346
+ {
1347
+ "epoch": 9.17,
1348
+ "learning_rate": 3.41130604288499e-05,
1349
+ "loss": 0.4423,
1350
+ "step": 1050
1351
+ },
1352
+ {
1353
+ "epoch": 9.21,
1354
+ "learning_rate": 3.427550357374919e-05,
1355
+ "loss": 0.4946,
1356
+ "step": 1055
1357
+ },
1358
+ {
1359
+ "epoch": 9.26,
1360
+ "learning_rate": 3.443794671864847e-05,
1361
+ "loss": 0.3786,
1362
+ "step": 1060
1363
+ },
1364
+ {
1365
+ "epoch": 9.3,
1366
+ "learning_rate": 3.4600389863547764e-05,
1367
+ "loss": 0.4355,
1368
+ "step": 1065
1369
+ },
1370
+ {
1371
+ "epoch": 9.34,
1372
+ "learning_rate": 3.476283300844704e-05,
1373
+ "loss": 0.4098,
1374
+ "step": 1070
1375
+ },
1376
+ {
1377
+ "epoch": 9.39,
1378
+ "learning_rate": 3.492527615334633e-05,
1379
+ "loss": 0.465,
1380
+ "step": 1075
1381
+ },
1382
+ {
1383
+ "epoch": 9.43,
1384
+ "learning_rate": 3.508771929824561e-05,
1385
+ "loss": 0.4482,
1386
+ "step": 1080
1387
+ },
1388
+ {
1389
+ "epoch": 9.48,
1390
+ "learning_rate": 3.52501624431449e-05,
1391
+ "loss": 0.4087,
1392
+ "step": 1085
1393
+ },
1394
+ {
1395
+ "epoch": 9.52,
1396
+ "learning_rate": 3.541260558804418e-05,
1397
+ "loss": 0.3359,
1398
+ "step": 1090
1399
+ },
1400
+ {
1401
+ "epoch": 9.56,
1402
+ "learning_rate": 3.557504873294347e-05,
1403
+ "loss": 0.3615,
1404
+ "step": 1095
1405
+ },
1406
+ {
1407
+ "epoch": 9.61,
1408
+ "learning_rate": 3.573749187784276e-05,
1409
+ "loss": 0.4745,
1410
+ "step": 1100
1411
+ },
1412
+ {
1413
+ "epoch": 9.65,
1414
+ "learning_rate": 3.589993502274204e-05,
1415
+ "loss": 0.5523,
1416
+ "step": 1105
1417
+ },
1418
+ {
1419
+ "epoch": 9.69,
1420
+ "learning_rate": 3.606237816764133e-05,
1421
+ "loss": 0.4844,
1422
+ "step": 1110
1423
+ },
1424
+ {
1425
+ "epoch": 9.74,
1426
+ "learning_rate": 3.622482131254061e-05,
1427
+ "loss": 0.4739,
1428
+ "step": 1115
1429
+ },
1430
+ {
1431
+ "epoch": 9.78,
1432
+ "learning_rate": 3.63872644574399e-05,
1433
+ "loss": 0.516,
1434
+ "step": 1120
1435
+ },
1436
+ {
1437
+ "epoch": 9.83,
1438
+ "learning_rate": 3.654970760233918e-05,
1439
+ "loss": 0.4514,
1440
+ "step": 1125
1441
+ },
1442
+ {
1443
+ "epoch": 9.87,
1444
+ "learning_rate": 3.671215074723847e-05,
1445
+ "loss": 0.4085,
1446
+ "step": 1130
1447
+ },
1448
+ {
1449
+ "epoch": 9.91,
1450
+ "learning_rate": 3.687459389213775e-05,
1451
+ "loss": 0.3573,
1452
+ "step": 1135
1453
+ },
1454
+ {
1455
+ "epoch": 9.96,
1456
+ "learning_rate": 3.7037037037037037e-05,
1457
+ "loss": 0.3216,
1458
+ "step": 1140
1459
+ },
1460
+ {
1461
+ "epoch": 10.0,
1462
+ "learning_rate": 3.719948018193632e-05,
1463
+ "loss": 0.3296,
1464
+ "step": 1145
1465
+ },
1466
+ {
1467
+ "epoch": 10.0,
1468
+ "eval_accuracy": 0.9203612479474549,
1469
+ "eval_loss": 0.30508941411972046,
1470
+ "eval_runtime": 14.4142,
1471
+ "eval_samples_per_second": 84.5,
1472
+ "eval_steps_per_second": 5.342,
1473
+ "step": 1145
1474
+ },
1475
+ {
1476
+ "epoch": 10.04,
1477
+ "learning_rate": 3.7361923326835606e-05,
1478
+ "loss": 0.4359,
1479
+ "step": 1150
1480
+ },
1481
+ {
1482
+ "epoch": 10.09,
1483
+ "learning_rate": 3.75243664717349e-05,
1484
+ "loss": 0.3197,
1485
+ "step": 1155
1486
+ },
1487
+ {
1488
+ "epoch": 10.13,
1489
+ "learning_rate": 3.7686809616634176e-05,
1490
+ "loss": 0.2599,
1491
+ "step": 1160
1492
+ },
1493
+ {
1494
+ "epoch": 10.17,
1495
+ "learning_rate": 3.784925276153347e-05,
1496
+ "loss": 0.4766,
1497
+ "step": 1165
1498
+ },
1499
+ {
1500
+ "epoch": 10.22,
1501
+ "learning_rate": 3.8011695906432746e-05,
1502
+ "loss": 0.3636,
1503
+ "step": 1170
1504
+ },
1505
+ {
1506
+ "epoch": 10.26,
1507
+ "learning_rate": 3.817413905133204e-05,
1508
+ "loss": 0.3543,
1509
+ "step": 1175
1510
+ },
1511
+ {
1512
+ "epoch": 10.31,
1513
+ "learning_rate": 3.8336582196231315e-05,
1514
+ "loss": 0.4652,
1515
+ "step": 1180
1516
+ },
1517
+ {
1518
+ "epoch": 10.35,
1519
+ "learning_rate": 3.849902534113061e-05,
1520
+ "loss": 0.4386,
1521
+ "step": 1185
1522
+ },
1523
+ {
1524
+ "epoch": 10.39,
1525
+ "learning_rate": 3.866146848602989e-05,
1526
+ "loss": 0.5715,
1527
+ "step": 1190
1528
+ },
1529
+ {
1530
+ "epoch": 10.44,
1531
+ "learning_rate": 3.882391163092918e-05,
1532
+ "loss": 0.3944,
1533
+ "step": 1195
1534
+ },
1535
+ {
1536
+ "epoch": 10.48,
1537
+ "learning_rate": 3.898635477582846e-05,
1538
+ "loss": 0.4055,
1539
+ "step": 1200
1540
+ },
1541
+ {
1542
+ "epoch": 10.52,
1543
+ "learning_rate": 3.9148797920727747e-05,
1544
+ "loss": 0.473,
1545
+ "step": 1205
1546
+ },
1547
+ {
1548
+ "epoch": 10.57,
1549
+ "learning_rate": 3.931124106562703e-05,
1550
+ "loss": 0.4065,
1551
+ "step": 1210
1552
+ },
1553
+ {
1554
+ "epoch": 10.61,
1555
+ "learning_rate": 3.9473684210526316e-05,
1556
+ "loss": 0.3315,
1557
+ "step": 1215
1558
+ },
1559
+ {
1560
+ "epoch": 10.66,
1561
+ "learning_rate": 3.96361273554256e-05,
1562
+ "loss": 0.3246,
1563
+ "step": 1220
1564
+ },
1565
+ {
1566
+ "epoch": 10.7,
1567
+ "learning_rate": 3.9798570500324886e-05,
1568
+ "loss": 0.5089,
1569
+ "step": 1225
1570
+ },
1571
+ {
1572
+ "epoch": 10.74,
1573
+ "learning_rate": 3.996101364522417e-05,
1574
+ "loss": 0.3709,
1575
+ "step": 1230
1576
+ },
1577
+ {
1578
+ "epoch": 10.79,
1579
+ "learning_rate": 4.012345679012346e-05,
1580
+ "loss": 0.4847,
1581
+ "step": 1235
1582
+ },
1583
+ {
1584
+ "epoch": 10.83,
1585
+ "learning_rate": 4.028589993502274e-05,
1586
+ "loss": 0.3866,
1587
+ "step": 1240
1588
+ },
1589
+ {
1590
+ "epoch": 10.87,
1591
+ "learning_rate": 4.044834307992203e-05,
1592
+ "loss": 0.2914,
1593
+ "step": 1245
1594
+ },
1595
+ {
1596
+ "epoch": 10.92,
1597
+ "learning_rate": 4.061078622482131e-05,
1598
+ "loss": 0.3748,
1599
+ "step": 1250
1600
+ },
1601
+ {
1602
+ "epoch": 10.96,
1603
+ "learning_rate": 4.07732293697206e-05,
1604
+ "loss": 0.3559,
1605
+ "step": 1255
1606
+ },
1607
+ {
1608
+ "epoch": 11.0,
1609
+ "eval_accuracy": 0.8366174055829229,
1610
+ "eval_loss": 0.5266081094741821,
1611
+ "eval_runtime": 14.2921,
1612
+ "eval_samples_per_second": 85.222,
1613
+ "eval_steps_per_second": 5.388,
1614
+ "step": 1259
1615
+ },
1616
+ {
1617
+ "epoch": 11.0,
1618
+ "learning_rate": 4.093567251461988e-05,
1619
+ "loss": 0.5677,
1620
+ "step": 1260
1621
+ },
1622
+ {
1623
+ "epoch": 11.05,
1624
+ "learning_rate": 4.109811565951917e-05,
1625
+ "loss": 0.6239,
1626
+ "step": 1265
1627
+ },
1628
+ {
1629
+ "epoch": 11.09,
1630
+ "learning_rate": 4.1260558804418457e-05,
1631
+ "loss": 0.5781,
1632
+ "step": 1270
1633
+ },
1634
+ {
1635
+ "epoch": 11.14,
1636
+ "learning_rate": 4.142300194931774e-05,
1637
+ "loss": 0.341,
1638
+ "step": 1275
1639
+ },
1640
+ {
1641
+ "epoch": 11.18,
1642
+ "learning_rate": 4.1585445094217026e-05,
1643
+ "loss": 0.31,
1644
+ "step": 1280
1645
+ },
1646
+ {
1647
+ "epoch": 11.22,
1648
+ "learning_rate": 4.174788823911631e-05,
1649
+ "loss": 0.3522,
1650
+ "step": 1285
1651
+ },
1652
+ {
1653
+ "epoch": 11.27,
1654
+ "learning_rate": 4.1910331384015596e-05,
1655
+ "loss": 0.3488,
1656
+ "step": 1290
1657
+ },
1658
+ {
1659
+ "epoch": 11.31,
1660
+ "learning_rate": 4.207277452891488e-05,
1661
+ "loss": 0.2973,
1662
+ "step": 1295
1663
+ },
1664
+ {
1665
+ "epoch": 11.35,
1666
+ "learning_rate": 4.2235217673814166e-05,
1667
+ "loss": 0.2906,
1668
+ "step": 1300
1669
+ },
1670
+ {
1671
+ "epoch": 11.4,
1672
+ "learning_rate": 4.239766081871345e-05,
1673
+ "loss": 0.3714,
1674
+ "step": 1305
1675
+ },
1676
+ {
1677
+ "epoch": 11.44,
1678
+ "learning_rate": 4.2560103963612735e-05,
1679
+ "loss": 0.3396,
1680
+ "step": 1310
1681
+ },
1682
+ {
1683
+ "epoch": 11.48,
1684
+ "learning_rate": 4.272254710851202e-05,
1685
+ "loss": 0.3847,
1686
+ "step": 1315
1687
+ },
1688
+ {
1689
+ "epoch": 11.53,
1690
+ "learning_rate": 4.2884990253411305e-05,
1691
+ "loss": 0.2346,
1692
+ "step": 1320
1693
+ },
1694
+ {
1695
+ "epoch": 11.57,
1696
+ "learning_rate": 4.30474333983106e-05,
1697
+ "loss": 0.4439,
1698
+ "step": 1325
1699
+ },
1700
+ {
1701
+ "epoch": 11.62,
1702
+ "learning_rate": 4.3209876543209875e-05,
1703
+ "loss": 0.3444,
1704
+ "step": 1330
1705
+ },
1706
+ {
1707
+ "epoch": 11.66,
1708
+ "learning_rate": 4.3372319688109166e-05,
1709
+ "loss": 0.3281,
1710
+ "step": 1335
1711
+ },
1712
+ {
1713
+ "epoch": 11.7,
1714
+ "learning_rate": 4.3534762833008445e-05,
1715
+ "loss": 0.263,
1716
+ "step": 1340
1717
+ },
1718
+ {
1719
+ "epoch": 11.75,
1720
+ "learning_rate": 4.3697205977907736e-05,
1721
+ "loss": 0.4037,
1722
+ "step": 1345
1723
+ },
1724
+ {
1725
+ "epoch": 11.79,
1726
+ "learning_rate": 4.3859649122807014e-05,
1727
+ "loss": 0.2882,
1728
+ "step": 1350
1729
+ },
1730
+ {
1731
+ "epoch": 11.83,
1732
+ "learning_rate": 4.4022092267706306e-05,
1733
+ "loss": 0.2378,
1734
+ "step": 1355
1735
+ },
1736
+ {
1737
+ "epoch": 11.88,
1738
+ "learning_rate": 4.418453541260559e-05,
1739
+ "loss": 0.3295,
1740
+ "step": 1360
1741
+ },
1742
+ {
1743
+ "epoch": 11.92,
1744
+ "learning_rate": 4.4346978557504876e-05,
1745
+ "loss": 0.2535,
1746
+ "step": 1365
1747
+ },
1748
+ {
1749
+ "epoch": 11.97,
1750
+ "learning_rate": 4.450942170240416e-05,
1751
+ "loss": 0.3089,
1752
+ "step": 1370
1753
+ },
1754
+ {
1755
+ "epoch": 12.0,
1756
+ "eval_accuracy": 0.8883415435139573,
1757
+ "eval_loss": 0.3568573296070099,
1758
+ "eval_runtime": 14.1852,
1759
+ "eval_samples_per_second": 85.864,
1760
+ "eval_steps_per_second": 5.428,
1761
+ "step": 1374
1762
+ },
1763
+ {
1764
+ "epoch": 12.01,
1765
+ "learning_rate": 4.4671864847303445e-05,
1766
+ "loss": 0.4128,
1767
+ "step": 1375
1768
+ },
1769
+ {
1770
+ "epoch": 12.05,
1771
+ "learning_rate": 4.483430799220273e-05,
1772
+ "loss": 0.5395,
1773
+ "step": 1380
1774
+ },
1775
+ {
1776
+ "epoch": 12.1,
1777
+ "learning_rate": 4.4996751137102015e-05,
1778
+ "loss": 0.4097,
1779
+ "step": 1385
1780
+ },
1781
+ {
1782
+ "epoch": 12.14,
1783
+ "learning_rate": 4.51591942820013e-05,
1784
+ "loss": 0.3277,
1785
+ "step": 1390
1786
+ },
1787
+ {
1788
+ "epoch": 12.18,
1789
+ "learning_rate": 4.5321637426900585e-05,
1790
+ "loss": 0.3105,
1791
+ "step": 1395
1792
+ },
1793
+ {
1794
+ "epoch": 12.23,
1795
+ "learning_rate": 4.548408057179987e-05,
1796
+ "loss": 0.2685,
1797
+ "step": 1400
1798
+ },
1799
+ {
1800
+ "epoch": 12.27,
1801
+ "learning_rate": 4.5646523716699155e-05,
1802
+ "loss": 0.3484,
1803
+ "step": 1405
1804
+ },
1805
+ {
1806
+ "epoch": 12.31,
1807
+ "learning_rate": 4.580896686159844e-05,
1808
+ "loss": 0.3437,
1809
+ "step": 1410
1810
+ },
1811
+ {
1812
+ "epoch": 12.36,
1813
+ "learning_rate": 4.597141000649773e-05,
1814
+ "loss": 0.3515,
1815
+ "step": 1415
1816
+ },
1817
+ {
1818
+ "epoch": 12.4,
1819
+ "learning_rate": 4.613385315139701e-05,
1820
+ "loss": 0.3601,
1821
+ "step": 1420
1822
+ },
1823
+ {
1824
+ "epoch": 12.45,
1825
+ "learning_rate": 4.62962962962963e-05,
1826
+ "loss": 0.3287,
1827
+ "step": 1425
1828
+ },
1829
+ {
1830
+ "epoch": 12.49,
1831
+ "learning_rate": 4.645873944119558e-05,
1832
+ "loss": 0.3401,
1833
+ "step": 1430
1834
+ },
1835
+ {
1836
+ "epoch": 12.53,
1837
+ "learning_rate": 4.662118258609487e-05,
1838
+ "loss": 0.2752,
1839
+ "step": 1435
1840
+ },
1841
+ {
1842
+ "epoch": 12.58,
1843
+ "learning_rate": 4.678362573099415e-05,
1844
+ "loss": 0.4052,
1845
+ "step": 1440
1846
+ },
1847
+ {
1848
+ "epoch": 12.62,
1849
+ "learning_rate": 4.694606887589344e-05,
1850
+ "loss": 0.3117,
1851
+ "step": 1445
1852
+ },
1853
+ {
1854
+ "epoch": 12.66,
1855
+ "learning_rate": 4.7108512020792725e-05,
1856
+ "loss": 0.2903,
1857
+ "step": 1450
1858
+ },
1859
+ {
1860
+ "epoch": 12.71,
1861
+ "learning_rate": 4.727095516569201e-05,
1862
+ "loss": 0.2411,
1863
+ "step": 1455
1864
+ },
1865
+ {
1866
+ "epoch": 12.75,
1867
+ "learning_rate": 4.7433398310591295e-05,
1868
+ "loss": 0.3215,
1869
+ "step": 1460
1870
+ },
1871
+ {
1872
+ "epoch": 12.79,
1873
+ "learning_rate": 4.759584145549058e-05,
1874
+ "loss": 0.3449,
1875
+ "step": 1465
1876
+ },
1877
+ {
1878
+ "epoch": 12.84,
1879
+ "learning_rate": 4.7758284600389865e-05,
1880
+ "loss": 0.3509,
1881
+ "step": 1470
1882
+ },
1883
+ {
1884
+ "epoch": 12.88,
1885
+ "learning_rate": 4.792072774528915e-05,
1886
+ "loss": 0.3198,
1887
+ "step": 1475
1888
+ },
1889
+ {
1890
+ "epoch": 12.93,
1891
+ "learning_rate": 4.8083170890188434e-05,
1892
+ "loss": 0.3255,
1893
+ "step": 1480
1894
+ },
1895
+ {
1896
+ "epoch": 12.97,
1897
+ "learning_rate": 4.824561403508772e-05,
1898
+ "loss": 0.2272,
1899
+ "step": 1485
1900
+ },
1901
+ {
1902
+ "epoch": 13.0,
1903
+ "eval_accuracy": 0.9679802955665024,
1904
+ "eval_loss": 0.14868870377540588,
1905
+ "eval_runtime": 14.3655,
1906
+ "eval_samples_per_second": 84.787,
1907
+ "eval_steps_per_second": 5.36,
1908
+ "step": 1488
1909
+ },
1910
+ {
1911
+ "epoch": 13.01,
1912
+ "learning_rate": 4.8408057179987004e-05,
1913
+ "loss": 0.2218,
1914
+ "step": 1490
1915
+ },
1916
+ {
1917
+ "epoch": 13.06,
1918
+ "learning_rate": 4.857050032488629e-05,
1919
+ "loss": 0.4013,
1920
+ "step": 1495
1921
+ },
1922
+ {
1923
+ "epoch": 13.1,
1924
+ "learning_rate": 4.8732943469785574e-05,
1925
+ "loss": 0.3278,
1926
+ "step": 1500
1927
+ },
1928
+ {
1929
+ "epoch": 13.14,
1930
+ "learning_rate": 4.8895386614684865e-05,
1931
+ "loss": 0.31,
1932
+ "step": 1505
1933
+ },
1934
+ {
1935
+ "epoch": 13.19,
1936
+ "learning_rate": 4.9057829759584143e-05,
1937
+ "loss": 0.2165,
1938
+ "step": 1510
1939
+ },
1940
+ {
1941
+ "epoch": 13.23,
1942
+ "learning_rate": 4.9220272904483435e-05,
1943
+ "loss": 0.1984,
1944
+ "step": 1515
1945
+ },
1946
+ {
1947
+ "epoch": 13.28,
1948
+ "learning_rate": 4.938271604938271e-05,
1949
+ "loss": 0.2901,
1950
+ "step": 1520
1951
+ },
1952
+ {
1953
+ "epoch": 13.32,
1954
+ "learning_rate": 4.9545159194282005e-05,
1955
+ "loss": 0.3497,
1956
+ "step": 1525
1957
+ },
1958
+ {
1959
+ "epoch": 13.36,
1960
+ "learning_rate": 4.970760233918128e-05,
1961
+ "loss": 0.2879,
1962
+ "step": 1530
1963
+ },
1964
+ {
1965
+ "epoch": 13.41,
1966
+ "learning_rate": 4.9870045484080575e-05,
1967
+ "loss": 0.3517,
1968
+ "step": 1535
1969
+ },
1970
+ {
1971
+ "epoch": 13.45,
1972
+ "learning_rate": 4.970760233918128e-05,
1973
+ "loss": 0.2498,
1974
+ "step": 1540
1975
+ },
1976
+ {
1977
+ "epoch": 13.49,
1978
+ "learning_rate": 4.824561403508772e-05,
1979
+ "loss": 0.2148,
1980
+ "step": 1545
1981
+ },
1982
+ {
1983
+ "epoch": 13.54,
1984
+ "learning_rate": 4.678362573099415e-05,
1985
+ "loss": 0.2684,
1986
+ "step": 1550
1987
+ },
1988
+ {
1989
+ "epoch": 13.58,
1990
+ "learning_rate": 4.5321637426900585e-05,
1991
+ "loss": 0.2943,
1992
+ "step": 1555
1993
+ },
1994
+ {
1995
+ "epoch": 13.62,
1996
+ "learning_rate": 4.3859649122807014e-05,
1997
+ "loss": 0.2528,
1998
+ "step": 1560
1999
+ },
2000
+ {
2001
+ "epoch": 13.67,
2002
+ "learning_rate": 4.239766081871345e-05,
2003
+ "loss": 0.1341,
2004
+ "step": 1565
2005
+ },
2006
+ {
2007
+ "epoch": 13.71,
2008
+ "learning_rate": 4.093567251461988e-05,
2009
+ "loss": 0.2324,
2010
+ "step": 1570
2011
+ },
2012
+ {
2013
+ "epoch": 13.76,
2014
+ "learning_rate": 3.9473684210526316e-05,
2015
+ "loss": 0.3278,
2016
+ "step": 1575
2017
+ },
2018
+ {
2019
+ "epoch": 13.8,
2020
+ "learning_rate": 3.8011695906432746e-05,
2021
+ "loss": 0.3827,
2022
+ "step": 1580
2023
+ },
2024
+ {
2025
+ "epoch": 13.84,
2026
+ "learning_rate": 3.654970760233918e-05,
2027
+ "loss": 0.2841,
2028
+ "step": 1585
2029
+ },
2030
+ {
2031
+ "epoch": 13.89,
2032
+ "learning_rate": 3.508771929824561e-05,
2033
+ "loss": 0.2648,
2034
+ "step": 1590
2035
+ },
2036
+ {
2037
+ "epoch": 13.93,
2038
+ "learning_rate": 3.362573099415205e-05,
2039
+ "loss": 0.314,
2040
+ "step": 1595
2041
+ },
2042
+ {
2043
+ "epoch": 13.97,
2044
+ "learning_rate": 3.216374269005848e-05,
2045
+ "loss": 0.3355,
2046
+ "step": 1600
2047
+ },
2048
+ {
2049
+ "epoch": 14.0,
2050
+ "eval_accuracy": 0.9269293924466339,
2051
+ "eval_loss": 0.234413281083107,
2052
+ "eval_runtime": 14.1453,
2053
+ "eval_samples_per_second": 86.106,
2054
+ "eval_steps_per_second": 5.444,
2055
+ "step": 1603
2056
+ },
2057
+ {
2058
+ "epoch": 14.02,
2059
+ "learning_rate": 3.0701754385964913e-05,
2060
+ "loss": 0.2411,
2061
+ "step": 1605
2062
+ },
2063
+ {
2064
+ "epoch": 14.06,
2065
+ "learning_rate": 2.9239766081871346e-05,
2066
+ "loss": 0.1699,
2067
+ "step": 1610
2068
+ },
2069
+ {
2070
+ "epoch": 14.1,
2071
+ "learning_rate": 2.777777777777778e-05,
2072
+ "loss": 0.239,
2073
+ "step": 1615
2074
+ },
2075
+ {
2076
+ "epoch": 14.15,
2077
+ "learning_rate": 2.6315789473684212e-05,
2078
+ "loss": 0.2076,
2079
+ "step": 1620
2080
+ },
2081
+ {
2082
+ "epoch": 14.19,
2083
+ "learning_rate": 2.485380116959064e-05,
2084
+ "loss": 0.2498,
2085
+ "step": 1625
2086
+ },
2087
+ {
2088
+ "epoch": 14.24,
2089
+ "learning_rate": 2.3391812865497074e-05,
2090
+ "loss": 0.2281,
2091
+ "step": 1630
2092
+ },
2093
+ {
2094
+ "epoch": 14.28,
2095
+ "learning_rate": 2.1929824561403507e-05,
2096
+ "loss": 0.1815,
2097
+ "step": 1635
2098
+ },
2099
+ {
2100
+ "epoch": 14.32,
2101
+ "learning_rate": 2.046783625730994e-05,
2102
+ "loss": 0.1548,
2103
+ "step": 1640
2104
+ },
2105
+ {
2106
+ "epoch": 14.37,
2107
+ "learning_rate": 1.9005847953216373e-05,
2108
+ "loss": 0.1867,
2109
+ "step": 1645
2110
+ },
2111
+ {
2112
+ "epoch": 14.41,
2113
+ "learning_rate": 1.7543859649122806e-05,
2114
+ "loss": 0.1237,
2115
+ "step": 1650
2116
+ },
2117
+ {
2118
+ "epoch": 14.45,
2119
+ "learning_rate": 1.608187134502924e-05,
2120
+ "loss": 0.1528,
2121
+ "step": 1655
2122
+ },
2123
+ {
2124
+ "epoch": 14.5,
2125
+ "learning_rate": 1.4619883040935673e-05,
2126
+ "loss": 0.1484,
2127
+ "step": 1660
2128
+ },
2129
+ {
2130
+ "epoch": 14.54,
2131
+ "learning_rate": 1.3157894736842106e-05,
2132
+ "loss": 0.208,
2133
+ "step": 1665
2134
+ },
2135
+ {
2136
+ "epoch": 14.59,
2137
+ "learning_rate": 1.1695906432748537e-05,
2138
+ "loss": 0.1522,
2139
+ "step": 1670
2140
+ },
2141
+ {
2142
+ "epoch": 14.63,
2143
+ "learning_rate": 1.023391812865497e-05,
2144
+ "loss": 0.1902,
2145
+ "step": 1675
2146
+ },
2147
+ {
2148
+ "epoch": 14.67,
2149
+ "learning_rate": 8.771929824561403e-06,
2150
+ "loss": 0.1111,
2151
+ "step": 1680
2152
+ },
2153
+ {
2154
+ "epoch": 14.72,
2155
+ "learning_rate": 7.3099415204678366e-06,
2156
+ "loss": 0.1581,
2157
+ "step": 1685
2158
+ },
2159
+ {
2160
+ "epoch": 14.76,
2161
+ "learning_rate": 5.8479532163742686e-06,
2162
+ "loss": 0.1491,
2163
+ "step": 1690
2164
+ },
2165
+ {
2166
+ "epoch": 14.8,
2167
+ "learning_rate": 4.3859649122807014e-06,
2168
+ "loss": 0.1382,
2169
+ "step": 1695
2170
+ },
2171
+ {
2172
+ "epoch": 14.85,
2173
+ "learning_rate": 2.9239766081871343e-06,
2174
+ "loss": 0.151,
2175
+ "step": 1700
2176
+ },
2177
+ {
2178
+ "epoch": 14.89,
2179
+ "learning_rate": 1.4619883040935671e-06,
2180
+ "loss": 0.1941,
2181
+ "step": 1705
2182
+ },
2183
+ {
2184
+ "epoch": 14.93,
2185
+ "learning_rate": 0.0,
2186
+ "loss": 0.1581,
2187
+ "step": 1710
2188
+ },
2189
+ {
2190
+ "epoch": 14.93,
2191
+ "eval_accuracy": 0.9893267651888341,
2192
+ "eval_loss": 0.06719201803207397,
2193
+ "eval_runtime": 14.1195,
2194
+ "eval_samples_per_second": 86.264,
2195
+ "eval_steps_per_second": 5.453,
2196
+ "step": 1710
2197
+ },
2198
+ {
2199
+ "epoch": 14.93,
2200
+ "step": 1710,
2201
+ "total_flos": 9.675577376037974e+18,
2202
+ "train_loss": 0.806596442168219,
2203
+ "train_runtime": 3496.1772,
2204
+ "train_samples_per_second": 15.664,
2205
+ "train_steps_per_second": 0.489
2206
+ }
2207
+ ],
2208
+ "logging_steps": 5,
2209
+ "max_steps": 1710,
2210
+ "num_train_epochs": 15,
2211
+ "save_steps": 500,
2212
+ "total_flos": 9.675577376037974e+18,
2213
+ "trial_name": null,
2214
+ "trial_params": null
2215
+ }