cloudwalkerw commited on
Commit
f8fabf9
1 Parent(s): 2d05f74

End of training

Browse files
Files changed (5) hide show
  1. README.md +3 -2
  2. all_results.json +12 -0
  3. eval_results.json +8 -0
  4. train_results.json +7 -0
  5. trainer_state.json +2998 -0
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  base_model: microsoft/wavlm-base
3
  tags:
 
4
  - generated_from_trainer
5
  metrics:
6
  - accuracy
@@ -16,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [microsoft/wavlm-base](https://huggingface.co/microsoft/wavlm-base) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.3326
20
- - Accuracy: 0.8974
21
 
22
  ## Model description
23
 
 
1
  ---
2
  base_model: microsoft/wavlm-base
3
  tags:
4
+ - audio-classification
5
  - generated_from_trainer
6
  metrics:
7
  - accuracy
 
17
 
18
  This model is a fine-tuned version of [microsoft/wavlm-base](https://huggingface.co/microsoft/wavlm-base) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.0244
21
+ - Accuracy: 0.9966
22
 
23
  ## Model description
24
 
all_results.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 49.91,
3
+ "eval_accuracy": 0.9965786507808726,
4
+ "eval_loss": 0.024423159658908844,
5
+ "eval_runtime": 501.2432,
6
+ "eval_samples_per_second": 49.565,
7
+ "eval_steps_per_second": 24.782,
8
+ "train_loss": 0.3200095210412536,
9
+ "train_runtime": 116243.9445,
10
+ "train_samples_per_second": 10.917,
11
+ "train_steps_per_second": 0.17
12
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 49.91,
3
+ "eval_accuracy": 0.9965786507808726,
4
+ "eval_loss": 0.024423159658908844,
5
+ "eval_runtime": 501.2432,
6
+ "eval_samples_per_second": 49.565,
7
+ "eval_steps_per_second": 24.782
8
+ }
train_results.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 49.91,
3
+ "train_loss": 0.3200095210412536,
4
+ "train_runtime": 116243.9445,
5
+ "train_samples_per_second": 10.917,
6
+ "train_steps_per_second": 0.17
7
+ }
trainer_state.json ADDED
@@ -0,0 +1,2998 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.9965786507808726,
3
+ "best_model_checkpoint": "/home/cloudwalker/ASVmodel/wavlm-base_2/checkpoint-300",
4
+ "epoch": 49.9054820415879,
5
+ "eval_steps": 100,
6
+ "global_step": 19800,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.25,
13
+ "learning_rate": 1.515151515151515e-05,
14
+ "loss": 0.4872,
15
+ "step": 100
16
+ },
17
+ {
18
+ "epoch": 0.25,
19
+ "eval_accuracy": 0.8974400257607471,
20
+ "eval_loss": 0.21796834468841553,
21
+ "eval_runtime": 498.2273,
22
+ "eval_samples_per_second": 49.865,
23
+ "eval_steps_per_second": 24.932,
24
+ "step": 100
25
+ },
26
+ {
27
+ "epoch": 0.5,
28
+ "learning_rate": 3.03030303030303e-05,
29
+ "loss": 0.1571,
30
+ "step": 200
31
+ },
32
+ {
33
+ "epoch": 0.5,
34
+ "eval_accuracy": 0.93342456931251,
35
+ "eval_loss": 0.2581726014614105,
36
+ "eval_runtime": 500.3876,
37
+ "eval_samples_per_second": 49.65,
38
+ "eval_steps_per_second": 24.825,
39
+ "step": 200
40
+ },
41
+ {
42
+ "epoch": 0.76,
43
+ "learning_rate": 4.545454545454545e-05,
44
+ "loss": 0.0644,
45
+ "step": 300
46
+ },
47
+ {
48
+ "epoch": 0.76,
49
+ "eval_accuracy": 0.9965786507808726,
50
+ "eval_loss": 0.024423159658908844,
51
+ "eval_runtime": 500.4785,
52
+ "eval_samples_per_second": 49.64,
53
+ "eval_steps_per_second": 24.82,
54
+ "step": 300
55
+ },
56
+ {
57
+ "epoch": 1.01,
58
+ "learning_rate": 6.06060606060606e-05,
59
+ "loss": 0.0553,
60
+ "step": 400
61
+ },
62
+ {
63
+ "epoch": 1.01,
64
+ "eval_accuracy": 0.9927950410561907,
65
+ "eval_loss": 0.11555636674165726,
66
+ "eval_runtime": 500.405,
67
+ "eval_samples_per_second": 49.648,
68
+ "eval_steps_per_second": 24.824,
69
+ "step": 400
70
+ },
71
+ {
72
+ "epoch": 1.26,
73
+ "learning_rate": 7.575757575757576e-05,
74
+ "loss": 0.1108,
75
+ "step": 500
76
+ },
77
+ {
78
+ "epoch": 1.26,
79
+ "eval_accuracy": 0.9898164546771856,
80
+ "eval_loss": 0.1576482504606247,
81
+ "eval_runtime": 500.3246,
82
+ "eval_samples_per_second": 49.656,
83
+ "eval_steps_per_second": 24.828,
84
+ "step": 500
85
+ },
86
+ {
87
+ "epoch": 1.51,
88
+ "learning_rate": 9.09090909090909e-05,
89
+ "loss": 0.0849,
90
+ "step": 600
91
+ },
92
+ {
93
+ "epoch": 1.51,
94
+ "eval_accuracy": 0.9946868459185316,
95
+ "eval_loss": 0.08708283305168152,
96
+ "eval_runtime": 500.3759,
97
+ "eval_samples_per_second": 49.651,
98
+ "eval_steps_per_second": 24.825,
99
+ "step": 600
100
+ },
101
+ {
102
+ "epoch": 1.76,
103
+ "learning_rate": 0.00010606060606060605,
104
+ "loss": 0.0635,
105
+ "step": 700
106
+ },
107
+ {
108
+ "epoch": 1.76,
109
+ "eval_accuracy": 0.9938818225728546,
110
+ "eval_loss": 0.10875184088945389,
111
+ "eval_runtime": 500.3093,
112
+ "eval_samples_per_second": 49.657,
113
+ "eval_steps_per_second": 24.829,
114
+ "step": 700
115
+ },
116
+ {
117
+ "epoch": 2.02,
118
+ "learning_rate": 0.0001212121212121212,
119
+ "loss": 0.0504,
120
+ "step": 800
121
+ },
122
+ {
123
+ "epoch": 2.02,
124
+ "eval_accuracy": 0.9789888906778297,
125
+ "eval_loss": 0.4074054956436157,
126
+ "eval_runtime": 500.4204,
127
+ "eval_samples_per_second": 49.646,
128
+ "eval_steps_per_second": 24.823,
129
+ "step": 800
130
+ },
131
+ {
132
+ "epoch": 2.27,
133
+ "learning_rate": 0.00013636363636363634,
134
+ "loss": 0.1075,
135
+ "step": 900
136
+ },
137
+ {
138
+ "epoch": 2.27,
139
+ "eval_accuracy": 0.9814442118821446,
140
+ "eval_loss": 0.2954882085323334,
141
+ "eval_runtime": 500.4501,
142
+ "eval_samples_per_second": 49.643,
143
+ "eval_steps_per_second": 24.822,
144
+ "step": 900
145
+ },
146
+ {
147
+ "epoch": 2.52,
148
+ "learning_rate": 0.00015151515151515152,
149
+ "loss": 0.2387,
150
+ "step": 1000
151
+ },
152
+ {
153
+ "epoch": 2.52,
154
+ "eval_accuracy": 0.9956126227660602,
155
+ "eval_loss": 0.06512398272752762,
156
+ "eval_runtime": 500.7096,
157
+ "eval_samples_per_second": 49.618,
158
+ "eval_steps_per_second": 24.809,
159
+ "step": 1000
160
+ },
161
+ {
162
+ "epoch": 2.77,
163
+ "learning_rate": 0.00016666666666666666,
164
+ "loss": 0.3052,
165
+ "step": 1100
166
+ },
167
+ {
168
+ "epoch": 2.77,
169
+ "eval_accuracy": 0.8974400257607471,
170
+ "eval_loss": 0.23793257772922516,
171
+ "eval_runtime": 500.5364,
172
+ "eval_samples_per_second": 49.635,
173
+ "eval_steps_per_second": 24.817,
174
+ "step": 1100
175
+ },
176
+ {
177
+ "epoch": 3.02,
178
+ "learning_rate": 0.0001818181818181818,
179
+ "loss": 0.3336,
180
+ "step": 1200
181
+ },
182
+ {
183
+ "epoch": 3.02,
184
+ "eval_accuracy": 0.8974400257607471,
185
+ "eval_loss": 0.35269346833229065,
186
+ "eval_runtime": 501.0064,
187
+ "eval_samples_per_second": 49.588,
188
+ "eval_steps_per_second": 24.794,
189
+ "step": 1200
190
+ },
191
+ {
192
+ "epoch": 3.28,
193
+ "learning_rate": 0.00019696969696969695,
194
+ "loss": 0.3322,
195
+ "step": 1300
196
+ },
197
+ {
198
+ "epoch": 3.28,
199
+ "eval_accuracy": 0.8974400257607471,
200
+ "eval_loss": 0.33067458868026733,
201
+ "eval_runtime": 502.8336,
202
+ "eval_samples_per_second": 49.408,
203
+ "eval_steps_per_second": 24.704,
204
+ "step": 1300
205
+ },
206
+ {
207
+ "epoch": 3.53,
208
+ "learning_rate": 0.0002121212121212121,
209
+ "loss": 0.3201,
210
+ "step": 1400
211
+ },
212
+ {
213
+ "epoch": 3.53,
214
+ "eval_accuracy": 0.8974400257607471,
215
+ "eval_loss": 0.34046611189842224,
216
+ "eval_runtime": 500.7806,
217
+ "eval_samples_per_second": 49.611,
218
+ "eval_steps_per_second": 24.805,
219
+ "step": 1400
220
+ },
221
+ {
222
+ "epoch": 3.78,
223
+ "learning_rate": 0.00022727272727272725,
224
+ "loss": 0.3406,
225
+ "step": 1500
226
+ },
227
+ {
228
+ "epoch": 3.78,
229
+ "eval_accuracy": 0.8974400257607471,
230
+ "eval_loss": 0.33353403210639954,
231
+ "eval_runtime": 500.7499,
232
+ "eval_samples_per_second": 49.614,
233
+ "eval_steps_per_second": 24.807,
234
+ "step": 1500
235
+ },
236
+ {
237
+ "epoch": 4.03,
238
+ "learning_rate": 0.0002424242424242424,
239
+ "loss": 0.3475,
240
+ "step": 1600
241
+ },
242
+ {
243
+ "epoch": 4.03,
244
+ "eval_accuracy": 0.8974400257607471,
245
+ "eval_loss": 0.3340916931629181,
246
+ "eval_runtime": 500.598,
247
+ "eval_samples_per_second": 49.629,
248
+ "eval_steps_per_second": 24.814,
249
+ "step": 1600
250
+ },
251
+ {
252
+ "epoch": 4.28,
253
+ "learning_rate": 0.00025757575757575756,
254
+ "loss": 0.3312,
255
+ "step": 1700
256
+ },
257
+ {
258
+ "epoch": 4.28,
259
+ "eval_accuracy": 0.8974400257607471,
260
+ "eval_loss": 0.33610448241233826,
261
+ "eval_runtime": 500.8798,
262
+ "eval_samples_per_second": 49.601,
263
+ "eval_steps_per_second": 24.8,
264
+ "step": 1700
265
+ },
266
+ {
267
+ "epoch": 4.54,
268
+ "learning_rate": 0.0002727272727272727,
269
+ "loss": 0.3367,
270
+ "step": 1800
271
+ },
272
+ {
273
+ "epoch": 4.54,
274
+ "eval_accuracy": 0.8974400257607471,
275
+ "eval_loss": 0.3309839069843292,
276
+ "eval_runtime": 500.5768,
277
+ "eval_samples_per_second": 49.631,
278
+ "eval_steps_per_second": 24.815,
279
+ "step": 1800
280
+ },
281
+ {
282
+ "epoch": 4.79,
283
+ "learning_rate": 0.00028787878787878786,
284
+ "loss": 0.3284,
285
+ "step": 1900
286
+ },
287
+ {
288
+ "epoch": 4.79,
289
+ "eval_accuracy": 0.8974400257607471,
290
+ "eval_loss": 0.33385568857192993,
291
+ "eval_runtime": 500.453,
292
+ "eval_samples_per_second": 49.643,
293
+ "eval_steps_per_second": 24.822,
294
+ "step": 1900
295
+ },
296
+ {
297
+ "epoch": 5.04,
298
+ "learning_rate": 0.00029966329966329963,
299
+ "loss": 0.3267,
300
+ "step": 2000
301
+ },
302
+ {
303
+ "epoch": 5.04,
304
+ "eval_accuracy": 0.8974400257607471,
305
+ "eval_loss": 0.3350389301776886,
306
+ "eval_runtime": 500.7512,
307
+ "eval_samples_per_second": 49.613,
308
+ "eval_steps_per_second": 24.807,
309
+ "step": 2000
310
+ },
311
+ {
312
+ "epoch": 5.29,
313
+ "learning_rate": 0.00029797979797979794,
314
+ "loss": 0.338,
315
+ "step": 2100
316
+ },
317
+ {
318
+ "epoch": 5.29,
319
+ "eval_accuracy": 0.8974400257607471,
320
+ "eval_loss": 0.33081698417663574,
321
+ "eval_runtime": 500.5738,
322
+ "eval_samples_per_second": 49.631,
323
+ "eval_steps_per_second": 24.816,
324
+ "step": 2100
325
+ },
326
+ {
327
+ "epoch": 5.55,
328
+ "learning_rate": 0.00029629629629629624,
329
+ "loss": 0.3277,
330
+ "step": 2200
331
+ },
332
+ {
333
+ "epoch": 5.55,
334
+ "eval_accuracy": 0.8974400257607471,
335
+ "eval_loss": 0.330895334482193,
336
+ "eval_runtime": 500.5595,
337
+ "eval_samples_per_second": 49.632,
338
+ "eval_steps_per_second": 24.816,
339
+ "step": 2200
340
+ },
341
+ {
342
+ "epoch": 5.8,
343
+ "learning_rate": 0.0002946127946127946,
344
+ "loss": 0.3294,
345
+ "step": 2300
346
+ },
347
+ {
348
+ "epoch": 5.8,
349
+ "eval_accuracy": 0.8974400257607471,
350
+ "eval_loss": 0.3312866687774658,
351
+ "eval_runtime": 500.6862,
352
+ "eval_samples_per_second": 49.62,
353
+ "eval_steps_per_second": 24.81,
354
+ "step": 2300
355
+ },
356
+ {
357
+ "epoch": 6.05,
358
+ "learning_rate": 0.0002929292929292929,
359
+ "loss": 0.3315,
360
+ "step": 2400
361
+ },
362
+ {
363
+ "epoch": 6.05,
364
+ "eval_accuracy": 0.8974400257607471,
365
+ "eval_loss": 0.33599570393562317,
366
+ "eval_runtime": 500.6176,
367
+ "eval_samples_per_second": 49.627,
368
+ "eval_steps_per_second": 24.813,
369
+ "step": 2400
370
+ },
371
+ {
372
+ "epoch": 6.3,
373
+ "learning_rate": 0.00029124579124579125,
374
+ "loss": 0.3397,
375
+ "step": 2500
376
+ },
377
+ {
378
+ "epoch": 6.3,
379
+ "eval_accuracy": 0.8974400257607471,
380
+ "eval_loss": 0.33067843317985535,
381
+ "eval_runtime": 500.7157,
382
+ "eval_samples_per_second": 49.617,
383
+ "eval_steps_per_second": 24.808,
384
+ "step": 2500
385
+ },
386
+ {
387
+ "epoch": 6.55,
388
+ "learning_rate": 0.00028956228956228955,
389
+ "loss": 0.3318,
390
+ "step": 2600
391
+ },
392
+ {
393
+ "epoch": 6.55,
394
+ "eval_accuracy": 0.8974400257607471,
395
+ "eval_loss": 0.3359489440917969,
396
+ "eval_runtime": 500.805,
397
+ "eval_samples_per_second": 49.608,
398
+ "eval_steps_per_second": 24.804,
399
+ "step": 2600
400
+ },
401
+ {
402
+ "epoch": 6.81,
403
+ "learning_rate": 0.00028787878787878786,
404
+ "loss": 0.3312,
405
+ "step": 2700
406
+ },
407
+ {
408
+ "epoch": 6.81,
409
+ "eval_accuracy": 0.8974400257607471,
410
+ "eval_loss": 0.3307555615901947,
411
+ "eval_runtime": 500.6263,
412
+ "eval_samples_per_second": 49.626,
413
+ "eval_steps_per_second": 24.813,
414
+ "step": 2700
415
+ },
416
+ {
417
+ "epoch": 7.06,
418
+ "learning_rate": 0.00028619528619528616,
419
+ "loss": 0.3155,
420
+ "step": 2800
421
+ },
422
+ {
423
+ "epoch": 7.06,
424
+ "eval_accuracy": 0.8974400257607471,
425
+ "eval_loss": 0.33172452449798584,
426
+ "eval_runtime": 500.7242,
427
+ "eval_samples_per_second": 49.616,
428
+ "eval_steps_per_second": 24.808,
429
+ "step": 2800
430
+ },
431
+ {
432
+ "epoch": 7.31,
433
+ "learning_rate": 0.0002845117845117845,
434
+ "loss": 0.3304,
435
+ "step": 2900
436
+ },
437
+ {
438
+ "epoch": 7.31,
439
+ "eval_accuracy": 0.8974400257607471,
440
+ "eval_loss": 0.33618223667144775,
441
+ "eval_runtime": 500.5229,
442
+ "eval_samples_per_second": 49.636,
443
+ "eval_steps_per_second": 24.818,
444
+ "step": 2900
445
+ },
446
+ {
447
+ "epoch": 7.56,
448
+ "learning_rate": 0.0002828282828282828,
449
+ "loss": 0.338,
450
+ "step": 3000
451
+ },
452
+ {
453
+ "epoch": 7.56,
454
+ "eval_accuracy": 0.8974400257607471,
455
+ "eval_loss": 0.3341616988182068,
456
+ "eval_runtime": 500.7918,
457
+ "eval_samples_per_second": 49.609,
458
+ "eval_steps_per_second": 24.805,
459
+ "step": 3000
460
+ },
461
+ {
462
+ "epoch": 7.81,
463
+ "learning_rate": 0.0002811447811447811,
464
+ "loss": 0.3241,
465
+ "step": 3100
466
+ },
467
+ {
468
+ "epoch": 7.81,
469
+ "eval_accuracy": 0.8974400257607471,
470
+ "eval_loss": 0.330985426902771,
471
+ "eval_runtime": 500.924,
472
+ "eval_samples_per_second": 49.596,
473
+ "eval_steps_per_second": 24.798,
474
+ "step": 3100
475
+ },
476
+ {
477
+ "epoch": 8.07,
478
+ "learning_rate": 0.0002794612794612794,
479
+ "loss": 0.3325,
480
+ "step": 3200
481
+ },
482
+ {
483
+ "epoch": 8.07,
484
+ "eval_accuracy": 0.8974400257607471,
485
+ "eval_loss": 0.33258649706840515,
486
+ "eval_runtime": 500.7775,
487
+ "eval_samples_per_second": 49.611,
488
+ "eval_steps_per_second": 24.805,
489
+ "step": 3200
490
+ },
491
+ {
492
+ "epoch": 8.32,
493
+ "learning_rate": 0.0002777777777777778,
494
+ "loss": 0.3202,
495
+ "step": 3300
496
+ },
497
+ {
498
+ "epoch": 8.32,
499
+ "eval_accuracy": 0.8974400257607471,
500
+ "eval_loss": 0.3345409035682678,
501
+ "eval_runtime": 501.0057,
502
+ "eval_samples_per_second": 49.588,
503
+ "eval_steps_per_second": 24.794,
504
+ "step": 3300
505
+ },
506
+ {
507
+ "epoch": 8.57,
508
+ "learning_rate": 0.0002760942760942761,
509
+ "loss": 0.3315,
510
+ "step": 3400
511
+ },
512
+ {
513
+ "epoch": 8.57,
514
+ "eval_accuracy": 0.8974400257607471,
515
+ "eval_loss": 0.3335334360599518,
516
+ "eval_runtime": 500.8188,
517
+ "eval_samples_per_second": 49.607,
518
+ "eval_steps_per_second": 24.803,
519
+ "step": 3400
520
+ },
521
+ {
522
+ "epoch": 8.82,
523
+ "learning_rate": 0.0002744107744107744,
524
+ "loss": 0.3288,
525
+ "step": 3500
526
+ },
527
+ {
528
+ "epoch": 8.82,
529
+ "eval_accuracy": 0.8974400257607471,
530
+ "eval_loss": 0.33116644620895386,
531
+ "eval_runtime": 501.0568,
532
+ "eval_samples_per_second": 49.583,
533
+ "eval_steps_per_second": 24.792,
534
+ "step": 3500
535
+ },
536
+ {
537
+ "epoch": 9.07,
538
+ "learning_rate": 0.0002727272727272727,
539
+ "loss": 0.3371,
540
+ "step": 3600
541
+ },
542
+ {
543
+ "epoch": 9.07,
544
+ "eval_accuracy": 0.8974400257607471,
545
+ "eval_loss": 0.34014323353767395,
546
+ "eval_runtime": 500.7918,
547
+ "eval_samples_per_second": 49.609,
548
+ "eval_steps_per_second": 24.805,
549
+ "step": 3600
550
+ },
551
+ {
552
+ "epoch": 9.33,
553
+ "learning_rate": 0.00027104377104377104,
554
+ "loss": 0.3409,
555
+ "step": 3700
556
+ },
557
+ {
558
+ "epoch": 9.33,
559
+ "eval_accuracy": 0.8974400257607471,
560
+ "eval_loss": 0.33300086855888367,
561
+ "eval_runtime": 500.8108,
562
+ "eval_samples_per_second": 49.608,
563
+ "eval_steps_per_second": 24.804,
564
+ "step": 3700
565
+ },
566
+ {
567
+ "epoch": 9.58,
568
+ "learning_rate": 0.00026936026936026934,
569
+ "loss": 0.3236,
570
+ "step": 3800
571
+ },
572
+ {
573
+ "epoch": 9.58,
574
+ "eval_accuracy": 0.8974400257607471,
575
+ "eval_loss": 0.3329709768295288,
576
+ "eval_runtime": 500.7254,
577
+ "eval_samples_per_second": 49.616,
578
+ "eval_steps_per_second": 24.808,
579
+ "step": 3800
580
+ },
581
+ {
582
+ "epoch": 9.83,
583
+ "learning_rate": 0.00026767676767676764,
584
+ "loss": 0.3224,
585
+ "step": 3900
586
+ },
587
+ {
588
+ "epoch": 9.83,
589
+ "eval_accuracy": 0.8974400257607471,
590
+ "eval_loss": 0.3320678770542145,
591
+ "eval_runtime": 500.9946,
592
+ "eval_samples_per_second": 49.589,
593
+ "eval_steps_per_second": 24.795,
594
+ "step": 3900
595
+ },
596
+ {
597
+ "epoch": 10.08,
598
+ "learning_rate": 0.00026599326599326595,
599
+ "loss": 0.3439,
600
+ "step": 4000
601
+ },
602
+ {
603
+ "epoch": 10.08,
604
+ "eval_accuracy": 0.8974400257607471,
605
+ "eval_loss": 0.33262181282043457,
606
+ "eval_runtime": 501.0278,
607
+ "eval_samples_per_second": 49.586,
608
+ "eval_steps_per_second": 24.793,
609
+ "step": 4000
610
+ },
611
+ {
612
+ "epoch": 10.33,
613
+ "learning_rate": 0.0002643097643097643,
614
+ "loss": 0.3382,
615
+ "step": 4100
616
+ },
617
+ {
618
+ "epoch": 10.33,
619
+ "eval_accuracy": 0.8974400257607471,
620
+ "eval_loss": 0.3310418426990509,
621
+ "eval_runtime": 501.0043,
622
+ "eval_samples_per_second": 49.588,
623
+ "eval_steps_per_second": 24.794,
624
+ "step": 4100
625
+ },
626
+ {
627
+ "epoch": 10.59,
628
+ "learning_rate": 0.0002626262626262626,
629
+ "loss": 0.3307,
630
+ "step": 4200
631
+ },
632
+ {
633
+ "epoch": 10.59,
634
+ "eval_accuracy": 0.8974400257607471,
635
+ "eval_loss": 0.33820316195487976,
636
+ "eval_runtime": 501.0192,
637
+ "eval_samples_per_second": 49.587,
638
+ "eval_steps_per_second": 24.793,
639
+ "step": 4200
640
+ },
641
+ {
642
+ "epoch": 10.84,
643
+ "learning_rate": 0.0002609427609427609,
644
+ "loss": 0.3231,
645
+ "step": 4300
646
+ },
647
+ {
648
+ "epoch": 10.84,
649
+ "eval_accuracy": 0.8974400257607471,
650
+ "eval_loss": 0.3324846625328064,
651
+ "eval_runtime": 500.6054,
652
+ "eval_samples_per_second": 49.628,
653
+ "eval_steps_per_second": 24.814,
654
+ "step": 4300
655
+ },
656
+ {
657
+ "epoch": 11.09,
658
+ "learning_rate": 0.0002592592592592592,
659
+ "loss": 0.3095,
660
+ "step": 4400
661
+ },
662
+ {
663
+ "epoch": 11.09,
664
+ "eval_accuracy": 0.8974400257607471,
665
+ "eval_loss": 0.3348234295845032,
666
+ "eval_runtime": 500.6559,
667
+ "eval_samples_per_second": 49.623,
668
+ "eval_steps_per_second": 24.811,
669
+ "step": 4400
670
+ },
671
+ {
672
+ "epoch": 11.34,
673
+ "learning_rate": 0.00025757575757575756,
674
+ "loss": 0.3442,
675
+ "step": 4500
676
+ },
677
+ {
678
+ "epoch": 11.34,
679
+ "eval_accuracy": 0.8974400257607471,
680
+ "eval_loss": 0.33274412155151367,
681
+ "eval_runtime": 501.0421,
682
+ "eval_samples_per_second": 49.585,
683
+ "eval_steps_per_second": 24.792,
684
+ "step": 4500
685
+ },
686
+ {
687
+ "epoch": 11.59,
688
+ "learning_rate": 0.00025589225589225587,
689
+ "loss": 0.3269,
690
+ "step": 4600
691
+ },
692
+ {
693
+ "epoch": 11.59,
694
+ "eval_accuracy": 0.8974400257607471,
695
+ "eval_loss": 0.33261528611183167,
696
+ "eval_runtime": 500.8659,
697
+ "eval_samples_per_second": 49.602,
698
+ "eval_steps_per_second": 24.801,
699
+ "step": 4600
700
+ },
701
+ {
702
+ "epoch": 11.85,
703
+ "learning_rate": 0.00025420875420875417,
704
+ "loss": 0.3323,
705
+ "step": 4700
706
+ },
707
+ {
708
+ "epoch": 11.85,
709
+ "eval_accuracy": 0.8974400257607471,
710
+ "eval_loss": 0.3308444619178772,
711
+ "eval_runtime": 501.0609,
712
+ "eval_samples_per_second": 49.583,
713
+ "eval_steps_per_second": 24.791,
714
+ "step": 4700
715
+ },
716
+ {
717
+ "epoch": 12.1,
718
+ "learning_rate": 0.0002525252525252525,
719
+ "loss": 0.3313,
720
+ "step": 4800
721
+ },
722
+ {
723
+ "epoch": 12.1,
724
+ "eval_accuracy": 0.8974400257607471,
725
+ "eval_loss": 0.3308044970035553,
726
+ "eval_runtime": 500.8061,
727
+ "eval_samples_per_second": 49.608,
728
+ "eval_steps_per_second": 24.804,
729
+ "step": 4800
730
+ },
731
+ {
732
+ "epoch": 12.35,
733
+ "learning_rate": 0.0002508417508417508,
734
+ "loss": 0.3283,
735
+ "step": 4900
736
+ },
737
+ {
738
+ "epoch": 12.35,
739
+ "eval_accuracy": 0.8974400257607471,
740
+ "eval_loss": 0.3314284384250641,
741
+ "eval_runtime": 500.7554,
742
+ "eval_samples_per_second": 49.613,
743
+ "eval_steps_per_second": 24.807,
744
+ "step": 4900
745
+ },
746
+ {
747
+ "epoch": 12.6,
748
+ "learning_rate": 0.00024915824915824913,
749
+ "loss": 0.3331,
750
+ "step": 5000
751
+ },
752
+ {
753
+ "epoch": 12.6,
754
+ "eval_accuracy": 0.8974400257607471,
755
+ "eval_loss": 0.3306741416454315,
756
+ "eval_runtime": 500.9128,
757
+ "eval_samples_per_second": 49.597,
758
+ "eval_steps_per_second": 24.799,
759
+ "step": 5000
760
+ },
761
+ {
762
+ "epoch": 12.85,
763
+ "learning_rate": 0.0002474747474747475,
764
+ "loss": 0.3317,
765
+ "step": 5100
766
+ },
767
+ {
768
+ "epoch": 12.85,
769
+ "eval_accuracy": 0.8974400257607471,
770
+ "eval_loss": 0.3343793749809265,
771
+ "eval_runtime": 500.7387,
772
+ "eval_samples_per_second": 49.615,
773
+ "eval_steps_per_second": 24.807,
774
+ "step": 5100
775
+ },
776
+ {
777
+ "epoch": 13.11,
778
+ "learning_rate": 0.0002457912457912458,
779
+ "loss": 0.3283,
780
+ "step": 5200
781
+ },
782
+ {
783
+ "epoch": 13.11,
784
+ "eval_accuracy": 0.8974400257607471,
785
+ "eval_loss": 0.33199575543403625,
786
+ "eval_runtime": 500.8527,
787
+ "eval_samples_per_second": 49.603,
788
+ "eval_steps_per_second": 24.802,
789
+ "step": 5200
790
+ },
791
+ {
792
+ "epoch": 13.36,
793
+ "learning_rate": 0.00024410774410774406,
794
+ "loss": 0.3263,
795
+ "step": 5300
796
+ },
797
+ {
798
+ "epoch": 13.36,
799
+ "eval_accuracy": 0.8974400257607471,
800
+ "eval_loss": 0.33114317059516907,
801
+ "eval_runtime": 500.8605,
802
+ "eval_samples_per_second": 49.603,
803
+ "eval_steps_per_second": 24.801,
804
+ "step": 5300
805
+ },
806
+ {
807
+ "epoch": 13.61,
808
+ "learning_rate": 0.0002424242424242424,
809
+ "loss": 0.3421,
810
+ "step": 5400
811
+ },
812
+ {
813
+ "epoch": 13.61,
814
+ "eval_accuracy": 0.8974400257607471,
815
+ "eval_loss": 0.3306863009929657,
816
+ "eval_runtime": 500.9253,
817
+ "eval_samples_per_second": 49.596,
818
+ "eval_steps_per_second": 24.798,
819
+ "step": 5400
820
+ },
821
+ {
822
+ "epoch": 13.86,
823
+ "learning_rate": 0.00024074074074074072,
824
+ "loss": 0.3164,
825
+ "step": 5500
826
+ },
827
+ {
828
+ "epoch": 13.86,
829
+ "eval_accuracy": 0.8974400257607471,
830
+ "eval_loss": 0.3318192958831787,
831
+ "eval_runtime": 500.4762,
832
+ "eval_samples_per_second": 49.641,
833
+ "eval_steps_per_second": 24.82,
834
+ "step": 5500
835
+ },
836
+ {
837
+ "epoch": 14.11,
838
+ "learning_rate": 0.00023905723905723905,
839
+ "loss": 0.3315,
840
+ "step": 5600
841
+ },
842
+ {
843
+ "epoch": 14.11,
844
+ "eval_accuracy": 0.8974400257607471,
845
+ "eval_loss": 0.3335217535495758,
846
+ "eval_runtime": 500.848,
847
+ "eval_samples_per_second": 49.604,
848
+ "eval_steps_per_second": 24.802,
849
+ "step": 5600
850
+ },
851
+ {
852
+ "epoch": 14.37,
853
+ "learning_rate": 0.00023737373737373732,
854
+ "loss": 0.3415,
855
+ "step": 5700
856
+ },
857
+ {
858
+ "epoch": 14.37,
859
+ "eval_accuracy": 0.8974400257607471,
860
+ "eval_loss": 0.3314845860004425,
861
+ "eval_runtime": 500.8633,
862
+ "eval_samples_per_second": 49.602,
863
+ "eval_steps_per_second": 24.801,
864
+ "step": 5700
865
+ },
866
+ {
867
+ "epoch": 14.62,
868
+ "learning_rate": 0.00023569023569023565,
869
+ "loss": 0.3325,
870
+ "step": 5800
871
+ },
872
+ {
873
+ "epoch": 14.62,
874
+ "eval_accuracy": 0.8974400257607471,
875
+ "eval_loss": 0.33067190647125244,
876
+ "eval_runtime": 500.8182,
877
+ "eval_samples_per_second": 49.607,
878
+ "eval_steps_per_second": 24.803,
879
+ "step": 5800
880
+ },
881
+ {
882
+ "epoch": 14.87,
883
+ "learning_rate": 0.00023400673400673398,
884
+ "loss": 0.3264,
885
+ "step": 5900
886
+ },
887
+ {
888
+ "epoch": 14.87,
889
+ "eval_accuracy": 0.8974400257607471,
890
+ "eval_loss": 0.33295896649360657,
891
+ "eval_runtime": 500.9198,
892
+ "eval_samples_per_second": 49.597,
893
+ "eval_steps_per_second": 24.798,
894
+ "step": 5900
895
+ },
896
+ {
897
+ "epoch": 15.12,
898
+ "learning_rate": 0.0002323232323232323,
899
+ "loss": 0.3223,
900
+ "step": 6000
901
+ },
902
+ {
903
+ "epoch": 15.12,
904
+ "eval_accuracy": 0.8974400257607471,
905
+ "eval_loss": 0.3306836187839508,
906
+ "eval_runtime": 500.9444,
907
+ "eval_samples_per_second": 49.594,
908
+ "eval_steps_per_second": 24.797,
909
+ "step": 6000
910
+ },
911
+ {
912
+ "epoch": 15.37,
913
+ "learning_rate": 0.00023063973063973064,
914
+ "loss": 0.3289,
915
+ "step": 6100
916
+ },
917
+ {
918
+ "epoch": 15.37,
919
+ "eval_accuracy": 0.8974400257607471,
920
+ "eval_loss": 0.3328978717327118,
921
+ "eval_runtime": 500.8768,
922
+ "eval_samples_per_second": 49.601,
923
+ "eval_steps_per_second": 24.801,
924
+ "step": 6100
925
+ },
926
+ {
927
+ "epoch": 15.63,
928
+ "learning_rate": 0.00022895622895622892,
929
+ "loss": 0.3353,
930
+ "step": 6200
931
+ },
932
+ {
933
+ "epoch": 15.63,
934
+ "eval_accuracy": 0.8974400257607471,
935
+ "eval_loss": 0.33112406730651855,
936
+ "eval_runtime": 500.9115,
937
+ "eval_samples_per_second": 49.598,
938
+ "eval_steps_per_second": 24.799,
939
+ "step": 6200
940
+ },
941
+ {
942
+ "epoch": 15.88,
943
+ "learning_rate": 0.00022727272727272725,
944
+ "loss": 0.3246,
945
+ "step": 6300
946
+ },
947
+ {
948
+ "epoch": 15.88,
949
+ "eval_accuracy": 0.8974400257607471,
950
+ "eval_loss": 0.3310993015766144,
951
+ "eval_runtime": 501.1149,
952
+ "eval_samples_per_second": 49.577,
953
+ "eval_steps_per_second": 24.789,
954
+ "step": 6300
955
+ },
956
+ {
957
+ "epoch": 16.13,
958
+ "learning_rate": 0.00022558922558922557,
959
+ "loss": 0.3425,
960
+ "step": 6400
961
+ },
962
+ {
963
+ "epoch": 16.13,
964
+ "eval_accuracy": 0.8974400257607471,
965
+ "eval_loss": 0.330674409866333,
966
+ "eval_runtime": 500.85,
967
+ "eval_samples_per_second": 49.604,
968
+ "eval_steps_per_second": 24.802,
969
+ "step": 6400
970
+ },
971
+ {
972
+ "epoch": 16.38,
973
+ "learning_rate": 0.0002239057239057239,
974
+ "loss": 0.331,
975
+ "step": 6500
976
+ },
977
+ {
978
+ "epoch": 16.38,
979
+ "eval_accuracy": 0.8974400257607471,
980
+ "eval_loss": 0.3306954503059387,
981
+ "eval_runtime": 501.1853,
982
+ "eval_samples_per_second": 49.57,
983
+ "eval_steps_per_second": 24.785,
984
+ "step": 6500
985
+ },
986
+ {
987
+ "epoch": 16.64,
988
+ "learning_rate": 0.00022222222222222218,
989
+ "loss": 0.3293,
990
+ "step": 6600
991
+ },
992
+ {
993
+ "epoch": 16.64,
994
+ "eval_accuracy": 0.8974400257607471,
995
+ "eval_loss": 0.33531516790390015,
996
+ "eval_runtime": 500.9658,
997
+ "eval_samples_per_second": 49.592,
998
+ "eval_steps_per_second": 24.796,
999
+ "step": 6600
1000
+ },
1001
+ {
1002
+ "epoch": 16.89,
1003
+ "learning_rate": 0.0002205387205387205,
1004
+ "loss": 0.3249,
1005
+ "step": 6700
1006
+ },
1007
+ {
1008
+ "epoch": 16.89,
1009
+ "eval_accuracy": 0.8974400257607471,
1010
+ "eval_loss": 0.3339368402957916,
1011
+ "eval_runtime": 500.8138,
1012
+ "eval_samples_per_second": 49.607,
1013
+ "eval_steps_per_second": 24.804,
1014
+ "step": 6700
1015
+ },
1016
+ {
1017
+ "epoch": 17.14,
1018
+ "learning_rate": 0.00021885521885521884,
1019
+ "loss": 0.3214,
1020
+ "step": 6800
1021
+ },
1022
+ {
1023
+ "epoch": 17.14,
1024
+ "eval_accuracy": 0.8974400257607471,
1025
+ "eval_loss": 0.3337734639644623,
1026
+ "eval_runtime": 500.9586,
1027
+ "eval_samples_per_second": 49.593,
1028
+ "eval_steps_per_second": 24.796,
1029
+ "step": 6800
1030
+ },
1031
+ {
1032
+ "epoch": 17.39,
1033
+ "learning_rate": 0.00021717171717171717,
1034
+ "loss": 0.3259,
1035
+ "step": 6900
1036
+ },
1037
+ {
1038
+ "epoch": 17.39,
1039
+ "eval_accuracy": 0.8974400257607471,
1040
+ "eval_loss": 0.3327140212059021,
1041
+ "eval_runtime": 501.0122,
1042
+ "eval_samples_per_second": 49.588,
1043
+ "eval_steps_per_second": 24.794,
1044
+ "step": 6900
1045
+ },
1046
+ {
1047
+ "epoch": 17.64,
1048
+ "learning_rate": 0.00021548821548821544,
1049
+ "loss": 0.3408,
1050
+ "step": 7000
1051
+ },
1052
+ {
1053
+ "epoch": 17.64,
1054
+ "eval_accuracy": 0.8974400257607471,
1055
+ "eval_loss": 0.33182209730148315,
1056
+ "eval_runtime": 500.9279,
1057
+ "eval_samples_per_second": 49.596,
1058
+ "eval_steps_per_second": 24.798,
1059
+ "step": 7000
1060
+ },
1061
+ {
1062
+ "epoch": 17.9,
1063
+ "learning_rate": 0.00021380471380471377,
1064
+ "loss": 0.3258,
1065
+ "step": 7100
1066
+ },
1067
+ {
1068
+ "epoch": 17.9,
1069
+ "eval_accuracy": 0.8974400257607471,
1070
+ "eval_loss": 0.33183717727661133,
1071
+ "eval_runtime": 501.2678,
1072
+ "eval_samples_per_second": 49.562,
1073
+ "eval_steps_per_second": 24.781,
1074
+ "step": 7100
1075
+ },
1076
+ {
1077
+ "epoch": 18.15,
1078
+ "learning_rate": 0.0002121212121212121,
1079
+ "loss": 0.3299,
1080
+ "step": 7200
1081
+ },
1082
+ {
1083
+ "epoch": 18.15,
1084
+ "eval_accuracy": 0.8974400257607471,
1085
+ "eval_loss": 0.33080849051475525,
1086
+ "eval_runtime": 501.2555,
1087
+ "eval_samples_per_second": 49.564,
1088
+ "eval_steps_per_second": 24.782,
1089
+ "step": 7200
1090
+ },
1091
+ {
1092
+ "epoch": 18.4,
1093
+ "learning_rate": 0.00021043771043771043,
1094
+ "loss": 0.327,
1095
+ "step": 7300
1096
+ },
1097
+ {
1098
+ "epoch": 18.4,
1099
+ "eval_accuracy": 0.8974400257607471,
1100
+ "eval_loss": 0.3371123671531677,
1101
+ "eval_runtime": 500.9892,
1102
+ "eval_samples_per_second": 49.59,
1103
+ "eval_steps_per_second": 24.795,
1104
+ "step": 7300
1105
+ },
1106
+ {
1107
+ "epoch": 18.65,
1108
+ "learning_rate": 0.00020875420875420876,
1109
+ "loss": 0.3317,
1110
+ "step": 7400
1111
+ },
1112
+ {
1113
+ "epoch": 18.65,
1114
+ "eval_accuracy": 0.8974400257607471,
1115
+ "eval_loss": 0.3307543694972992,
1116
+ "eval_runtime": 500.9046,
1117
+ "eval_samples_per_second": 49.598,
1118
+ "eval_steps_per_second": 24.799,
1119
+ "step": 7400
1120
+ },
1121
+ {
1122
+ "epoch": 18.9,
1123
+ "learning_rate": 0.00020707070707070703,
1124
+ "loss": 0.3291,
1125
+ "step": 7500
1126
+ },
1127
+ {
1128
+ "epoch": 18.9,
1129
+ "eval_accuracy": 0.8974400257607471,
1130
+ "eval_loss": 0.33100253343582153,
1131
+ "eval_runtime": 500.936,
1132
+ "eval_samples_per_second": 49.595,
1133
+ "eval_steps_per_second": 24.798,
1134
+ "step": 7500
1135
+ },
1136
+ {
1137
+ "epoch": 19.16,
1138
+ "learning_rate": 0.00020538720538720536,
1139
+ "loss": 0.3263,
1140
+ "step": 7600
1141
+ },
1142
+ {
1143
+ "epoch": 19.16,
1144
+ "eval_accuracy": 0.8974400257607471,
1145
+ "eval_loss": 0.33248230814933777,
1146
+ "eval_runtime": 500.8588,
1147
+ "eval_samples_per_second": 49.603,
1148
+ "eval_steps_per_second": 24.801,
1149
+ "step": 7600
1150
+ },
1151
+ {
1152
+ "epoch": 19.41,
1153
+ "learning_rate": 0.0002037037037037037,
1154
+ "loss": 0.3223,
1155
+ "step": 7700
1156
+ },
1157
+ {
1158
+ "epoch": 19.41,
1159
+ "eval_accuracy": 0.8974400257607471,
1160
+ "eval_loss": 0.33463332056999207,
1161
+ "eval_runtime": 500.8344,
1162
+ "eval_samples_per_second": 49.605,
1163
+ "eval_steps_per_second": 24.803,
1164
+ "step": 7700
1165
+ },
1166
+ {
1167
+ "epoch": 19.66,
1168
+ "learning_rate": 0.00020202020202020202,
1169
+ "loss": 0.3403,
1170
+ "step": 7800
1171
+ },
1172
+ {
1173
+ "epoch": 19.66,
1174
+ "eval_accuracy": 0.8974400257607471,
1175
+ "eval_loss": 0.3315812647342682,
1176
+ "eval_runtime": 500.8929,
1177
+ "eval_samples_per_second": 49.599,
1178
+ "eval_steps_per_second": 24.8,
1179
+ "step": 7800
1180
+ },
1181
+ {
1182
+ "epoch": 19.91,
1183
+ "learning_rate": 0.0002003367003367003,
1184
+ "loss": 0.3265,
1185
+ "step": 7900
1186
+ },
1187
+ {
1188
+ "epoch": 19.91,
1189
+ "eval_accuracy": 0.8974400257607471,
1190
+ "eval_loss": 0.3309071660041809,
1191
+ "eval_runtime": 500.8065,
1192
+ "eval_samples_per_second": 49.608,
1193
+ "eval_steps_per_second": 24.804,
1194
+ "step": 7900
1195
+ },
1196
+ {
1197
+ "epoch": 20.16,
1198
+ "learning_rate": 0.00019865319865319862,
1199
+ "loss": 0.33,
1200
+ "step": 8000
1201
+ },
1202
+ {
1203
+ "epoch": 20.16,
1204
+ "eval_accuracy": 0.8974400257607471,
1205
+ "eval_loss": 0.3318468928337097,
1206
+ "eval_runtime": 501.0869,
1207
+ "eval_samples_per_second": 49.58,
1208
+ "eval_steps_per_second": 24.79,
1209
+ "step": 8000
1210
+ },
1211
+ {
1212
+ "epoch": 20.42,
1213
+ "learning_rate": 0.00019696969696969695,
1214
+ "loss": 0.3488,
1215
+ "step": 8100
1216
+ },
1217
+ {
1218
+ "epoch": 20.42,
1219
+ "eval_accuracy": 0.8974400257607471,
1220
+ "eval_loss": 0.33127933740615845,
1221
+ "eval_runtime": 500.8956,
1222
+ "eval_samples_per_second": 49.599,
1223
+ "eval_steps_per_second": 24.8,
1224
+ "step": 8100
1225
+ },
1226
+ {
1227
+ "epoch": 20.67,
1228
+ "learning_rate": 0.00019528619528619528,
1229
+ "loss": 0.3293,
1230
+ "step": 8200
1231
+ },
1232
+ {
1233
+ "epoch": 20.67,
1234
+ "eval_accuracy": 0.8974400257607471,
1235
+ "eval_loss": 0.33354687690734863,
1236
+ "eval_runtime": 501.2059,
1237
+ "eval_samples_per_second": 49.568,
1238
+ "eval_steps_per_second": 24.784,
1239
+ "step": 8200
1240
+ },
1241
+ {
1242
+ "epoch": 20.92,
1243
+ "learning_rate": 0.00019360269360269356,
1244
+ "loss": 0.3095,
1245
+ "step": 8300
1246
+ },
1247
+ {
1248
+ "epoch": 20.92,
1249
+ "eval_accuracy": 0.8974400257607471,
1250
+ "eval_loss": 0.33559244871139526,
1251
+ "eval_runtime": 501.1442,
1252
+ "eval_samples_per_second": 49.575,
1253
+ "eval_steps_per_second": 24.787,
1254
+ "step": 8300
1255
+ },
1256
+ {
1257
+ "epoch": 21.17,
1258
+ "learning_rate": 0.0001919191919191919,
1259
+ "loss": 0.3366,
1260
+ "step": 8400
1261
+ },
1262
+ {
1263
+ "epoch": 21.17,
1264
+ "eval_accuracy": 0.8974400257607471,
1265
+ "eval_loss": 0.3331533968448639,
1266
+ "eval_runtime": 501.0445,
1267
+ "eval_samples_per_second": 49.584,
1268
+ "eval_steps_per_second": 24.792,
1269
+ "step": 8400
1270
+ },
1271
+ {
1272
+ "epoch": 21.42,
1273
+ "learning_rate": 0.00019023569023569022,
1274
+ "loss": 0.317,
1275
+ "step": 8500
1276
+ },
1277
+ {
1278
+ "epoch": 21.42,
1279
+ "eval_accuracy": 0.8974400257607471,
1280
+ "eval_loss": 0.3337852358818054,
1281
+ "eval_runtime": 501.2024,
1282
+ "eval_samples_per_second": 49.569,
1283
+ "eval_steps_per_second": 24.784,
1284
+ "step": 8500
1285
+ },
1286
+ {
1287
+ "epoch": 21.68,
1288
+ "learning_rate": 0.00018855218855218854,
1289
+ "loss": 0.3299,
1290
+ "step": 8600
1291
+ },
1292
+ {
1293
+ "epoch": 21.68,
1294
+ "eval_accuracy": 0.8974400257607471,
1295
+ "eval_loss": 0.3308347165584564,
1296
+ "eval_runtime": 501.0,
1297
+ "eval_samples_per_second": 49.589,
1298
+ "eval_steps_per_second": 24.794,
1299
+ "step": 8600
1300
+ },
1301
+ {
1302
+ "epoch": 21.93,
1303
+ "learning_rate": 0.00018686868686868687,
1304
+ "loss": 0.3434,
1305
+ "step": 8700
1306
+ },
1307
+ {
1308
+ "epoch": 21.93,
1309
+ "eval_accuracy": 0.8974400257607471,
1310
+ "eval_loss": 0.330965131521225,
1311
+ "eval_runtime": 501.1751,
1312
+ "eval_samples_per_second": 49.571,
1313
+ "eval_steps_per_second": 24.786,
1314
+ "step": 8700
1315
+ },
1316
+ {
1317
+ "epoch": 22.18,
1318
+ "learning_rate": 0.00018518518518518515,
1319
+ "loss": 0.3208,
1320
+ "step": 8800
1321
+ },
1322
+ {
1323
+ "epoch": 22.18,
1324
+ "eval_accuracy": 0.8974400257607471,
1325
+ "eval_loss": 0.3308819830417633,
1326
+ "eval_runtime": 501.189,
1327
+ "eval_samples_per_second": 49.57,
1328
+ "eval_steps_per_second": 24.785,
1329
+ "step": 8800
1330
+ },
1331
+ {
1332
+ "epoch": 22.43,
1333
+ "learning_rate": 0.00018350168350168348,
1334
+ "loss": 0.3351,
1335
+ "step": 8900
1336
+ },
1337
+ {
1338
+ "epoch": 22.43,
1339
+ "eval_accuracy": 0.8974400257607471,
1340
+ "eval_loss": 0.33238929510116577,
1341
+ "eval_runtime": 501.2428,
1342
+ "eval_samples_per_second": 49.565,
1343
+ "eval_steps_per_second": 24.782,
1344
+ "step": 8900
1345
+ },
1346
+ {
1347
+ "epoch": 22.68,
1348
+ "learning_rate": 0.0001818181818181818,
1349
+ "loss": 0.3301,
1350
+ "step": 9000
1351
+ },
1352
+ {
1353
+ "epoch": 22.68,
1354
+ "eval_accuracy": 0.8974400257607471,
1355
+ "eval_loss": 0.3308260440826416,
1356
+ "eval_runtime": 500.8427,
1357
+ "eval_samples_per_second": 49.604,
1358
+ "eval_steps_per_second": 24.802,
1359
+ "step": 9000
1360
+ },
1361
+ {
1362
+ "epoch": 22.94,
1363
+ "learning_rate": 0.00018013468013468014,
1364
+ "loss": 0.3196,
1365
+ "step": 9100
1366
+ },
1367
+ {
1368
+ "epoch": 22.94,
1369
+ "eval_accuracy": 0.8974400257607471,
1370
+ "eval_loss": 0.3329552710056305,
1371
+ "eval_runtime": 501.1009,
1372
+ "eval_samples_per_second": 49.579,
1373
+ "eval_steps_per_second": 24.789,
1374
+ "step": 9100
1375
+ },
1376
+ {
1377
+ "epoch": 23.19,
1378
+ "learning_rate": 0.0001784511784511784,
1379
+ "loss": 0.3339,
1380
+ "step": 9200
1381
+ },
1382
+ {
1383
+ "epoch": 23.19,
1384
+ "eval_accuracy": 0.8974400257607471,
1385
+ "eval_loss": 0.33333924412727356,
1386
+ "eval_runtime": 500.8988,
1387
+ "eval_samples_per_second": 49.599,
1388
+ "eval_steps_per_second": 24.799,
1389
+ "step": 9200
1390
+ },
1391
+ {
1392
+ "epoch": 23.44,
1393
+ "learning_rate": 0.00017676767676767674,
1394
+ "loss": 0.3249,
1395
+ "step": 9300
1396
+ },
1397
+ {
1398
+ "epoch": 23.44,
1399
+ "eval_accuracy": 0.8974400257607471,
1400
+ "eval_loss": 0.3307563364505768,
1401
+ "eval_runtime": 501.0394,
1402
+ "eval_samples_per_second": 49.585,
1403
+ "eval_steps_per_second": 24.792,
1404
+ "step": 9300
1405
+ },
1406
+ {
1407
+ "epoch": 23.69,
1408
+ "learning_rate": 0.00017508417508417507,
1409
+ "loss": 0.3247,
1410
+ "step": 9400
1411
+ },
1412
+ {
1413
+ "epoch": 23.69,
1414
+ "eval_accuracy": 0.8974400257607471,
1415
+ "eval_loss": 0.3338105082511902,
1416
+ "eval_runtime": 500.7662,
1417
+ "eval_samples_per_second": 49.612,
1418
+ "eval_steps_per_second": 24.806,
1419
+ "step": 9400
1420
+ },
1421
+ {
1422
+ "epoch": 23.94,
1423
+ "learning_rate": 0.0001734006734006734,
1424
+ "loss": 0.3369,
1425
+ "step": 9500
1426
+ },
1427
+ {
1428
+ "epoch": 23.94,
1429
+ "eval_accuracy": 0.8974400257607471,
1430
+ "eval_loss": 0.3312574028968811,
1431
+ "eval_runtime": 501.3028,
1432
+ "eval_samples_per_second": 49.559,
1433
+ "eval_steps_per_second": 24.779,
1434
+ "step": 9500
1435
+ },
1436
+ {
1437
+ "epoch": 24.2,
1438
+ "learning_rate": 0.00017171717171717167,
1439
+ "loss": 0.3291,
1440
+ "step": 9600
1441
+ },
1442
+ {
1443
+ "epoch": 24.2,
1444
+ "eval_accuracy": 0.8974400257607471,
1445
+ "eval_loss": 0.3320288062095642,
1446
+ "eval_runtime": 501.3419,
1447
+ "eval_samples_per_second": 49.555,
1448
+ "eval_steps_per_second": 24.777,
1449
+ "step": 9600
1450
+ },
1451
+ {
1452
+ "epoch": 24.45,
1453
+ "learning_rate": 0.00017003367003367,
1454
+ "loss": 0.3307,
1455
+ "step": 9700
1456
+ },
1457
+ {
1458
+ "epoch": 24.45,
1459
+ "eval_accuracy": 0.8974400257607471,
1460
+ "eval_loss": 0.33087393641471863,
1461
+ "eval_runtime": 501.1809,
1462
+ "eval_samples_per_second": 49.571,
1463
+ "eval_steps_per_second": 24.785,
1464
+ "step": 9700
1465
+ },
1466
+ {
1467
+ "epoch": 24.7,
1468
+ "learning_rate": 0.00016835016835016833,
1469
+ "loss": 0.3328,
1470
+ "step": 9800
1471
+ },
1472
+ {
1473
+ "epoch": 24.7,
1474
+ "eval_accuracy": 0.8974400257607471,
1475
+ "eval_loss": 0.33073562383651733,
1476
+ "eval_runtime": 500.8708,
1477
+ "eval_samples_per_second": 49.602,
1478
+ "eval_steps_per_second": 24.801,
1479
+ "step": 9800
1480
+ },
1481
+ {
1482
+ "epoch": 24.95,
1483
+ "learning_rate": 0.00016666666666666666,
1484
+ "loss": 0.3277,
1485
+ "step": 9900
1486
+ },
1487
+ {
1488
+ "epoch": 24.95,
1489
+ "eval_accuracy": 0.8974400257607471,
1490
+ "eval_loss": 0.3341946601867676,
1491
+ "eval_runtime": 501.1287,
1492
+ "eval_samples_per_second": 49.576,
1493
+ "eval_steps_per_second": 24.788,
1494
+ "step": 9900
1495
+ },
1496
+ {
1497
+ "epoch": 25.2,
1498
+ "learning_rate": 0.000164983164983165,
1499
+ "loss": 0.3278,
1500
+ "step": 10000
1501
+ },
1502
+ {
1503
+ "epoch": 25.2,
1504
+ "eval_accuracy": 0.8974400257607471,
1505
+ "eval_loss": 0.3309917449951172,
1506
+ "eval_runtime": 500.9142,
1507
+ "eval_samples_per_second": 49.597,
1508
+ "eval_steps_per_second": 24.799,
1509
+ "step": 10000
1510
+ },
1511
+ {
1512
+ "epoch": 25.46,
1513
+ "learning_rate": 0.00016329966329966327,
1514
+ "loss": 0.3197,
1515
+ "step": 10100
1516
+ },
1517
+ {
1518
+ "epoch": 25.46,
1519
+ "eval_accuracy": 0.8974400257607471,
1520
+ "eval_loss": 0.3348841965198517,
1521
+ "eval_runtime": 501.1589,
1522
+ "eval_samples_per_second": 49.573,
1523
+ "eval_steps_per_second": 24.787,
1524
+ "step": 10100
1525
+ },
1526
+ {
1527
+ "epoch": 25.71,
1528
+ "learning_rate": 0.0001616161616161616,
1529
+ "loss": 0.3273,
1530
+ "step": 10200
1531
+ },
1532
+ {
1533
+ "epoch": 25.71,
1534
+ "eval_accuracy": 0.8974400257607471,
1535
+ "eval_loss": 0.3321140706539154,
1536
+ "eval_runtime": 501.4344,
1537
+ "eval_samples_per_second": 49.546,
1538
+ "eval_steps_per_second": 24.773,
1539
+ "step": 10200
1540
+ },
1541
+ {
1542
+ "epoch": 25.96,
1543
+ "learning_rate": 0.00015993265993265992,
1544
+ "loss": 0.3345,
1545
+ "step": 10300
1546
+ },
1547
+ {
1548
+ "epoch": 25.96,
1549
+ "eval_accuracy": 0.8974400257607471,
1550
+ "eval_loss": 0.3312225043773651,
1551
+ "eval_runtime": 500.9045,
1552
+ "eval_samples_per_second": 49.598,
1553
+ "eval_steps_per_second": 24.799,
1554
+ "step": 10300
1555
+ },
1556
+ {
1557
+ "epoch": 26.21,
1558
+ "learning_rate": 0.00015824915824915825,
1559
+ "loss": 0.3351,
1560
+ "step": 10400
1561
+ },
1562
+ {
1563
+ "epoch": 26.21,
1564
+ "eval_accuracy": 0.8974400257607471,
1565
+ "eval_loss": 0.33248284459114075,
1566
+ "eval_runtime": 501.2052,
1567
+ "eval_samples_per_second": 49.569,
1568
+ "eval_steps_per_second": 24.784,
1569
+ "step": 10400
1570
+ },
1571
+ {
1572
+ "epoch": 26.47,
1573
+ "learning_rate": 0.00015656565656565653,
1574
+ "loss": 0.3144,
1575
+ "step": 10500
1576
+ },
1577
+ {
1578
+ "epoch": 26.47,
1579
+ "eval_accuracy": 0.8974400257607471,
1580
+ "eval_loss": 0.334583580493927,
1581
+ "eval_runtime": 501.103,
1582
+ "eval_samples_per_second": 49.579,
1583
+ "eval_steps_per_second": 24.789,
1584
+ "step": 10500
1585
+ },
1586
+ {
1587
+ "epoch": 26.72,
1588
+ "learning_rate": 0.00015488215488215486,
1589
+ "loss": 0.3361,
1590
+ "step": 10600
1591
+ },
1592
+ {
1593
+ "epoch": 26.72,
1594
+ "eval_accuracy": 0.8974400257607471,
1595
+ "eval_loss": 0.33112606406211853,
1596
+ "eval_runtime": 500.6859,
1597
+ "eval_samples_per_second": 49.62,
1598
+ "eval_steps_per_second": 24.81,
1599
+ "step": 10600
1600
+ },
1601
+ {
1602
+ "epoch": 26.97,
1603
+ "learning_rate": 0.00015319865319865319,
1604
+ "loss": 0.3334,
1605
+ "step": 10700
1606
+ },
1607
+ {
1608
+ "epoch": 26.97,
1609
+ "eval_accuracy": 0.8974400257607471,
1610
+ "eval_loss": 0.3306848406791687,
1611
+ "eval_runtime": 500.81,
1612
+ "eval_samples_per_second": 49.608,
1613
+ "eval_steps_per_second": 24.804,
1614
+ "step": 10700
1615
+ },
1616
+ {
1617
+ "epoch": 27.22,
1618
+ "learning_rate": 0.00015151515151515152,
1619
+ "loss": 0.3287,
1620
+ "step": 10800
1621
+ },
1622
+ {
1623
+ "epoch": 27.22,
1624
+ "eval_accuracy": 0.8974400257607471,
1625
+ "eval_loss": 0.3373050093650818,
1626
+ "eval_runtime": 501.0133,
1627
+ "eval_samples_per_second": 49.588,
1628
+ "eval_steps_per_second": 24.794,
1629
+ "step": 10800
1630
+ },
1631
+ {
1632
+ "epoch": 27.47,
1633
+ "learning_rate": 0.00014983164983164982,
1634
+ "loss": 0.3374,
1635
+ "step": 10900
1636
+ },
1637
+ {
1638
+ "epoch": 27.47,
1639
+ "eval_accuracy": 0.8974400257607471,
1640
+ "eval_loss": 0.3306737244129181,
1641
+ "eval_runtime": 501.4272,
1642
+ "eval_samples_per_second": 49.547,
1643
+ "eval_steps_per_second": 24.773,
1644
+ "step": 10900
1645
+ },
1646
+ {
1647
+ "epoch": 27.73,
1648
+ "learning_rate": 0.00014814814814814812,
1649
+ "loss": 0.3302,
1650
+ "step": 11000
1651
+ },
1652
+ {
1653
+ "epoch": 27.73,
1654
+ "eval_accuracy": 0.8974400257607471,
1655
+ "eval_loss": 0.3306819200515747,
1656
+ "eval_runtime": 501.0901,
1657
+ "eval_samples_per_second": 49.58,
1658
+ "eval_steps_per_second": 24.79,
1659
+ "step": 11000
1660
+ },
1661
+ {
1662
+ "epoch": 27.98,
1663
+ "learning_rate": 0.00014646464646464645,
1664
+ "loss": 0.3245,
1665
+ "step": 11100
1666
+ },
1667
+ {
1668
+ "epoch": 27.98,
1669
+ "eval_accuracy": 0.8974400257607471,
1670
+ "eval_loss": 0.33153215050697327,
1671
+ "eval_runtime": 501.2107,
1672
+ "eval_samples_per_second": 49.568,
1673
+ "eval_steps_per_second": 24.784,
1674
+ "step": 11100
1675
+ },
1676
+ {
1677
+ "epoch": 28.23,
1678
+ "learning_rate": 0.00014478114478114478,
1679
+ "loss": 0.3353,
1680
+ "step": 11200
1681
+ },
1682
+ {
1683
+ "epoch": 28.23,
1684
+ "eval_accuracy": 0.8974400257607471,
1685
+ "eval_loss": 0.33351030945777893,
1686
+ "eval_runtime": 501.1769,
1687
+ "eval_samples_per_second": 49.571,
1688
+ "eval_steps_per_second": 24.786,
1689
+ "step": 11200
1690
+ },
1691
+ {
1692
+ "epoch": 28.48,
1693
+ "learning_rate": 0.00014309764309764308,
1694
+ "loss": 0.3191,
1695
+ "step": 11300
1696
+ },
1697
+ {
1698
+ "epoch": 28.48,
1699
+ "eval_accuracy": 0.8974400257607471,
1700
+ "eval_loss": 0.33356890082359314,
1701
+ "eval_runtime": 501.2908,
1702
+ "eval_samples_per_second": 49.56,
1703
+ "eval_steps_per_second": 24.78,
1704
+ "step": 11300
1705
+ },
1706
+ {
1707
+ "epoch": 28.73,
1708
+ "learning_rate": 0.0001414141414141414,
1709
+ "loss": 0.3226,
1710
+ "step": 11400
1711
+ },
1712
+ {
1713
+ "epoch": 28.73,
1714
+ "eval_accuracy": 0.8974400257607471,
1715
+ "eval_loss": 0.33081722259521484,
1716
+ "eval_runtime": 501.1297,
1717
+ "eval_samples_per_second": 49.576,
1718
+ "eval_steps_per_second": 24.788,
1719
+ "step": 11400
1720
+ },
1721
+ {
1722
+ "epoch": 28.99,
1723
+ "learning_rate": 0.0001397306397306397,
1724
+ "loss": 0.3384,
1725
+ "step": 11500
1726
+ },
1727
+ {
1728
+ "epoch": 28.99,
1729
+ "eval_accuracy": 0.8974400257607471,
1730
+ "eval_loss": 0.3321709930896759,
1731
+ "eval_runtime": 501.2824,
1732
+ "eval_samples_per_second": 49.561,
1733
+ "eval_steps_per_second": 24.78,
1734
+ "step": 11500
1735
+ },
1736
+ {
1737
+ "epoch": 29.24,
1738
+ "learning_rate": 0.00013804713804713804,
1739
+ "loss": 0.3368,
1740
+ "step": 11600
1741
+ },
1742
+ {
1743
+ "epoch": 29.24,
1744
+ "eval_accuracy": 0.8974400257607471,
1745
+ "eval_loss": 0.3336506485939026,
1746
+ "eval_runtime": 500.9493,
1747
+ "eval_samples_per_second": 49.594,
1748
+ "eval_steps_per_second": 24.797,
1749
+ "step": 11600
1750
+ },
1751
+ {
1752
+ "epoch": 29.49,
1753
+ "learning_rate": 0.00013636363636363634,
1754
+ "loss": 0.3224,
1755
+ "step": 11700
1756
+ },
1757
+ {
1758
+ "epoch": 29.49,
1759
+ "eval_accuracy": 0.8974400257607471,
1760
+ "eval_loss": 0.3331962823867798,
1761
+ "eval_runtime": 501.3861,
1762
+ "eval_samples_per_second": 49.551,
1763
+ "eval_steps_per_second": 24.775,
1764
+ "step": 11700
1765
+ },
1766
+ {
1767
+ "epoch": 29.74,
1768
+ "learning_rate": 0.00013468013468013467,
1769
+ "loss": 0.3224,
1770
+ "step": 11800
1771
+ },
1772
+ {
1773
+ "epoch": 29.74,
1774
+ "eval_accuracy": 0.8974400257607471,
1775
+ "eval_loss": 0.3318473696708679,
1776
+ "eval_runtime": 501.3052,
1777
+ "eval_samples_per_second": 49.559,
1778
+ "eval_steps_per_second": 24.779,
1779
+ "step": 11800
1780
+ },
1781
+ {
1782
+ "epoch": 29.99,
1783
+ "learning_rate": 0.00013299663299663297,
1784
+ "loss": 0.3363,
1785
+ "step": 11900
1786
+ },
1787
+ {
1788
+ "epoch": 29.99,
1789
+ "eval_accuracy": 0.8974400257607471,
1790
+ "eval_loss": 0.3309670388698578,
1791
+ "eval_runtime": 501.4331,
1792
+ "eval_samples_per_second": 49.546,
1793
+ "eval_steps_per_second": 24.773,
1794
+ "step": 11900
1795
+ },
1796
+ {
1797
+ "epoch": 30.25,
1798
+ "learning_rate": 0.0001313131313131313,
1799
+ "loss": 0.327,
1800
+ "step": 12000
1801
+ },
1802
+ {
1803
+ "epoch": 30.25,
1804
+ "eval_accuracy": 0.8974400257607471,
1805
+ "eval_loss": 0.3306976854801178,
1806
+ "eval_runtime": 501.4726,
1807
+ "eval_samples_per_second": 49.542,
1808
+ "eval_steps_per_second": 24.771,
1809
+ "step": 12000
1810
+ },
1811
+ {
1812
+ "epoch": 30.5,
1813
+ "learning_rate": 0.0001296296296296296,
1814
+ "loss": 0.3291,
1815
+ "step": 12100
1816
+ },
1817
+ {
1818
+ "epoch": 30.5,
1819
+ "eval_accuracy": 0.8974400257607471,
1820
+ "eval_loss": 0.3306950628757477,
1821
+ "eval_runtime": 501.0845,
1822
+ "eval_samples_per_second": 49.58,
1823
+ "eval_steps_per_second": 24.79,
1824
+ "step": 12100
1825
+ },
1826
+ {
1827
+ "epoch": 30.75,
1828
+ "learning_rate": 0.00012794612794612793,
1829
+ "loss": 0.3369,
1830
+ "step": 12200
1831
+ },
1832
+ {
1833
+ "epoch": 30.75,
1834
+ "eval_accuracy": 0.8974400257607471,
1835
+ "eval_loss": 0.3321588933467865,
1836
+ "eval_runtime": 501.0681,
1837
+ "eval_samples_per_second": 49.582,
1838
+ "eval_steps_per_second": 24.791,
1839
+ "step": 12200
1840
+ },
1841
+ {
1842
+ "epoch": 31.0,
1843
+ "learning_rate": 0.00012626262626262626,
1844
+ "loss": 0.3211,
1845
+ "step": 12300
1846
+ },
1847
+ {
1848
+ "epoch": 31.0,
1849
+ "eval_accuracy": 0.8974400257607471,
1850
+ "eval_loss": 0.3328503370285034,
1851
+ "eval_runtime": 501.3433,
1852
+ "eval_samples_per_second": 49.555,
1853
+ "eval_steps_per_second": 24.777,
1854
+ "step": 12300
1855
+ },
1856
+ {
1857
+ "epoch": 31.25,
1858
+ "learning_rate": 0.00012457912457912456,
1859
+ "loss": 0.329,
1860
+ "step": 12400
1861
+ },
1862
+ {
1863
+ "epoch": 31.25,
1864
+ "eval_accuracy": 0.8974400257607471,
1865
+ "eval_loss": 0.33213621377944946,
1866
+ "eval_runtime": 501.089,
1867
+ "eval_samples_per_second": 49.58,
1868
+ "eval_steps_per_second": 24.79,
1869
+ "step": 12400
1870
+ },
1871
+ {
1872
+ "epoch": 31.51,
1873
+ "learning_rate": 0.0001228956228956229,
1874
+ "loss": 0.3206,
1875
+ "step": 12500
1876
+ },
1877
+ {
1878
+ "epoch": 31.51,
1879
+ "eval_accuracy": 0.8974400257607471,
1880
+ "eval_loss": 0.33089062571525574,
1881
+ "eval_runtime": 501.0382,
1882
+ "eval_samples_per_second": 49.585,
1883
+ "eval_steps_per_second": 24.793,
1884
+ "step": 12500
1885
+ },
1886
+ {
1887
+ "epoch": 31.76,
1888
+ "learning_rate": 0.0001212121212121212,
1889
+ "loss": 0.3339,
1890
+ "step": 12600
1891
+ },
1892
+ {
1893
+ "epoch": 31.76,
1894
+ "eval_accuracy": 0.8974400257607471,
1895
+ "eval_loss": 0.3331972658634186,
1896
+ "eval_runtime": 501.242,
1897
+ "eval_samples_per_second": 49.565,
1898
+ "eval_steps_per_second": 24.782,
1899
+ "step": 12600
1900
+ },
1901
+ {
1902
+ "epoch": 32.01,
1903
+ "learning_rate": 0.00011952861952861952,
1904
+ "loss": 0.3323,
1905
+ "step": 12700
1906
+ },
1907
+ {
1908
+ "epoch": 32.01,
1909
+ "eval_accuracy": 0.8974400257607471,
1910
+ "eval_loss": 0.3316064476966858,
1911
+ "eval_runtime": 501.0626,
1912
+ "eval_samples_per_second": 49.583,
1913
+ "eval_steps_per_second": 24.791,
1914
+ "step": 12700
1915
+ },
1916
+ {
1917
+ "epoch": 32.26,
1918
+ "learning_rate": 0.00011784511784511783,
1919
+ "loss": 0.3273,
1920
+ "step": 12800
1921
+ },
1922
+ {
1923
+ "epoch": 32.26,
1924
+ "eval_accuracy": 0.8974400257607471,
1925
+ "eval_loss": 0.3323478400707245,
1926
+ "eval_runtime": 501.4098,
1927
+ "eval_samples_per_second": 49.548,
1928
+ "eval_steps_per_second": 24.774,
1929
+ "step": 12800
1930
+ },
1931
+ {
1932
+ "epoch": 32.51,
1933
+ "learning_rate": 0.00011616161616161616,
1934
+ "loss": 0.3362,
1935
+ "step": 12900
1936
+ },
1937
+ {
1938
+ "epoch": 32.51,
1939
+ "eval_accuracy": 0.8974400257607471,
1940
+ "eval_loss": 0.33072328567504883,
1941
+ "eval_runtime": 501.8013,
1942
+ "eval_samples_per_second": 49.51,
1943
+ "eval_steps_per_second": 24.755,
1944
+ "step": 12900
1945
+ },
1946
+ {
1947
+ "epoch": 32.77,
1948
+ "learning_rate": 0.00011447811447811446,
1949
+ "loss": 0.3387,
1950
+ "step": 13000
1951
+ },
1952
+ {
1953
+ "epoch": 32.77,
1954
+ "eval_accuracy": 0.8974400257607471,
1955
+ "eval_loss": 0.3308790922164917,
1956
+ "eval_runtime": 501.2768,
1957
+ "eval_samples_per_second": 49.561,
1958
+ "eval_steps_per_second": 24.781,
1959
+ "step": 13000
1960
+ },
1961
+ {
1962
+ "epoch": 33.02,
1963
+ "learning_rate": 0.00011279461279461279,
1964
+ "loss": 0.3173,
1965
+ "step": 13100
1966
+ },
1967
+ {
1968
+ "epoch": 33.02,
1969
+ "eval_accuracy": 0.8974400257607471,
1970
+ "eval_loss": 0.33112308382987976,
1971
+ "eval_runtime": 501.2827,
1972
+ "eval_samples_per_second": 49.561,
1973
+ "eval_steps_per_second": 24.78,
1974
+ "step": 13100
1975
+ },
1976
+ {
1977
+ "epoch": 33.27,
1978
+ "learning_rate": 0.00011111111111111109,
1979
+ "loss": 0.3291,
1980
+ "step": 13200
1981
+ },
1982
+ {
1983
+ "epoch": 33.27,
1984
+ "eval_accuracy": 0.8974400257607471,
1985
+ "eval_loss": 0.33085396885871887,
1986
+ "eval_runtime": 501.2449,
1987
+ "eval_samples_per_second": 49.565,
1988
+ "eval_steps_per_second": 24.782,
1989
+ "step": 13200
1990
+ },
1991
+ {
1992
+ "epoch": 33.52,
1993
+ "learning_rate": 0.00010942760942760942,
1994
+ "loss": 0.3316,
1995
+ "step": 13300
1996
+ },
1997
+ {
1998
+ "epoch": 33.52,
1999
+ "eval_accuracy": 0.8974400257607471,
2000
+ "eval_loss": 0.33154767751693726,
2001
+ "eval_runtime": 501.0257,
2002
+ "eval_samples_per_second": 49.586,
2003
+ "eval_steps_per_second": 24.793,
2004
+ "step": 13300
2005
+ },
2006
+ {
2007
+ "epoch": 33.77,
2008
+ "learning_rate": 0.00010774410774410772,
2009
+ "loss": 0.3366,
2010
+ "step": 13400
2011
+ },
2012
+ {
2013
+ "epoch": 33.77,
2014
+ "eval_accuracy": 0.8974400257607471,
2015
+ "eval_loss": 0.33317822217941284,
2016
+ "eval_runtime": 501.0403,
2017
+ "eval_samples_per_second": 49.585,
2018
+ "eval_steps_per_second": 24.792,
2019
+ "step": 13400
2020
+ },
2021
+ {
2022
+ "epoch": 34.03,
2023
+ "learning_rate": 0.00010606060606060605,
2024
+ "loss": 0.3115,
2025
+ "step": 13500
2026
+ },
2027
+ {
2028
+ "epoch": 34.03,
2029
+ "eval_accuracy": 0.8974400257607471,
2030
+ "eval_loss": 0.3382599353790283,
2031
+ "eval_runtime": 500.7949,
2032
+ "eval_samples_per_second": 49.609,
2033
+ "eval_steps_per_second": 24.805,
2034
+ "step": 13500
2035
+ },
2036
+ {
2037
+ "epoch": 34.28,
2038
+ "learning_rate": 0.00010437710437710438,
2039
+ "loss": 0.3275,
2040
+ "step": 13600
2041
+ },
2042
+ {
2043
+ "epoch": 34.28,
2044
+ "eval_accuracy": 0.8974400257607471,
2045
+ "eval_loss": 0.332431823015213,
2046
+ "eval_runtime": 500.933,
2047
+ "eval_samples_per_second": 49.595,
2048
+ "eval_steps_per_second": 24.798,
2049
+ "step": 13600
2050
+ },
2051
+ {
2052
+ "epoch": 34.53,
2053
+ "learning_rate": 0.00010269360269360268,
2054
+ "loss": 0.3373,
2055
+ "step": 13700
2056
+ },
2057
+ {
2058
+ "epoch": 34.53,
2059
+ "eval_accuracy": 0.8974400257607471,
2060
+ "eval_loss": 0.33150389790534973,
2061
+ "eval_runtime": 500.781,
2062
+ "eval_samples_per_second": 49.611,
2063
+ "eval_steps_per_second": 24.805,
2064
+ "step": 13700
2065
+ },
2066
+ {
2067
+ "epoch": 34.78,
2068
+ "learning_rate": 0.00010101010101010101,
2069
+ "loss": 0.3247,
2070
+ "step": 13800
2071
+ },
2072
+ {
2073
+ "epoch": 34.78,
2074
+ "eval_accuracy": 0.8974400257607471,
2075
+ "eval_loss": 0.3313423693180084,
2076
+ "eval_runtime": 501.1265,
2077
+ "eval_samples_per_second": 49.576,
2078
+ "eval_steps_per_second": 24.788,
2079
+ "step": 13800
2080
+ },
2081
+ {
2082
+ "epoch": 35.03,
2083
+ "learning_rate": 9.932659932659931e-05,
2084
+ "loss": 0.3349,
2085
+ "step": 13900
2086
+ },
2087
+ {
2088
+ "epoch": 35.03,
2089
+ "eval_accuracy": 0.8974400257607471,
2090
+ "eval_loss": 0.33250102400779724,
2091
+ "eval_runtime": 501.0936,
2092
+ "eval_samples_per_second": 49.58,
2093
+ "eval_steps_per_second": 24.79,
2094
+ "step": 13900
2095
+ },
2096
+ {
2097
+ "epoch": 35.29,
2098
+ "learning_rate": 9.764309764309764e-05,
2099
+ "loss": 0.3223,
2100
+ "step": 14000
2101
+ },
2102
+ {
2103
+ "epoch": 35.29,
2104
+ "eval_accuracy": 0.8974400257607471,
2105
+ "eval_loss": 0.33122116327285767,
2106
+ "eval_runtime": 500.9681,
2107
+ "eval_samples_per_second": 49.592,
2108
+ "eval_steps_per_second": 24.796,
2109
+ "step": 14000
2110
+ },
2111
+ {
2112
+ "epoch": 35.54,
2113
+ "learning_rate": 9.595959595959594e-05,
2114
+ "loss": 0.3321,
2115
+ "step": 14100
2116
+ },
2117
+ {
2118
+ "epoch": 35.54,
2119
+ "eval_accuracy": 0.8974400257607471,
2120
+ "eval_loss": 0.3307776153087616,
2121
+ "eval_runtime": 500.9865,
2122
+ "eval_samples_per_second": 49.59,
2123
+ "eval_steps_per_second": 24.795,
2124
+ "step": 14100
2125
+ },
2126
+ {
2127
+ "epoch": 35.79,
2128
+ "learning_rate": 9.427609427609427e-05,
2129
+ "loss": 0.3304,
2130
+ "step": 14200
2131
+ },
2132
+ {
2133
+ "epoch": 35.79,
2134
+ "eval_accuracy": 0.8974400257607471,
2135
+ "eval_loss": 0.3315562605857849,
2136
+ "eval_runtime": 500.788,
2137
+ "eval_samples_per_second": 49.61,
2138
+ "eval_steps_per_second": 24.805,
2139
+ "step": 14200
2140
+ },
2141
+ {
2142
+ "epoch": 36.04,
2143
+ "learning_rate": 9.259259259259257e-05,
2144
+ "loss": 0.3262,
2145
+ "step": 14300
2146
+ },
2147
+ {
2148
+ "epoch": 36.04,
2149
+ "eval_accuracy": 0.8974400257607471,
2150
+ "eval_loss": 0.33196473121643066,
2151
+ "eval_runtime": 501.0344,
2152
+ "eval_samples_per_second": 49.585,
2153
+ "eval_steps_per_second": 24.793,
2154
+ "step": 14300
2155
+ },
2156
+ {
2157
+ "epoch": 36.29,
2158
+ "learning_rate": 9.09090909090909e-05,
2159
+ "loss": 0.3239,
2160
+ "step": 14400
2161
+ },
2162
+ {
2163
+ "epoch": 36.29,
2164
+ "eval_accuracy": 0.8974400257607471,
2165
+ "eval_loss": 0.3316847085952759,
2166
+ "eval_runtime": 501.0629,
2167
+ "eval_samples_per_second": 49.583,
2168
+ "eval_steps_per_second": 24.791,
2169
+ "step": 14400
2170
+ },
2171
+ {
2172
+ "epoch": 36.55,
2173
+ "learning_rate": 8.92255892255892e-05,
2174
+ "loss": 0.3325,
2175
+ "step": 14500
2176
+ },
2177
+ {
2178
+ "epoch": 36.55,
2179
+ "eval_accuracy": 0.8974400257607471,
2180
+ "eval_loss": 0.3308143615722656,
2181
+ "eval_runtime": 500.8635,
2182
+ "eval_samples_per_second": 49.602,
2183
+ "eval_steps_per_second": 24.801,
2184
+ "step": 14500
2185
+ },
2186
+ {
2187
+ "epoch": 36.8,
2188
+ "learning_rate": 8.754208754208753e-05,
2189
+ "loss": 0.325,
2190
+ "step": 14600
2191
+ },
2192
+ {
2193
+ "epoch": 36.8,
2194
+ "eval_accuracy": 0.8974400257607471,
2195
+ "eval_loss": 0.3316170275211334,
2196
+ "eval_runtime": 500.7755,
2197
+ "eval_samples_per_second": 49.611,
2198
+ "eval_steps_per_second": 24.806,
2199
+ "step": 14600
2200
+ },
2201
+ {
2202
+ "epoch": 37.05,
2203
+ "learning_rate": 8.585858585858584e-05,
2204
+ "loss": 0.3416,
2205
+ "step": 14700
2206
+ },
2207
+ {
2208
+ "epoch": 37.05,
2209
+ "eval_accuracy": 0.8974400257607471,
2210
+ "eval_loss": 0.3310682773590088,
2211
+ "eval_runtime": 501.0155,
2212
+ "eval_samples_per_second": 49.587,
2213
+ "eval_steps_per_second": 24.794,
2214
+ "step": 14700
2215
+ },
2216
+ {
2217
+ "epoch": 37.3,
2218
+ "learning_rate": 8.417508417508417e-05,
2219
+ "loss": 0.3226,
2220
+ "step": 14800
2221
+ },
2222
+ {
2223
+ "epoch": 37.3,
2224
+ "eval_accuracy": 0.8974400257607471,
2225
+ "eval_loss": 0.33090585470199585,
2226
+ "eval_runtime": 500.9851,
2227
+ "eval_samples_per_second": 49.59,
2228
+ "eval_steps_per_second": 24.795,
2229
+ "step": 14800
2230
+ },
2231
+ {
2232
+ "epoch": 37.56,
2233
+ "learning_rate": 8.24915824915825e-05,
2234
+ "loss": 0.3286,
2235
+ "step": 14900
2236
+ },
2237
+ {
2238
+ "epoch": 37.56,
2239
+ "eval_accuracy": 0.8974400257607471,
2240
+ "eval_loss": 0.3306817412376404,
2241
+ "eval_runtime": 500.941,
2242
+ "eval_samples_per_second": 49.595,
2243
+ "eval_steps_per_second": 24.797,
2244
+ "step": 14900
2245
+ },
2246
+ {
2247
+ "epoch": 37.81,
2248
+ "learning_rate": 8.08080808080808e-05,
2249
+ "loss": 0.3284,
2250
+ "step": 15000
2251
+ },
2252
+ {
2253
+ "epoch": 37.81,
2254
+ "eval_accuracy": 0.8974400257607471,
2255
+ "eval_loss": 0.3312084972858429,
2256
+ "eval_runtime": 500.7822,
2257
+ "eval_samples_per_second": 49.61,
2258
+ "eval_steps_per_second": 24.805,
2259
+ "step": 15000
2260
+ },
2261
+ {
2262
+ "epoch": 38.06,
2263
+ "learning_rate": 7.912457912457913e-05,
2264
+ "loss": 0.3298,
2265
+ "step": 15100
2266
+ },
2267
+ {
2268
+ "epoch": 38.06,
2269
+ "eval_accuracy": 0.8974400257607471,
2270
+ "eval_loss": 0.33263882994651794,
2271
+ "eval_runtime": 500.7072,
2272
+ "eval_samples_per_second": 49.618,
2273
+ "eval_steps_per_second": 24.809,
2274
+ "step": 15100
2275
+ },
2276
+ {
2277
+ "epoch": 38.31,
2278
+ "learning_rate": 7.744107744107743e-05,
2279
+ "loss": 0.3383,
2280
+ "step": 15200
2281
+ },
2282
+ {
2283
+ "epoch": 38.31,
2284
+ "eval_accuracy": 0.8974400257607471,
2285
+ "eval_loss": 0.33113569021224976,
2286
+ "eval_runtime": 501.0449,
2287
+ "eval_samples_per_second": 49.584,
2288
+ "eval_steps_per_second": 24.792,
2289
+ "step": 15200
2290
+ },
2291
+ {
2292
+ "epoch": 38.56,
2293
+ "learning_rate": 7.575757575757576e-05,
2294
+ "loss": 0.3418,
2295
+ "step": 15300
2296
+ },
2297
+ {
2298
+ "epoch": 38.56,
2299
+ "eval_accuracy": 0.8974400257607471,
2300
+ "eval_loss": 0.33080732822418213,
2301
+ "eval_runtime": 501.1158,
2302
+ "eval_samples_per_second": 49.577,
2303
+ "eval_steps_per_second": 24.789,
2304
+ "step": 15300
2305
+ },
2306
+ {
2307
+ "epoch": 38.82,
2308
+ "learning_rate": 7.407407407407406e-05,
2309
+ "loss": 0.3123,
2310
+ "step": 15400
2311
+ },
2312
+ {
2313
+ "epoch": 38.82,
2314
+ "eval_accuracy": 0.8974400257607471,
2315
+ "eval_loss": 0.3311246931552887,
2316
+ "eval_runtime": 501.2192,
2317
+ "eval_samples_per_second": 49.567,
2318
+ "eval_steps_per_second": 24.784,
2319
+ "step": 15400
2320
+ },
2321
+ {
2322
+ "epoch": 39.07,
2323
+ "learning_rate": 7.239057239057239e-05,
2324
+ "loss": 0.3237,
2325
+ "step": 15500
2326
+ },
2327
+ {
2328
+ "epoch": 39.07,
2329
+ "eval_accuracy": 0.8974400257607471,
2330
+ "eval_loss": 0.3346453011035919,
2331
+ "eval_runtime": 501.3886,
2332
+ "eval_samples_per_second": 49.55,
2333
+ "eval_steps_per_second": 24.775,
2334
+ "step": 15500
2335
+ },
2336
+ {
2337
+ "epoch": 39.32,
2338
+ "learning_rate": 7.07070707070707e-05,
2339
+ "loss": 0.3261,
2340
+ "step": 15600
2341
+ },
2342
+ {
2343
+ "epoch": 39.32,
2344
+ "eval_accuracy": 0.8974400257607471,
2345
+ "eval_loss": 0.33250510692596436,
2346
+ "eval_runtime": 501.4416,
2347
+ "eval_samples_per_second": 49.545,
2348
+ "eval_steps_per_second": 24.773,
2349
+ "step": 15600
2350
+ },
2351
+ {
2352
+ "epoch": 39.57,
2353
+ "learning_rate": 6.902356902356902e-05,
2354
+ "loss": 0.3269,
2355
+ "step": 15700
2356
+ },
2357
+ {
2358
+ "epoch": 39.57,
2359
+ "eval_accuracy": 0.8974400257607471,
2360
+ "eval_loss": 0.33122241497039795,
2361
+ "eval_runtime": 501.3022,
2362
+ "eval_samples_per_second": 49.559,
2363
+ "eval_steps_per_second": 24.779,
2364
+ "step": 15700
2365
+ },
2366
+ {
2367
+ "epoch": 39.82,
2368
+ "learning_rate": 6.734006734006734e-05,
2369
+ "loss": 0.3267,
2370
+ "step": 15800
2371
+ },
2372
+ {
2373
+ "epoch": 39.82,
2374
+ "eval_accuracy": 0.8974400257607471,
2375
+ "eval_loss": 0.3319133520126343,
2376
+ "eval_runtime": 501.3262,
2377
+ "eval_samples_per_second": 49.557,
2378
+ "eval_steps_per_second": 24.778,
2379
+ "step": 15800
2380
+ },
2381
+ {
2382
+ "epoch": 40.08,
2383
+ "learning_rate": 6.565656565656565e-05,
2384
+ "loss": 0.3381,
2385
+ "step": 15900
2386
+ },
2387
+ {
2388
+ "epoch": 40.08,
2389
+ "eval_accuracy": 0.8974400257607471,
2390
+ "eval_loss": 0.33269181847572327,
2391
+ "eval_runtime": 500.8586,
2392
+ "eval_samples_per_second": 49.603,
2393
+ "eval_steps_per_second": 24.801,
2394
+ "step": 15900
2395
+ },
2396
+ {
2397
+ "epoch": 40.33,
2398
+ "learning_rate": 6.397306397306397e-05,
2399
+ "loss": 0.3238,
2400
+ "step": 16000
2401
+ },
2402
+ {
2403
+ "epoch": 40.33,
2404
+ "eval_accuracy": 0.8974400257607471,
2405
+ "eval_loss": 0.3325785994529724,
2406
+ "eval_runtime": 501.1224,
2407
+ "eval_samples_per_second": 49.577,
2408
+ "eval_steps_per_second": 24.788,
2409
+ "step": 16000
2410
+ },
2411
+ {
2412
+ "epoch": 40.58,
2413
+ "learning_rate": 6.228956228956228e-05,
2414
+ "loss": 0.3299,
2415
+ "step": 16100
2416
+ },
2417
+ {
2418
+ "epoch": 40.58,
2419
+ "eval_accuracy": 0.8974400257607471,
2420
+ "eval_loss": 0.33203861117362976,
2421
+ "eval_runtime": 500.8556,
2422
+ "eval_samples_per_second": 49.603,
2423
+ "eval_steps_per_second": 24.802,
2424
+ "step": 16100
2425
+ },
2426
+ {
2427
+ "epoch": 40.83,
2428
+ "learning_rate": 6.06060606060606e-05,
2429
+ "loss": 0.3385,
2430
+ "step": 16200
2431
+ },
2432
+ {
2433
+ "epoch": 40.83,
2434
+ "eval_accuracy": 0.8974400257607471,
2435
+ "eval_loss": 0.33086949586868286,
2436
+ "eval_runtime": 501.1006,
2437
+ "eval_samples_per_second": 49.579,
2438
+ "eval_steps_per_second": 24.789,
2439
+ "step": 16200
2440
+ },
2441
+ {
2442
+ "epoch": 41.08,
2443
+ "learning_rate": 5.8922558922558913e-05,
2444
+ "loss": 0.3268,
2445
+ "step": 16300
2446
+ },
2447
+ {
2448
+ "epoch": 41.08,
2449
+ "eval_accuracy": 0.8974400257607471,
2450
+ "eval_loss": 0.33224013447761536,
2451
+ "eval_runtime": 500.9055,
2452
+ "eval_samples_per_second": 49.598,
2453
+ "eval_steps_per_second": 24.799,
2454
+ "step": 16300
2455
+ },
2456
+ {
2457
+ "epoch": 41.34,
2458
+ "learning_rate": 5.723905723905723e-05,
2459
+ "loss": 0.3253,
2460
+ "step": 16400
2461
+ },
2462
+ {
2463
+ "epoch": 41.34,
2464
+ "eval_accuracy": 0.8974400257607471,
2465
+ "eval_loss": 0.3319920301437378,
2466
+ "eval_runtime": 501.2306,
2467
+ "eval_samples_per_second": 49.566,
2468
+ "eval_steps_per_second": 24.783,
2469
+ "step": 16400
2470
+ },
2471
+ {
2472
+ "epoch": 41.59,
2473
+ "learning_rate": 5.5555555555555545e-05,
2474
+ "loss": 0.3261,
2475
+ "step": 16500
2476
+ },
2477
+ {
2478
+ "epoch": 41.59,
2479
+ "eval_accuracy": 0.8974400257607471,
2480
+ "eval_loss": 0.33143314719200134,
2481
+ "eval_runtime": 501.0325,
2482
+ "eval_samples_per_second": 49.586,
2483
+ "eval_steps_per_second": 24.793,
2484
+ "step": 16500
2485
+ },
2486
+ {
2487
+ "epoch": 41.84,
2488
+ "learning_rate": 5.387205387205386e-05,
2489
+ "loss": 0.3362,
2490
+ "step": 16600
2491
+ },
2492
+ {
2493
+ "epoch": 41.84,
2494
+ "eval_accuracy": 0.8974400257607471,
2495
+ "eval_loss": 0.3324301838874817,
2496
+ "eval_runtime": 500.7987,
2497
+ "eval_samples_per_second": 49.609,
2498
+ "eval_steps_per_second": 24.804,
2499
+ "step": 16600
2500
+ },
2501
+ {
2502
+ "epoch": 42.09,
2503
+ "learning_rate": 5.218855218855219e-05,
2504
+ "loss": 0.3203,
2505
+ "step": 16700
2506
+ },
2507
+ {
2508
+ "epoch": 42.09,
2509
+ "eval_accuracy": 0.8974400257607471,
2510
+ "eval_loss": 0.3325912356376648,
2511
+ "eval_runtime": 500.6821,
2512
+ "eval_samples_per_second": 49.62,
2513
+ "eval_steps_per_second": 24.81,
2514
+ "step": 16700
2515
+ },
2516
+ {
2517
+ "epoch": 42.34,
2518
+ "learning_rate": 5.0505050505050505e-05,
2519
+ "loss": 0.325,
2520
+ "step": 16800
2521
+ },
2522
+ {
2523
+ "epoch": 42.34,
2524
+ "eval_accuracy": 0.8974400257607471,
2525
+ "eval_loss": 0.3323043882846832,
2526
+ "eval_runtime": 501.26,
2527
+ "eval_samples_per_second": 49.563,
2528
+ "eval_steps_per_second": 24.782,
2529
+ "step": 16800
2530
+ },
2531
+ {
2532
+ "epoch": 42.6,
2533
+ "learning_rate": 4.882154882154882e-05,
2534
+ "loss": 0.3172,
2535
+ "step": 16900
2536
+ },
2537
+ {
2538
+ "epoch": 42.6,
2539
+ "eval_accuracy": 0.8974400257607471,
2540
+ "eval_loss": 0.33261871337890625,
2541
+ "eval_runtime": 500.9553,
2542
+ "eval_samples_per_second": 49.593,
2543
+ "eval_steps_per_second": 24.797,
2544
+ "step": 16900
2545
+ },
2546
+ {
2547
+ "epoch": 42.85,
2548
+ "learning_rate": 4.7138047138047136e-05,
2549
+ "loss": 0.3361,
2550
+ "step": 17000
2551
+ },
2552
+ {
2553
+ "epoch": 42.85,
2554
+ "eval_accuracy": 0.8974400257607471,
2555
+ "eval_loss": 0.3307626247406006,
2556
+ "eval_runtime": 501.0928,
2557
+ "eval_samples_per_second": 49.58,
2558
+ "eval_steps_per_second": 24.79,
2559
+ "step": 17000
2560
+ },
2561
+ {
2562
+ "epoch": 43.1,
2563
+ "learning_rate": 4.545454545454545e-05,
2564
+ "loss": 0.3432,
2565
+ "step": 17100
2566
+ },
2567
+ {
2568
+ "epoch": 43.1,
2569
+ "eval_accuracy": 0.8974400257607471,
2570
+ "eval_loss": 0.3309696614742279,
2571
+ "eval_runtime": 501.4895,
2572
+ "eval_samples_per_second": 49.54,
2573
+ "eval_steps_per_second": 24.77,
2574
+ "step": 17100
2575
+ },
2576
+ {
2577
+ "epoch": 43.35,
2578
+ "learning_rate": 4.377104377104377e-05,
2579
+ "loss": 0.3396,
2580
+ "step": 17200
2581
+ },
2582
+ {
2583
+ "epoch": 43.35,
2584
+ "eval_accuracy": 0.8974400257607471,
2585
+ "eval_loss": 0.3312534689903259,
2586
+ "eval_runtime": 501.211,
2587
+ "eval_samples_per_second": 49.568,
2588
+ "eval_steps_per_second": 24.784,
2589
+ "step": 17200
2590
+ },
2591
+ {
2592
+ "epoch": 43.6,
2593
+ "learning_rate": 4.208754208754208e-05,
2594
+ "loss": 0.3163,
2595
+ "step": 17300
2596
+ },
2597
+ {
2598
+ "epoch": 43.6,
2599
+ "eval_accuracy": 0.8974400257607471,
2600
+ "eval_loss": 0.33276140689849854,
2601
+ "eval_runtime": 501.2264,
2602
+ "eval_samples_per_second": 49.566,
2603
+ "eval_steps_per_second": 24.783,
2604
+ "step": 17300
2605
+ },
2606
+ {
2607
+ "epoch": 43.86,
2608
+ "learning_rate": 4.04040404040404e-05,
2609
+ "loss": 0.3353,
2610
+ "step": 17400
2611
+ },
2612
+ {
2613
+ "epoch": 43.86,
2614
+ "eval_accuracy": 0.8974400257607471,
2615
+ "eval_loss": 0.3318198025226593,
2616
+ "eval_runtime": 501.088,
2617
+ "eval_samples_per_second": 49.58,
2618
+ "eval_steps_per_second": 24.79,
2619
+ "step": 17400
2620
+ },
2621
+ {
2622
+ "epoch": 44.11,
2623
+ "learning_rate": 3.8720538720538714e-05,
2624
+ "loss": 0.3299,
2625
+ "step": 17500
2626
+ },
2627
+ {
2628
+ "epoch": 44.11,
2629
+ "eval_accuracy": 0.8974400257607471,
2630
+ "eval_loss": 0.3316582441329956,
2631
+ "eval_runtime": 501.3763,
2632
+ "eval_samples_per_second": 49.552,
2633
+ "eval_steps_per_second": 24.776,
2634
+ "step": 17500
2635
+ },
2636
+ {
2637
+ "epoch": 44.36,
2638
+ "learning_rate": 3.703703703703703e-05,
2639
+ "loss": 0.3213,
2640
+ "step": 17600
2641
+ },
2642
+ {
2643
+ "epoch": 44.36,
2644
+ "eval_accuracy": 0.8974400257607471,
2645
+ "eval_loss": 0.33194538950920105,
2646
+ "eval_runtime": 501.7895,
2647
+ "eval_samples_per_second": 49.511,
2648
+ "eval_steps_per_second": 24.755,
2649
+ "step": 17600
2650
+ },
2651
+ {
2652
+ "epoch": 44.61,
2653
+ "learning_rate": 3.535353535353535e-05,
2654
+ "loss": 0.3253,
2655
+ "step": 17700
2656
+ },
2657
+ {
2658
+ "epoch": 44.61,
2659
+ "eval_accuracy": 0.8974400257607471,
2660
+ "eval_loss": 0.33288490772247314,
2661
+ "eval_runtime": 501.1283,
2662
+ "eval_samples_per_second": 49.576,
2663
+ "eval_steps_per_second": 24.788,
2664
+ "step": 17700
2665
+ },
2666
+ {
2667
+ "epoch": 44.86,
2668
+ "learning_rate": 3.367003367003367e-05,
2669
+ "loss": 0.3391,
2670
+ "step": 17800
2671
+ },
2672
+ {
2673
+ "epoch": 44.86,
2674
+ "eval_accuracy": 0.8974400257607471,
2675
+ "eval_loss": 0.33222696185112,
2676
+ "eval_runtime": 501.5052,
2677
+ "eval_samples_per_second": 49.539,
2678
+ "eval_steps_per_second": 24.769,
2679
+ "step": 17800
2680
+ },
2681
+ {
2682
+ "epoch": 45.12,
2683
+ "learning_rate": 3.198653198653198e-05,
2684
+ "loss": 0.3179,
2685
+ "step": 17900
2686
+ },
2687
+ {
2688
+ "epoch": 45.12,
2689
+ "eval_accuracy": 0.8974400257607471,
2690
+ "eval_loss": 0.333011269569397,
2691
+ "eval_runtime": 500.7091,
2692
+ "eval_samples_per_second": 49.618,
2693
+ "eval_steps_per_second": 24.809,
2694
+ "step": 17900
2695
+ },
2696
+ {
2697
+ "epoch": 45.37,
2698
+ "learning_rate": 3.03030303030303e-05,
2699
+ "loss": 0.3348,
2700
+ "step": 18000
2701
+ },
2702
+ {
2703
+ "epoch": 45.37,
2704
+ "eval_accuracy": 0.8974400257607471,
2705
+ "eval_loss": 0.3321002721786499,
2706
+ "eval_runtime": 501.2516,
2707
+ "eval_samples_per_second": 49.564,
2708
+ "eval_steps_per_second": 24.782,
2709
+ "step": 18000
2710
+ },
2711
+ {
2712
+ "epoch": 45.62,
2713
+ "learning_rate": 2.8619528619528615e-05,
2714
+ "loss": 0.3116,
2715
+ "step": 18100
2716
+ },
2717
+ {
2718
+ "epoch": 45.62,
2719
+ "eval_accuracy": 0.8974400257607471,
2720
+ "eval_loss": 0.33259570598602295,
2721
+ "eval_runtime": 501.2743,
2722
+ "eval_samples_per_second": 49.562,
2723
+ "eval_steps_per_second": 24.781,
2724
+ "step": 18100
2725
+ },
2726
+ {
2727
+ "epoch": 45.87,
2728
+ "learning_rate": 2.693602693602693e-05,
2729
+ "loss": 0.3334,
2730
+ "step": 18200
2731
+ },
2732
+ {
2733
+ "epoch": 45.87,
2734
+ "eval_accuracy": 0.8974400257607471,
2735
+ "eval_loss": 0.33218705654144287,
2736
+ "eval_runtime": 501.0248,
2737
+ "eval_samples_per_second": 49.586,
2738
+ "eval_steps_per_second": 24.793,
2739
+ "step": 18200
2740
+ },
2741
+ {
2742
+ "epoch": 46.12,
2743
+ "learning_rate": 2.5252525252525253e-05,
2744
+ "loss": 0.3401,
2745
+ "step": 18300
2746
+ },
2747
+ {
2748
+ "epoch": 46.12,
2749
+ "eval_accuracy": 0.8974400257607471,
2750
+ "eval_loss": 0.3314586579799652,
2751
+ "eval_runtime": 501.1615,
2752
+ "eval_samples_per_second": 49.573,
2753
+ "eval_steps_per_second": 24.786,
2754
+ "step": 18300
2755
+ },
2756
+ {
2757
+ "epoch": 46.38,
2758
+ "learning_rate": 2.3569023569023568e-05,
2759
+ "loss": 0.3381,
2760
+ "step": 18400
2761
+ },
2762
+ {
2763
+ "epoch": 46.38,
2764
+ "eval_accuracy": 0.8974400257607471,
2765
+ "eval_loss": 0.33111417293548584,
2766
+ "eval_runtime": 501.2779,
2767
+ "eval_samples_per_second": 49.561,
2768
+ "eval_steps_per_second": 24.781,
2769
+ "step": 18400
2770
+ },
2771
+ {
2772
+ "epoch": 46.63,
2773
+ "learning_rate": 2.1885521885521884e-05,
2774
+ "loss": 0.3154,
2775
+ "step": 18500
2776
+ },
2777
+ {
2778
+ "epoch": 46.63,
2779
+ "eval_accuracy": 0.8974400257607471,
2780
+ "eval_loss": 0.3327486515045166,
2781
+ "eval_runtime": 500.9424,
2782
+ "eval_samples_per_second": 49.595,
2783
+ "eval_steps_per_second": 24.797,
2784
+ "step": 18500
2785
+ },
2786
+ {
2787
+ "epoch": 46.88,
2788
+ "learning_rate": 2.02020202020202e-05,
2789
+ "loss": 0.3348,
2790
+ "step": 18600
2791
+ },
2792
+ {
2793
+ "epoch": 46.88,
2794
+ "eval_accuracy": 0.8974400257607471,
2795
+ "eval_loss": 0.33224716782569885,
2796
+ "eval_runtime": 500.9745,
2797
+ "eval_samples_per_second": 49.591,
2798
+ "eval_steps_per_second": 24.796,
2799
+ "step": 18600
2800
+ },
2801
+ {
2802
+ "epoch": 47.13,
2803
+ "learning_rate": 1.8518518518518515e-05,
2804
+ "loss": 0.3285,
2805
+ "step": 18700
2806
+ },
2807
+ {
2808
+ "epoch": 47.13,
2809
+ "eval_accuracy": 0.8974400257607471,
2810
+ "eval_loss": 0.3325360119342804,
2811
+ "eval_runtime": 501.157,
2812
+ "eval_samples_per_second": 49.573,
2813
+ "eval_steps_per_second": 24.787,
2814
+ "step": 18700
2815
+ },
2816
+ {
2817
+ "epoch": 47.39,
2818
+ "learning_rate": 1.6835016835016834e-05,
2819
+ "loss": 0.3256,
2820
+ "step": 18800
2821
+ },
2822
+ {
2823
+ "epoch": 47.39,
2824
+ "eval_accuracy": 0.8974400257607471,
2825
+ "eval_loss": 0.3328581750392914,
2826
+ "eval_runtime": 501.2027,
2827
+ "eval_samples_per_second": 49.569,
2828
+ "eval_steps_per_second": 24.784,
2829
+ "step": 18800
2830
+ },
2831
+ {
2832
+ "epoch": 47.64,
2833
+ "learning_rate": 1.515151515151515e-05,
2834
+ "loss": 0.3389,
2835
+ "step": 18900
2836
+ },
2837
+ {
2838
+ "epoch": 47.64,
2839
+ "eval_accuracy": 0.8974400257607471,
2840
+ "eval_loss": 0.3324856758117676,
2841
+ "eval_runtime": 501.1837,
2842
+ "eval_samples_per_second": 49.571,
2843
+ "eval_steps_per_second": 24.785,
2844
+ "step": 18900
2845
+ },
2846
+ {
2847
+ "epoch": 47.89,
2848
+ "learning_rate": 1.3468013468013465e-05,
2849
+ "loss": 0.3288,
2850
+ "step": 19000
2851
+ },
2852
+ {
2853
+ "epoch": 47.89,
2854
+ "eval_accuracy": 0.8974400257607471,
2855
+ "eval_loss": 0.3326534032821655,
2856
+ "eval_runtime": 501.4739,
2857
+ "eval_samples_per_second": 49.542,
2858
+ "eval_steps_per_second": 24.771,
2859
+ "step": 19000
2860
+ },
2861
+ {
2862
+ "epoch": 48.14,
2863
+ "learning_rate": 1.1784511784511784e-05,
2864
+ "loss": 0.3172,
2865
+ "step": 19100
2866
+ },
2867
+ {
2868
+ "epoch": 48.14,
2869
+ "eval_accuracy": 0.8974400257607471,
2870
+ "eval_loss": 0.3326767683029175,
2871
+ "eval_runtime": 500.8014,
2872
+ "eval_samples_per_second": 49.608,
2873
+ "eval_steps_per_second": 24.804,
2874
+ "step": 19100
2875
+ },
2876
+ {
2877
+ "epoch": 48.39,
2878
+ "learning_rate": 1.01010101010101e-05,
2879
+ "loss": 0.3211,
2880
+ "step": 19200
2881
+ },
2882
+ {
2883
+ "epoch": 48.39,
2884
+ "eval_accuracy": 0.8974400257607471,
2885
+ "eval_loss": 0.3324893116950989,
2886
+ "eval_runtime": 500.8057,
2887
+ "eval_samples_per_second": 49.608,
2888
+ "eval_steps_per_second": 24.804,
2889
+ "step": 19200
2890
+ },
2891
+ {
2892
+ "epoch": 48.65,
2893
+ "learning_rate": 8.417508417508417e-06,
2894
+ "loss": 0.3348,
2895
+ "step": 19300
2896
+ },
2897
+ {
2898
+ "epoch": 48.65,
2899
+ "eval_accuracy": 0.8974400257607471,
2900
+ "eval_loss": 0.33247503638267517,
2901
+ "eval_runtime": 501.0569,
2902
+ "eval_samples_per_second": 49.583,
2903
+ "eval_steps_per_second": 24.792,
2904
+ "step": 19300
2905
+ },
2906
+ {
2907
+ "epoch": 48.9,
2908
+ "learning_rate": 6.7340067340067325e-06,
2909
+ "loss": 0.3327,
2910
+ "step": 19400
2911
+ },
2912
+ {
2913
+ "epoch": 48.9,
2914
+ "eval_accuracy": 0.8974400257607471,
2915
+ "eval_loss": 0.33261463046073914,
2916
+ "eval_runtime": 501.0903,
2917
+ "eval_samples_per_second": 49.58,
2918
+ "eval_steps_per_second": 24.79,
2919
+ "step": 19400
2920
+ },
2921
+ {
2922
+ "epoch": 49.15,
2923
+ "learning_rate": 5.05050505050505e-06,
2924
+ "loss": 0.3341,
2925
+ "step": 19500
2926
+ },
2927
+ {
2928
+ "epoch": 49.15,
2929
+ "eval_accuracy": 0.8974400257607471,
2930
+ "eval_loss": 0.33255448937416077,
2931
+ "eval_runtime": 500.9292,
2932
+ "eval_samples_per_second": 49.596,
2933
+ "eval_steps_per_second": 24.798,
2934
+ "step": 19500
2935
+ },
2936
+ {
2937
+ "epoch": 49.4,
2938
+ "learning_rate": 3.3670033670033663e-06,
2939
+ "loss": 0.3344,
2940
+ "step": 19600
2941
+ },
2942
+ {
2943
+ "epoch": 49.4,
2944
+ "eval_accuracy": 0.8974400257607471,
2945
+ "eval_loss": 0.33247339725494385,
2946
+ "eval_runtime": 501.4588,
2947
+ "eval_samples_per_second": 49.543,
2948
+ "eval_steps_per_second": 24.772,
2949
+ "step": 19600
2950
+ },
2951
+ {
2952
+ "epoch": 49.65,
2953
+ "learning_rate": 1.6835016835016831e-06,
2954
+ "loss": 0.3207,
2955
+ "step": 19700
2956
+ },
2957
+ {
2958
+ "epoch": 49.65,
2959
+ "eval_accuracy": 0.8974400257607471,
2960
+ "eval_loss": 0.33257797360420227,
2961
+ "eval_runtime": 501.4807,
2962
+ "eval_samples_per_second": 49.541,
2963
+ "eval_steps_per_second": 24.771,
2964
+ "step": 19700
2965
+ },
2966
+ {
2967
+ "epoch": 49.91,
2968
+ "learning_rate": 0.0,
2969
+ "loss": 0.3299,
2970
+ "step": 19800
2971
+ },
2972
+ {
2973
+ "epoch": 49.91,
2974
+ "eval_accuracy": 0.8974400257607471,
2975
+ "eval_loss": 0.33260539174079895,
2976
+ "eval_runtime": 501.1869,
2977
+ "eval_samples_per_second": 49.57,
2978
+ "eval_steps_per_second": 24.785,
2979
+ "step": 19800
2980
+ },
2981
+ {
2982
+ "epoch": 49.91,
2983
+ "step": 19800,
2984
+ "total_flos": 7.53101543607702e+19,
2985
+ "train_loss": 0.3200095210412536,
2986
+ "train_runtime": 116243.9445,
2987
+ "train_samples_per_second": 10.917,
2988
+ "train_steps_per_second": 0.17
2989
+ }
2990
+ ],
2991
+ "logging_steps": 100,
2992
+ "max_steps": 19800,
2993
+ "num_train_epochs": 50,
2994
+ "save_steps": 100,
2995
+ "total_flos": 7.53101543607702e+19,
2996
+ "trial_name": null,
2997
+ "trial_params": null
2998
+ }