asahi417 commited on
Commit
b3692a1
1 Parent(s): 3f893b9

model update

Browse files
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "lmqg_output/qg_subjqa_vanilla/t5_small_subjqa_movies/best_model",
3
  "add_prefix": true,
4
  "architectures": [
5
  "T5ForConditionalGeneration"
 
1
  {
2
+ "_name_or_path": "t5-small",
3
  "add_prefix": true,
4
  "architectures": [
5
  "T5ForConditionalGeneration"
eval/metric.first.answer.paragraph_answer.question.asahi417_qg_subjqa.movies.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"validation": {"Bleu_1": 0.023638260638925664, "Bleu_2": 0.006408351040052978, "Bleu_3": 4.188331370698151e-08, "Bleu_4": 1.0788802322690441e-10}, "test": {"Bleu_1": 0.0016510638576064792, "Bleu_2": 2.3772858486866073e-11, "Bleu_3": 5.855754178811885e-14, "Bleu_4": 2.9345190129665035e-15}}
eval/samples.test.hyp.paragraph_answer.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,153 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+ I completely loved Battle Royale as it was an amazing and unbelievably good movie. It goes into detail about the things this movie skimps over and explores the characters on a much deeper level.
14
+
15
+
16
+
17
+
18
+
19
+
20
+
21
+
22
+ great DVD, ok movie.
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+ "Gravity" is a life time experience that everyone must see! The main one out of all these fantastic genres is definitely suspense. You walk in feeling bored and tired and you walk out feeling like Ryan Stone in the movie. (Sandra Bullock)The thrilling adventure begins when
41
+
42
+
43
+
44
+
45
+
46
+
47
+ "Menace" is actually superior to "Clones"
48
+
49
+
50
+
51
+
52
+ PLOT SUMMARY: "Signs" takes place in the rural farm area of Pennsylvania, where a retired Preacher lives with his two children and younger brother. Mel Gibson stars as Father Graham Hess, who has lost all Faith in God ever since
53
+
54
+
55
+
56
+ X3: The Last Straw for Shawn James
57
+
58
+
59
+
60
+ Ivana Baquero is an amazing child actor. She reminds me of the sixteen year old Jennifer Connelly in "Labyrinth" twenty years ago. El Laberinto has young Ivana moving back and forth between an underworld of fairies and faun
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+ The Prestige (2006)Drama, Mystery, Thriller, 130 minutesDirected by Christopher NolanStarring Christian Bale, Hugh Jackman, Michael Caine, Rebecca Hall, Scarlett Johansson and David BowieChristopher Nolan takes chances in an industry which usually
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+
98
+
99
+
100
+
101
+
102
+
103
+
104
+
105
+
106
+
107
+ ANd himself and a German girl of some sort with a car, out of the American Embassy trap
108
+
109
+
110
+
111
+
112
+
113
+
114
+
115
+
116
+
117
+
118
+
119
+
120
+
121
+
122
+
123
+
124
+
125
+
126
+
127
+
128
+
129
+
130
+
131
+
132
+
133
+
134
+
135
+
136
+
137
+
138
+
139
+
140
+
141
+
142
+
143
+
144
+
145
+
146
+
147
+
148
+
149
+
150
+
151
+
152
+
153
+
eval/samples.test.hyp.paragraph_sentence.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,153 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+ I completely loved Battle Royale as it was an amazing and unbelievably good movie. It goes into detail about the things this movie skimps over and explores the characters on a much deeper level.
14
+
15
+
16
+
17
+
18
+
19
+
20
+
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+ "Gravity" is a life time experience that everyone must see! The acting is amazing and there is deep meaning behind it - what would you do, if you were alone in the deepest and darkest part of this entire universe, with nobody but yourself? Would you be able to
41
+
42
+
43
+
44
+
45
+
46
+
47
+ "Menace" is actually superior to "Clones"
48
+
49
+ "High Tension" is not for everyone. Even horror fans may be put off. "High Tension," is of a sicker, more brutal mold. It is more akin to "Texas Chainsaw Masacre," or "The Grudge"
50
+
51
+
52
+
53
+
54
+
55
+
56
+ X3: The Last Straw for Shawn James
57
+
58
+
59
+
60
+ Ivana Baquero is an amazing child actor. She reminds me of the sixteen year old Jennifer Connelly in "Labyrinth" twenty years ago. El Laberinto has young Ivana moving back and forth between an underworld of fairies and faun
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+ The Prestige (2006)Drama, Mystery, Thriller, 130 minutesDirected by Christopher NolanStarring Christian Bale, Hugh Jackman, Michael Caine, Rebecca Hall, Scarlett Johansson and David BowieChristopher Nolan takes chances in an industry which usually
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+
98
+
99
+
100
+
101
+
102
+
103
+
104
+
105
+
106
+
107
+ ANd himself and a German girl of some sort with a car, out of the American Embassy trap. ANd himself and a German girl of some sort with a car, out of the American Embassy trap. ANd himself and a German girl of some sort with a
108
+
109
+
110
+
111
+
112
+
113
+
114
+
115
+
116
+
117
+
118
+
119
+
120
+
121
+
122
+
123
+
124
+
125
+
126
+
127
+
128
+
129
+
130
+
131
+
132
+
133
+
134
+
135
+
136
+
137
+
138
+
139
+
140
+
141
+
142
+
143
+
144
+
145
+
146
+
147
+
148
+
149
+
150
+
151
+
152
+
153
+
eval/samples.test.hyp.sentence_answer.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,153 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+
14
+
15
+
16
+
17
+
18
+
19
+
20
+
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+
41
+
42
+
43
+
44
+
45
+
46
+
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+
98
+
99
+
100
+
101
+
102
+
103
+
104
+
105
+
106
+
107
+
108
+
109
+
110
+
111
+
112
+
113
+ "The Phantom Menace" is definetly not on par with that film, nor has it the originality of "A New Hope", but still I liked this film a lot. I actually found it better than "Return Of
114
+
115
+
116
+
117
+
118
+
119
+
120
+
121
+
122
+
123
+ FX so overwhelming that its like having spectacular fireworks let off in your face for 2 hours...
124
+
125
+
126
+
127
+
128
+
129
+
130
+
131
+
132
+
133
+
134
+
135
+
136
+
137
+
138
+
139
+
140
+
141
+
142
+
143
+
144
+
145
+
146
+
147
+
148
+
149
+
150
+
151
+
152
+
153
+
eval/samples.validation.hyp.paragraph_answer.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+
14
+
15
+
16
+
17
+
18
+ Burton’s first Batman film BATMAN has obvious Burton touches: odd and disturbing characters, dark tone, neo-noirish look, the film still manage to be generally accessible to the mass audience.
19
+
20
+
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+ American Hustle David O'Russell gives us a movie that is dazzling bringing viewers into the crime world of the 1970s
32
+
33
+
34
+
35
+
36
+
37
+
38
+ numbing.And for the record, Kill Bill Vol. 1 is not a Shaw Brothers kind of film, despite the Shaw logo which opens the film.
39
+
40
+
41
+
42
+ Oblivion is a much more complex story than is likely expected. The complexities do provide some depth to the film and force the audience to pay close attention; however, the juxtaposition between the style and the narrative is not smooth. Occasionally, the film is forced into a lul
43
+
44
+ a powerful movie, in which it's main theme centers around drug abuse & addiction, and the dangerous consequences that may follow.
45
+
46
+ a very good opener. Lots of comedic scenes and also shows the estrangement of your first few days of college nicely.#3 THE FRESHMAN - 4/5.
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+
71
+
72
+
73
+
74
+
75
+ HALLOWEEN. NIGHTMARE ON ELM STREET. The list is lengthy. Some of them introduce new characters that send goose bumps up our backs. Others tread over old material and put a fresh spin on them.
76
+
77
+
78
+
79
+ Jennifer Lawrence as Katniss Everdeen acted wonderfully. She always had an air of sadness yet responsibility. She made the tough heroine believable and relatable because her emotions were close beneath the surface despite her hard exterior. Elizabeth Banks as Effie Trinket provided much
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+ 80% of the dialogue in this movie is like this. It's like a big, dumb, obvious summary of what's going on at the moment. "Mom, I'm not a slave any more!" Mom: "All your dreams have come true"
98
+
99
+
100
+
eval/samples.validation.hyp.paragraph_sentence.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+
14
+
15
+
16
+
17
+
18
+
19
+
20
+
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+ numbing
39
+
40
+
41
+
42
+ Oblivion is a much more complex story than is likely expected. The complexities do provide some depth to the film and force the audience to pay close attention; however, the juxtaposition between the style and the narrative is not smooth. Occasionally, the film is forced into a lul
43
+
44
+ a powerful movie, in which it's main theme centers around drug abuse & addiction, and the dangerous consequences that may follow.
45
+
46
+ a very good opener. Lots of comedic scenes and also shows the estrangement of your first few days of college nicely.#3 THE FRESHMAN - 4/5.
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+ Jennifer Lawrence as Katniss Everdeen acted wonderfully. She always had an air of sadness yet responsibility. She made the tough heroine believable and relatable because her emotions were close beneath the surface despite her hard exterior. Elizabeth Banks as Effie Trinket provided much
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+ 80% of the dialogue in this movie is like this. It's like a big, dumb, obvious summary of what's going on at the moment. "Mom, I'm not a slave any more!" Mom: "All your dreams have come true"
98
+
99
+
100
+
eval/samples.validation.hyp.sentence_answer.question.asahi417_qg_subjqa.movies.txt ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+
4
+
5
+
6
+
7
+
8
+
9
+
10
+
11
+
12
+
13
+
14
+
15
+
16
+
17
+
18
+ Burton’s first Batman film BATMAN has obvious Burton touches: odd and disturbing characters, dark tone, neo-noirish look, the film still manage to be generally accessible to the mass audience.
19
+
20
+
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+
41
+
42
+
43
+
44
+
45
+
46
+
47
+
48
+
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+
58
+
59
+
60
+
61
+
62
+
63
+
64
+
65
+
66
+
67
+
68
+
69
+
70
+
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+
81
+
82
+
83
+
84
+
85
+
86
+
87
+
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+
96
+
97
+
98
+
99
+
100
+
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c76c58d196b7c6735e6598626942dfb69f3be6302fa6c2a7e319600aaa5ef12f
3
- size 242028475
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2fc8e35d6785570508d3f917501395bfa872318b3b15d8dd560157a91ee88d5
3
+ size 242030331
tokenizer_config.json CHANGED
@@ -1 +1 @@
1
- {"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 100, "additional_special_tokens": ["<extra_id_0>", "<extra_id_1>", "<extra_id_2>", "<extra_id_3>", "<extra_id_4>", "<extra_id_5>", "<extra_id_6>", "<extra_id_7>", "<extra_id_8>", "<extra_id_9>", "<extra_id_10>", "<extra_id_11>", "<extra_id_12>", "<extra_id_13>", "<extra_id_14>", "<extra_id_15>", "<extra_id_16>", "<extra_id_17>", "<extra_id_18>", "<extra_id_19>", "<extra_id_20>", "<extra_id_21>", "<extra_id_22>", "<extra_id_23>", "<extra_id_24>", "<extra_id_25>", "<extra_id_26>", "<extra_id_27>", "<extra_id_28>", "<extra_id_29>", "<extra_id_30>", "<extra_id_31>", "<extra_id_32>", "<extra_id_33>", "<extra_id_34>", "<extra_id_35>", "<extra_id_36>", "<extra_id_37>", "<extra_id_38>", "<extra_id_39>", "<extra_id_40>", "<extra_id_41>", "<extra_id_42>", "<extra_id_43>", "<extra_id_44>", "<extra_id_45>", "<extra_id_46>", "<extra_id_47>", "<extra_id_48>", "<extra_id_49>", "<extra_id_50>", "<extra_id_51>", "<extra_id_52>", "<extra_id_53>", "<extra_id_54>", "<extra_id_55>", "<extra_id_56>", "<extra_id_57>", "<extra_id_58>", "<extra_id_59>", "<extra_id_60>", "<extra_id_61>", "<extra_id_62>", "<extra_id_63>", "<extra_id_64>", "<extra_id_65>", "<extra_id_66>", "<extra_id_67>", "<extra_id_68>", "<extra_id_69>", "<extra_id_70>", "<extra_id_71>", "<extra_id_72>", "<extra_id_73>", "<extra_id_74>", "<extra_id_75>", "<extra_id_76>", "<extra_id_77>", "<extra_id_78>", "<extra_id_79>", "<extra_id_80>", "<extra_id_81>", "<extra_id_82>", "<extra_id_83>", "<extra_id_84>", "<extra_id_85>", "<extra_id_86>", "<extra_id_87>", "<extra_id_88>", "<extra_id_89>", "<extra_id_90>", "<extra_id_91>", "<extra_id_92>", "<extra_id_93>", "<extra_id_94>", "<extra_id_95>", "<extra_id_96>", "<extra_id_97>", "<extra_id_98>", "<extra_id_99>"], "model_max_length": 512, "name_or_path": "lmqg_output/qg_subjqa_vanilla/t5_small_subjqa_movies/best_model", "special_tokens_map_file": "lmqg_output/qg_subjqa_vanilla/t5_small_subjqa_movies/best_model/special_tokens_map.json", "tokenizer_class": "T5Tokenizer"}
 
1
+ {"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 100, "additional_special_tokens": ["<extra_id_0>", "<extra_id_1>", "<extra_id_2>", "<extra_id_3>", "<extra_id_4>", "<extra_id_5>", "<extra_id_6>", "<extra_id_7>", "<extra_id_8>", "<extra_id_9>", "<extra_id_10>", "<extra_id_11>", "<extra_id_12>", "<extra_id_13>", "<extra_id_14>", "<extra_id_15>", "<extra_id_16>", "<extra_id_17>", "<extra_id_18>", "<extra_id_19>", "<extra_id_20>", "<extra_id_21>", "<extra_id_22>", "<extra_id_23>", "<extra_id_24>", "<extra_id_25>", "<extra_id_26>", "<extra_id_27>", "<extra_id_28>", "<extra_id_29>", "<extra_id_30>", "<extra_id_31>", "<extra_id_32>", "<extra_id_33>", "<extra_id_34>", "<extra_id_35>", "<extra_id_36>", "<extra_id_37>", "<extra_id_38>", "<extra_id_39>", "<extra_id_40>", "<extra_id_41>", "<extra_id_42>", "<extra_id_43>", "<extra_id_44>", "<extra_id_45>", "<extra_id_46>", "<extra_id_47>", "<extra_id_48>", "<extra_id_49>", "<extra_id_50>", "<extra_id_51>", "<extra_id_52>", "<extra_id_53>", "<extra_id_54>", "<extra_id_55>", "<extra_id_56>", "<extra_id_57>", "<extra_id_58>", "<extra_id_59>", "<extra_id_60>", "<extra_id_61>", "<extra_id_62>", "<extra_id_63>", "<extra_id_64>", "<extra_id_65>", "<extra_id_66>", "<extra_id_67>", "<extra_id_68>", "<extra_id_69>", "<extra_id_70>", "<extra_id_71>", "<extra_id_72>", "<extra_id_73>", "<extra_id_74>", "<extra_id_75>", "<extra_id_76>", "<extra_id_77>", "<extra_id_78>", "<extra_id_79>", "<extra_id_80>", "<extra_id_81>", "<extra_id_82>", "<extra_id_83>", "<extra_id_84>", "<extra_id_85>", "<extra_id_86>", "<extra_id_87>", "<extra_id_88>", "<extra_id_89>", "<extra_id_90>", "<extra_id_91>", "<extra_id_92>", "<extra_id_93>", "<extra_id_94>", "<extra_id_95>", "<extra_id_96>", "<extra_id_97>", "<extra_id_98>", "<extra_id_99>"], "model_max_length": 512, "name_or_path": "t5-small", "tokenizer_class": "T5Tokenizer"}
trainer_config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dataset_path": "asahi417/qg_subjqa", "dataset_name": "movies", "input_types": ["paragraph_answer"], "output_types": ["question"], "prefix_types": ["qg"], "model": "t5-small", "max_length": 512, "max_length_output": 32, "epoch": 1, "batch": 32, "lr": 0.0001, "fp16": false, "random_seed": 1, "gradient_accumulation_steps": 2, "label_smoothing": 0.15}