File size: 40,711 Bytes
cf6f3df
e9c7f6d
 
 
 
 
 
 
 
 
cf6f3df
 
e9c7f6d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
---
license: other
base_model: peldrak/segformer-b3-ade-512-512-finetuned-coastTrain
tags:
- vision
- image-segmentation
- generated_from_trainer
model-index:
- name: segformer-b3-ade-512-512-finetuned-coastTrain-grCoastline
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# segformer-b3-ade-512-512-finetuned-coastTrain-grCoastline

This model is a fine-tuned version of [peldrak/segformer-b3-ade-512-512-finetuned-coastTrain](https://huggingface.co/peldrak/segformer-b3-ade-512-512-finetuned-coastTrain) on the peldrak/grCoastline_512 dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2531
- Mean Iou: 0.7677
- Mean Accuracy: 0.8502
- Overall Accuracy: 0.9340
- Accuracy Water: 0.9810
- Accuracy Whitewater: 0.5654
- Accuracy Sediment: 0.8995
- Accuracy Other Natural Terrain: 0.7891
- Accuracy Vegetation: 0.8969
- Accuracy Development: 0.8221
- Accuracy Unknown: 0.9974
- Iou Water: 0.9535
- Iou Whitewater: 0.4217
- Iou Sediment: 0.8288
- Iou Other Natural Terrain: 0.6339
- Iou Vegetation: 0.8151
- Iou Development: 0.7244
- Iou Unknown: 0.9964

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 6e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 25

### Training results

| Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Water | Accuracy Whitewater | Accuracy Sediment | Accuracy Other Natural Terrain | Accuracy Vegetation | Accuracy Development | Accuracy Unknown | Iou Water | Iou Whitewater | Iou Sediment | Iou Other Natural Terrain | Iou Vegetation | Iou Development | Iou Unknown |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:--------------:|:-------------------:|:-----------------:|:------------------------------:|:-------------------:|:--------------------:|:----------------:|:---------:|:--------------:|:------------:|:-------------------------:|:--------------:|:---------------:|:-----------:|
| 1.2485        | 0.24  | 20   | 0.4622          | 0.5668   | 0.6676        | 0.8536           | 0.9523         | 0.2722              | 0.9426            | 0.0                            | 0.9170              | 0.5995               | 0.9897           | 0.9004    | 0.2295         | 0.6418       | 0.0                       | 0.6785         | 0.5280          | 0.9890      |
| 0.4894        | 0.49  | 40   | 0.3645          | 0.6103   | 0.7022        | 0.8775           | 0.9738         | 0.2414              | 0.9207            | 0.1627                         | 0.9260              | 0.6974               | 0.9932           | 0.9318    | 0.2117         | 0.6742       | 0.1589                    | 0.7242         | 0.5807          | 0.9904      |
| 0.4931        | 0.73  | 60   | 0.3257          | 0.6374   | 0.7168        | 0.8940           | 0.9790         | 0.1616              | 0.8723            | 0.2837                         | 0.9522              | 0.7731               | 0.9955           | 0.9359    | 0.1529         | 0.7241       | 0.2724                    | 0.7487         | 0.6360          | 0.9920      |
| 0.1766        | 0.98  | 80   | 0.2769          | 0.6970   | 0.7755        | 0.9123           | 0.9726         | 0.3993              | 0.9157            | 0.6302                         | 0.9080              | 0.6049               | 0.9976           | 0.9443    | 0.3230         | 0.7710       | 0.5134                    | 0.7866         | 0.5485          | 0.9921      |
| 0.6156        | 1.22  | 100  | 0.2895          | 0.6691   | 0.7372        | 0.9115           | 0.9696         | 0.1418              | 0.9271            | 0.5343                         | 0.9293              | 0.6601               | 0.9981           | 0.9435    | 0.1371         | 0.7252       | 0.4855                    | 0.7931         | 0.6066          | 0.9929      |
| 0.4116        | 1.46  | 120  | 0.2715          | 0.7026   | 0.7775        | 0.9135           | 0.9521         | 0.2680              | 0.9245            | 0.6565                         | 0.8937              | 0.7554               | 0.9922           | 0.9225    | 0.2401         | 0.7913       | 0.5413                    | 0.7691         | 0.6637          | 0.9905      |
| 0.261         | 1.71  | 140  | 0.2459          | 0.7193   | 0.8036        | 0.9186           | 0.9770         | 0.3963              | 0.8738            | 0.6637                         | 0.8956              | 0.8211               | 0.9973           | 0.9387    | 0.3074         | 0.7904       | 0.5513                    | 0.7829         | 0.6708          | 0.9933      |
| 0.2603        | 1.95  | 160  | 0.2538          | 0.7189   | 0.7987        | 0.9159           | 0.9752         | 0.3829              | 0.9032            | 0.7231                         | 0.8610              | 0.7478               | 0.9975           | 0.9288    | 0.3082         | 0.7996       | 0.5457                    | 0.7713         | 0.6843          | 0.9943      |
| 0.3266        | 2.2   | 180  | 0.2468          | 0.7232   | 0.8227        | 0.9118           | 0.9734         | 0.4478              | 0.9127            | 0.8202                         | 0.7856              | 0.8226               | 0.9967           | 0.9337    | 0.3322         | 0.8097       | 0.5550                    | 0.7399         | 0.6988          | 0.9936      |
| 0.1754        | 2.44  | 200  | 0.2850          | 0.7269   | 0.8031        | 0.9209           | 0.9764         | 0.3942              | 0.8998            | 0.6822                         | 0.8980              | 0.7752               | 0.9957           | 0.9300    | 0.3147         | 0.8116       | 0.5579                    | 0.7858         | 0.6944          | 0.9937      |
| 0.1391        | 2.68  | 220  | 0.2787          | 0.7316   | 0.8041        | 0.9264           | 0.9678         | 0.4164              | 0.9050            | 0.6179                         | 0.9497              | 0.7737               | 0.9982           | 0.9474    | 0.3268         | 0.8058       | 0.5714                    | 0.8035         | 0.6720          | 0.9946      |
| 0.1294        | 2.93  | 240  | 0.2869          | 0.7176   | 0.8170        | 0.9100           | 0.9752         | 0.4576              | 0.9232            | 0.9012                         | 0.7608              | 0.7034               | 0.9976           | 0.9455    | 0.3430         | 0.7795       | 0.5795                    | 0.7315         | 0.6496          | 0.9948      |
| 0.3478        | 3.17  | 260  | 0.2799          | 0.7348   | 0.8127        | 0.9238           | 0.9792         | 0.4352              | 0.8693            | 0.6888                         | 0.9183              | 0.8048               | 0.9935           | 0.9461    | 0.3369         | 0.8102       | 0.5753                    | 0.7904         | 0.6923          | 0.9926      |
| 0.1053        | 3.41  | 280  | 0.2963          | 0.7227   | 0.7986        | 0.9234           | 0.9837         | 0.4045              | 0.8366            | 0.5931                         | 0.9610              | 0.8150               | 0.9966           | 0.9409    | 0.3144         | 0.7928       | 0.5578                    | 0.8011         | 0.6577          | 0.9939      |
| 0.3786        | 3.66  | 300  | 0.2416          | 0.7282   | 0.8228        | 0.9137           | 0.9689         | 0.4874              | 0.9182            | 0.8059                         | 0.8081              | 0.7729               | 0.9984           | 0.9455    | 0.3525         | 0.8143       | 0.5534                    | 0.7431         | 0.6944          | 0.9937      |
| 0.3046        | 3.9   | 320  | 0.2374          | 0.7406   | 0.8148        | 0.9279           | 0.9820         | 0.3912              | 0.8961            | 0.7267                         | 0.8996              | 0.8111               | 0.9966           | 0.9438    | 0.3180         | 0.8193       | 0.5968                    | 0.8014         | 0.7111          | 0.9940      |
| 0.1098        | 4.15  | 340  | 0.2479          | 0.7278   | 0.8012        | 0.9258           | 0.9816         | 0.2957              | 0.8885            | 0.7045                         | 0.8956              | 0.8445               | 0.9977           | 0.9488    | 0.2557         | 0.8194       | 0.5799                    | 0.7923         | 0.7036          | 0.9948      |
| 0.1654        | 4.39  | 360  | 0.2757          | 0.7484   | 0.8304        | 0.9290           | 0.9751         | 0.4714              | 0.8718            | 0.7298                         | 0.9119              | 0.8562               | 0.9965           | 0.9508    | 0.3615         | 0.8222       | 0.6089                    | 0.8021         | 0.6989          | 0.9944      |
| 0.1079        | 4.63  | 380  | 0.2821          | 0.7171   | 0.8052        | 0.9095           | 0.9789         | 0.3882              | 0.9159            | 0.8147                         | 0.7865              | 0.7563               | 0.9959           | 0.9358    | 0.3245         | 0.7857       | 0.5545                    | 0.7318         | 0.6930          | 0.9942      |
| 0.1849        | 4.88  | 400  | 0.2637          | 0.7398   | 0.8191        | 0.9250           | 0.9773         | 0.4225              | 0.8793            | 0.6972                         | 0.9008              | 0.8600               | 0.9967           | 0.9472    | 0.3367         | 0.8212       | 0.5715                    | 0.7886         | 0.7189          | 0.9946      |
| 0.1643        | 5.12  | 420  | 0.3350          | 0.7221   | 0.7861        | 0.9244           | 0.9782         | 0.3296              | 0.9235            | 0.5713                         | 0.9536              | 0.7526               | 0.9939           | 0.9458    | 0.2901         | 0.7973       | 0.5429                    | 0.8014         | 0.6843          | 0.9927      |
| 0.1595        | 5.37  | 440  | 0.2582          | 0.7366   | 0.8255        | 0.9196           | 0.9769         | 0.4560              | 0.8771            | 0.7617                         | 0.8518              | 0.8582               | 0.9965           | 0.9464    | 0.3440         | 0.8231       | 0.5601                    | 0.7647         | 0.7237          | 0.9946      |
| 0.3171        | 5.61  | 460  | 0.2579          | 0.7433   | 0.8317        | 0.9261           | 0.9681         | 0.5031              | 0.9291            | 0.7243                         | 0.8871              | 0.8137               | 0.9965           | 0.9506    | 0.3517         | 0.8177       | 0.5841                    | 0.7930         | 0.7112          | 0.9950      |
| 0.2955        | 5.85  | 480  | 0.2975          | 0.7288   | 0.8072        | 0.9226           | 0.9758         | 0.4648              | 0.9149            | 0.6695                         | 0.9146              | 0.7139               | 0.9967           | 0.9498    | 0.3452         | 0.7954       | 0.5683                    | 0.7901         | 0.6579          | 0.9948      |
| 0.0857        | 6.1   | 500  | 0.2707          | 0.7307   | 0.8236        | 0.9194           | 0.9792         | 0.5026              | 0.9181            | 0.7281                         | 0.8591              | 0.7821               | 0.9957           | 0.9512    | 0.3523         | 0.8017       | 0.5624                    | 0.7724         | 0.6806          | 0.9944      |
| 0.109         | 6.34  | 520  | 0.2674          | 0.7488   | 0.8316        | 0.9312           | 0.9738         | 0.5295              | 0.9087            | 0.6734                         | 0.9363              | 0.8021               | 0.9977           | 0.9524    | 0.3633         | 0.8258       | 0.5984                    | 0.8127         | 0.6945          | 0.9948      |
| 0.0593        | 6.59  | 540  | 0.2806          | 0.7376   | 0.8273        | 0.9204           | 0.9756         | 0.4729              | 0.9084            | 0.8021                         | 0.8373              | 0.7988               | 0.9962           | 0.9491    | 0.3463         | 0.8215       | 0.5723                    | 0.7676         | 0.7121          | 0.9947      |
| 0.099         | 6.83  | 560  | 0.2874          | 0.7421   | 0.8331        | 0.9237           | 0.9626         | 0.4619              | 0.9334            | 0.7321                         | 0.8586              | 0.8852               | 0.9982           | 0.9486    | 0.3640         | 0.8238       | 0.5798                    | 0.7802         | 0.7024          | 0.9957      |
| 0.0665        | 7.07  | 580  | 0.2642          | 0.7462   | 0.8177        | 0.9291           | 0.9780         | 0.5176              | 0.8784            | 0.6685                         | 0.9544              | 0.7287               | 0.9983           | 0.9493    | 0.3841         | 0.8119       | 0.5980                    | 0.8057         | 0.6788          | 0.9953      |
| 0.1285        | 7.32  | 600  | 0.2347          | 0.7495   | 0.8500        | 0.9236           | 0.9799         | 0.5332              | 0.8905            | 0.8549                         | 0.8181              | 0.8766               | 0.9968           | 0.9483    | 0.3906         | 0.8197       | 0.6088                    | 0.7745         | 0.7102          | 0.9946      |
| 0.1299        | 7.56  | 620  | 0.2630          | 0.7506   | 0.8232        | 0.9311           | 0.9751         | 0.4683              | 0.9292            | 0.6923                         | 0.9228              | 0.7773               | 0.9976           | 0.9489    | 0.3754         | 0.8070       | 0.6084                    | 0.8172         | 0.7028          | 0.9948      |
| 0.0504        | 7.8   | 640  | 0.2964          | 0.7358   | 0.8238        | 0.9172           | 0.9790         | 0.4852              | 0.9113            | 0.7586                         | 0.8335              | 0.8016               | 0.9976           | 0.9481    | 0.3776         | 0.8139       | 0.5465                    | 0.7591         | 0.7105          | 0.9953      |
| 0.0795        | 8.05  | 660  | 0.2654          | 0.7443   | 0.8427        | 0.9198           | 0.9764         | 0.5517              | 0.9103            | 0.8286                         | 0.8150              | 0.8193               | 0.9978           | 0.9506    | 0.3918         | 0.8173       | 0.5768                    | 0.7619         | 0.7163          | 0.9953      |
| 0.0614        | 8.29  | 680  | 0.2904          | 0.7452   | 0.8165        | 0.9303           | 0.9763         | 0.4578              | 0.8990            | 0.6315                         | 0.9536              | 0.8003               | 0.9973           | 0.9496    | 0.3518         | 0.8172       | 0.5805                    | 0.8118         | 0.7105          | 0.9951      |
| 0.1476        | 8.54  | 700  | 0.2814          | 0.7498   | 0.8324        | 0.9276           | 0.9785         | 0.5138              | 0.9093            | 0.7335                         | 0.8910              | 0.8028               | 0.9979           | 0.9489    | 0.3821         | 0.8168       | 0.5909                    | 0.7981         | 0.7165          | 0.9956      |
| 0.0669        | 8.78  | 720  | 0.2774          | 0.7483   | 0.8374        | 0.9250           | 0.9741         | 0.5476              | 0.9217            | 0.7477                         | 0.8710              | 0.8020               | 0.9980           | 0.9313    | 0.3931         | 0.8220       | 0.5795                    | 0.7975         | 0.7196          | 0.9953      |
| 0.142         | 9.02  | 740  | 0.2362          | 0.7624   | 0.8555        | 0.9327           | 0.9784         | 0.6280              | 0.8959            | 0.7341                         | 0.9111              | 0.8425               | 0.9983           | 0.9516    | 0.4124         | 0.8211       | 0.6182                    | 0.8158         | 0.7224          | 0.9952      |
| 0.1258        | 9.27  | 760  | 0.2666          | 0.7597   | 0.8357        | 0.9329           | 0.9762         | 0.4810              | 0.9161            | 0.7439                         | 0.9043              | 0.8311               | 0.9975           | 0.9554    | 0.3793         | 0.8262       | 0.6165                    | 0.8111         | 0.7338          | 0.9954      |
| 0.1541        | 9.51  | 780  | 0.2484          | 0.7630   | 0.8423        | 0.9334           | 0.9797         | 0.5260              | 0.9084            | 0.7548                         | 0.9043              | 0.8259               | 0.9973           | 0.9543    | 0.3991         | 0.8244       | 0.6228                    | 0.8147         | 0.7307          | 0.9953      |
| 0.1689        | 9.76  | 800  | 0.2151          | 0.7710   | 0.8619        | 0.9341           | 0.9747         | 0.6199              | 0.9143            | 0.8381                         | 0.8751              | 0.8127               | 0.9985           | 0.9553    | 0.4257         | 0.8333       | 0.6421                    | 0.8117         | 0.7341          | 0.9952      |
| 0.0931        | 10.0  | 820  | 0.2422          | 0.7506   | 0.8239        | 0.9325           | 0.9783         | 0.4062              | 0.9162            | 0.7139                         | 0.9116              | 0.8443               | 0.9969           | 0.9528    | 0.3324         | 0.8236       | 0.6103                    | 0.8137         | 0.7265          | 0.9953      |
| 0.1109        | 10.24 | 840  | 0.2336          | 0.7522   | 0.8271        | 0.9321           | 0.9774         | 0.4327              | 0.9191            | 0.7334                         | 0.9027              | 0.8263               | 0.9981           | 0.9530    | 0.3442         | 0.8194       | 0.6136                    | 0.8110         | 0.7283          | 0.9960      |
| 0.0561        | 10.49 | 860  | 0.2991          | 0.7572   | 0.8445        | 0.9284           | 0.9743         | 0.5846              | 0.9094            | 0.7471                         | 0.8933              | 0.8066               | 0.9966           | 0.9514    | 0.4134         | 0.8200       | 0.5952                    | 0.7985         | 0.7261          | 0.9955      |
| 0.0701        | 10.73 | 880  | 0.2647          | 0.7554   | 0.8481        | 0.9286           | 0.9774         | 0.6203              | 0.9098            | 0.7382                         | 0.8929              | 0.7991               | 0.9990           | 0.9534    | 0.4082         | 0.8163       | 0.5967                    | 0.8006         | 0.7175          | 0.9951      |
| 0.1528        | 10.98 | 900  | 0.2988          | 0.7626   | 0.8573        | 0.9310           | 0.9713         | 0.6322              | 0.9123            | 0.7464                         | 0.8980              | 0.8442               | 0.9969           | 0.9548    | 0.4138         | 0.8368       | 0.6036                    | 0.8022         | 0.7317          | 0.9956      |
| 0.0514        | 11.22 | 920  | 0.2537          | 0.7528   | 0.8314        | 0.9302           | 0.9749         | 0.4371              | 0.9270            | 0.8595                         | 0.8548              | 0.7694               | 0.9970           | 0.9527    | 0.3550         | 0.8248       | 0.6354                    | 0.8004         | 0.7063          | 0.9951      |
| 0.0959        | 11.46 | 940  | 0.2897          | 0.7458   | 0.8233        | 0.9279           | 0.9835         | 0.4569              | 0.8963            | 0.7962                         | 0.8808              | 0.7523               | 0.9974           | 0.9499    | 0.3569         | 0.8096       | 0.6191                    | 0.7974         | 0.6918          | 0.9958      |
| 0.1997        | 11.71 | 960  | 0.3142          | 0.7512   | 0.8251        | 0.9295           | 0.9745         | 0.5071              | 0.9290            | 0.6819                         | 0.9251              | 0.7615               | 0.9964           | 0.9537    | 0.3946         | 0.8181       | 0.5902                    | 0.8052         | 0.7017          | 0.9953      |
| 0.0724        | 11.95 | 980  | 0.2794          | 0.7525   | 0.8318        | 0.9290           | 0.9822         | 0.4696              | 0.9038            | 0.7310                         | 0.8897              | 0.8489               | 0.9973           | 0.9557    | 0.3727         | 0.8276       | 0.5890                    | 0.7970         | 0.7299          | 0.9957      |
| 0.0668        | 12.2  | 1000 | 0.2911          | 0.7447   | 0.8175        | 0.9321           | 0.9844         | 0.3514              | 0.9008            | 0.7032                         | 0.9105              | 0.8749               | 0.9970           | 0.9500    | 0.2946         | 0.8281       | 0.6032                    | 0.8126         | 0.7290          | 0.9953      |
| 0.0574        | 12.44 | 1020 | 0.2565          | 0.7619   | 0.8407        | 0.9330           | 0.9797         | 0.5386              | 0.9173            | 0.7298                         | 0.9096              | 0.8120               | 0.9982           | 0.9545    | 0.3984         | 0.8306       | 0.6073                    | 0.8131         | 0.7338          | 0.9956      |
| 0.0696        | 12.68 | 1040 | 0.2657          | 0.7595   | 0.8366        | 0.9339           | 0.9808         | 0.4966              | 0.9101            | 0.7057                         | 0.9197              | 0.8458               | 0.9979           | 0.9520    | 0.3767         | 0.8308       | 0.6096                    | 0.8173         | 0.7345          | 0.9956      |
| 0.3274        | 12.93 | 1060 | 0.2586          | 0.7465   | 0.8222        | 0.9297           | 0.9793         | 0.3965              | 0.9265            | 0.7214                         | 0.8877              | 0.8457               | 0.9983           | 0.9539    | 0.3307         | 0.8268       | 0.5935                    | 0.8017         | 0.7235          | 0.9953      |
| 0.0817        | 13.17 | 1080 | 0.2783          | 0.7569   | 0.8496        | 0.9265           | 0.9772         | 0.5303              | 0.9224            | 0.8566                         | 0.8235              | 0.8395               | 0.9975           | 0.9548    | 0.4030         | 0.8286       | 0.6126                    | 0.7783         | 0.7250          | 0.9963      |
| 0.0787        | 13.41 | 1100 | 0.2517          | 0.7489   | 0.8218        | 0.9294           | 0.9802         | 0.4487              | 0.9232            | 0.7094                         | 0.9058              | 0.7883               | 0.9968           | 0.9527    | 0.3654         | 0.8222       | 0.5939                    | 0.8027         | 0.7105          | 0.9951      |
| 0.1024        | 13.66 | 1120 | 0.2590          | 0.7569   | 0.8290        | 0.9327           | 0.9812         | 0.4873              | 0.9080            | 0.7041                         | 0.9259              | 0.7986               | 0.9977           | 0.9543    | 0.3833         | 0.8266       | 0.6094                    | 0.8118         | 0.7171          | 0.9960      |
| 0.0888        | 13.9  | 1140 | 0.2647          | 0.7489   | 0.8352        | 0.9228           | 0.9812         | 0.5251              | 0.9169            | 0.7856                         | 0.8447              | 0.7955               | 0.9973           | 0.9491    | 0.4024         | 0.8276       | 0.5748                    | 0.7738         | 0.7184          | 0.9958      |
| 0.0946        | 14.15 | 1160 | 0.2453          | 0.7571   | 0.8370        | 0.9298           | 0.9823         | 0.5318              | 0.9002            | 0.7619                         | 0.8942              | 0.7913               | 0.9973           | 0.9531    | 0.4046         | 0.8240       | 0.6086                    | 0.8008         | 0.7125          | 0.9960      |
| 0.0529        | 14.39 | 1180 | 0.2514          | 0.7596   | 0.8460        | 0.9298           | 0.9808         | 0.5804              | 0.9014            | 0.7354                         | 0.8979              | 0.8289               | 0.9970           | 0.9559    | 0.4197         | 0.8307       | 0.5978                    | 0.7990         | 0.7183          | 0.9958      |
| 0.0495        | 14.63 | 1200 | 0.2323          | 0.7634   | 0.8491        | 0.9324           | 0.9790         | 0.5831              | 0.9267            | 0.7848                         | 0.8862              | 0.7861               | 0.9977           | 0.9550    | 0.4175         | 0.8280       | 0.6217                    | 0.8103         | 0.7151          | 0.9962      |
| 0.0401        | 14.88 | 1220 | 0.2248          | 0.7677   | 0.8467        | 0.9366           | 0.9796         | 0.5337              | 0.9256            | 0.8125                         | 0.8943              | 0.7834               | 0.9981           | 0.9524    | 0.4037         | 0.8250       | 0.6561                    | 0.8282         | 0.7126          | 0.9961      |
| 0.053         | 15.12 | 1240 | 0.2280          | 0.7701   | 0.8541        | 0.9362           | 0.9805         | 0.5488              | 0.9155            | 0.8259                         | 0.8830              | 0.8280               | 0.9974           | 0.9542    | 0.4107         | 0.8259       | 0.6577                    | 0.8224         | 0.7233          | 0.9961      |
| 0.0764        | 15.37 | 1260 | 0.2350          | 0.7741   | 0.8577        | 0.9370           | 0.9777         | 0.5690              | 0.9145            | 0.8514                         | 0.8825              | 0.8119               | 0.9972           | 0.9574    | 0.4265         | 0.8296       | 0.6666                    | 0.8216         | 0.7212          | 0.9962      |
| 0.0568        | 15.61 | 1280 | 0.2420          | 0.7629   | 0.8407        | 0.9343           | 0.9813         | 0.5093              | 0.9057            | 0.8360                         | 0.8871              | 0.7680               | 0.9973           | 0.9560    | 0.3937         | 0.8246       | 0.6536                    | 0.8142         | 0.7025          | 0.9960      |
| 0.1199        | 15.85 | 1300 | 0.2545          | 0.7620   | 0.8463        | 0.9321           | 0.9752         | 0.5904              | 0.9180            | 0.7196                         | 0.9135              | 0.8090               | 0.9981           | 0.9557    | 0.4209         | 0.8276       | 0.6064                    | 0.8098         | 0.7171          | 0.9964      |
| 0.7094        | 16.1  | 1320 | 0.2446          | 0.7584   | 0.8409        | 0.9314           | 0.9790         | 0.5580              | 0.9151            | 0.7301                         | 0.9070              | 0.7993               | 0.9979           | 0.9542    | 0.4042         | 0.8218       | 0.6091                    | 0.8088         | 0.7145          | 0.9963      |
| 0.0321        | 16.34 | 1340 | 0.2652          | 0.7585   | 0.8329        | 0.9340           | 0.9787         | 0.5076              | 0.9089            | 0.6924                         | 0.9365              | 0.8091               | 0.9974           | 0.9538    | 0.3925         | 0.8214       | 0.6173                    | 0.8211         | 0.7075          | 0.9962      |
| 0.1328        | 16.59 | 1360 | 0.2322          | 0.7587   | 0.8403        | 0.9327           | 0.9805         | 0.5174              | 0.9092            | 0.7077                         | 0.9123              | 0.8570               | 0.9977           | 0.9558    | 0.3966         | 0.8276       | 0.6071                    | 0.8146         | 0.7132          | 0.9959      |
| 0.0637        | 16.83 | 1380 | 0.2331          | 0.7615   | 0.8441        | 0.9322           | 0.9831         | 0.5529              | 0.8983            | 0.7412                         | 0.9048              | 0.8305               | 0.9976           | 0.9530    | 0.4111         | 0.8243       | 0.6155                    | 0.8104         | 0.7201          | 0.9961      |
| 0.3028        | 17.07 | 1400 | 0.2446          | 0.7572   | 0.8367        | 0.9312           | 0.9804         | 0.5135              | 0.9061            | 0.7279                         | 0.9044              | 0.8263               | 0.9981           | 0.9548    | 0.3970         | 0.8212       | 0.6048                    | 0.8084         | 0.7181          | 0.9962      |
| 0.0479        | 17.32 | 1420 | 0.2556          | 0.7609   | 0.8506        | 0.9295           | 0.9778         | 0.6127              | 0.9095            | 0.7802                         | 0.8835              | 0.7929               | 0.9974           | 0.9556    | 0.4318         | 0.8241       | 0.6105                    | 0.7988         | 0.7095          | 0.9963      |
| 0.0645        | 17.56 | 1440 | 0.2530          | 0.7587   | 0.8480        | 0.9283           | 0.9769         | 0.5933              | 0.9080            | 0.7729                         | 0.8775              | 0.8091               | 0.9985           | 0.9543    | 0.4244         | 0.8268       | 0.5993                    | 0.7945         | 0.7155          | 0.9962      |
| 0.0513        | 17.8  | 1460 | 0.2451          | 0.7598   | 0.8467        | 0.9306           | 0.9794         | 0.5549              | 0.9064            | 0.7567                         | 0.8863              | 0.8448               | 0.9985           | 0.9547    | 0.4093         | 0.8259       | 0.6076                    | 0.8039         | 0.7214          | 0.9961      |
| 0.0387        | 18.05 | 1480 | 0.2374          | 0.7625   | 0.8446        | 0.9344           | 0.9810         | 0.5392              | 0.9007            | 0.7115                         | 0.9214              | 0.8609               | 0.9975           | 0.9539    | 0.4025         | 0.8249       | 0.6196                    | 0.8218         | 0.7193          | 0.9958      |
| 0.0903        | 18.29 | 1500 | 0.2353          | 0.7662   | 0.8468        | 0.9351           | 0.9820         | 0.5342              | 0.9097            | 0.8100                         | 0.8918              | 0.8030               | 0.9971           | 0.9549    | 0.4053         | 0.8261       | 0.6487                    | 0.8190         | 0.7130          | 0.9961      |
| 0.0832        | 18.54 | 1520 | 0.2372          | 0.7677   | 0.8428        | 0.9375           | 0.9807         | 0.5172              | 0.9098            | 0.7757                         | 0.9184              | 0.8007               | 0.9970           | 0.9563    | 0.3981         | 0.8264       | 0.6574                    | 0.8284         | 0.7113          | 0.9961      |
| 0.0601        | 18.78 | 1540 | 0.2473          | 0.7741   | 0.8607        | 0.9366           | 0.9771         | 0.6169              | 0.9135            | 0.8532                         | 0.8866              | 0.7798               | 0.9976           | 0.9559    | 0.4365         | 0.8295       | 0.6630                    | 0.8221         | 0.7154          | 0.9965      |
| 0.0516        | 19.02 | 1560 | 0.2363          | 0.7731   | 0.8556        | 0.9369           | 0.9792         | 0.5591              | 0.9075            | 0.8329                         | 0.8883              | 0.8243               | 0.9981           | 0.9563    | 0.4189         | 0.8305       | 0.6623                    | 0.8215         | 0.7256          | 0.9964      |
| 0.0782        | 19.27 | 1580 | 0.2454          | 0.7651   | 0.8426        | 0.9341           | 0.9813         | 0.5266              | 0.9008            | 0.7847                         | 0.9005              | 0.8059               | 0.9981           | 0.9543    | 0.4057         | 0.8280       | 0.6356                    | 0.8141         | 0.7217          | 0.9961      |
| 0.0221        | 19.51 | 1600 | 0.2540          | 0.7660   | 0.8474        | 0.9333           | 0.9785         | 0.5946              | 0.9085            | 0.7579                         | 0.9117              | 0.7828               | 0.9976           | 0.9543    | 0.4320         | 0.8265       | 0.6259                    | 0.8134         | 0.7131          | 0.9964      |
| 0.0283        | 19.76 | 1620 | 0.2623          | 0.7662   | 0.8588        | 0.9320           | 0.9750         | 0.6488              | 0.9141            | 0.7503                         | 0.8988              | 0.8266               | 0.9981           | 0.9549    | 0.4395         | 0.8271       | 0.6123                    | 0.8092         | 0.7240          | 0.9964      |
| 0.1029        | 20.0  | 1640 | 0.2747          | 0.7633   | 0.8522        | 0.9299           | 0.9767         | 0.6031              | 0.9118            | 0.7738                         | 0.8809              | 0.8213               | 0.9981           | 0.9539    | 0.4336         | 0.8317       | 0.6053                    | 0.7991         | 0.7235          | 0.9962      |
| 0.0731        | 20.24 | 1660 | 0.2650          | 0.7621   | 0.8529        | 0.9294           | 0.9794         | 0.6019              | 0.9106            | 0.7555                         | 0.8790              | 0.8453               | 0.9983           | 0.9552    | 0.4310         | 0.8288       | 0.5977                    | 0.7971         | 0.7288          | 0.9963      |
| 0.2587        | 20.49 | 1680 | 0.2767          | 0.7602   | 0.8430        | 0.9311           | 0.9794         | 0.5600              | 0.9158            | 0.7217                         | 0.9023              | 0.8234               | 0.9985           | 0.9552    | 0.4160         | 0.8239       | 0.5994                    | 0.8073         | 0.7237          | 0.9961      |
| 0.1071        | 20.73 | 1700 | 0.2826          | 0.7607   | 0.8443        | 0.9311           | 0.9805         | 0.5820              | 0.9125            | 0.7122                         | 0.9091              | 0.8156               | 0.9980           | 0.9548    | 0.4239         | 0.8225       | 0.5976                    | 0.8080         | 0.7220          | 0.9963      |
| 0.0323        | 20.98 | 1720 | 0.2620          | 0.7621   | 0.8522        | 0.9293           | 0.9801         | 0.6139              | 0.9065            | 0.7633                         | 0.8829              | 0.8215               | 0.9975           | 0.9551    | 0.4342         | 0.8296       | 0.5996                    | 0.7968         | 0.7231          | 0.9963      |
| 0.1072        | 21.22 | 1740 | 0.2592          | 0.7614   | 0.8426        | 0.9315           | 0.9824         | 0.5483              | 0.9094            | 0.7402                         | 0.8997              | 0.8211               | 0.9974           | 0.9546    | 0.4149         | 0.8257       | 0.6074                    | 0.8078         | 0.7230          | 0.9961      |
| 0.0732        | 21.46 | 1760 | 0.2598          | 0.7654   | 0.8497        | 0.9327           | 0.9795         | 0.5819              | 0.9130            | 0.7528                         | 0.8994              | 0.8240               | 0.9976           | 0.9557    | 0.4265         | 0.8275       | 0.6163                    | 0.8106         | 0.7248          | 0.9963      |
| 0.0603        | 21.71 | 1780 | 0.2581          | 0.7650   | 0.8503        | 0.9320           | 0.9790         | 0.5874              | 0.9130            | 0.7452                         | 0.8984              | 0.8315               | 0.9974           | 0.9556    | 0.4282         | 0.8302       | 0.6095                    | 0.8070         | 0.7280          | 0.9963      |
| 0.0548        | 21.95 | 1800 | 0.2520          | 0.7649   | 0.8598        | 0.9300           | 0.9747         | 0.6344              | 0.9218            | 0.7885                         | 0.8683              | 0.8322               | 0.9988           | 0.9560    | 0.4352         | 0.8339       | 0.6082                    | 0.7956         | 0.7291          | 0.9963      |
| 0.0503        | 22.2  | 1820 | 0.2521          | 0.7657   | 0.8528        | 0.9317           | 0.9799         | 0.6030              | 0.9077            | 0.7726                         | 0.8890              | 0.8193               | 0.9983           | 0.9558    | 0.4312         | 0.8324       | 0.6150                    | 0.8034         | 0.7257          | 0.9964      |
| 0.0356        | 22.44 | 1840 | 0.2491          | 0.7669   | 0.8551        | 0.9328           | 0.9783         | 0.6119              | 0.9086            | 0.7470                         | 0.9004              | 0.8412               | 0.9983           | 0.9568    | 0.4338         | 0.8310       | 0.6140                    | 0.8091         | 0.7271          | 0.9966      |
| 0.0381        | 22.68 | 1860 | 0.2660          | 0.7644   | 0.8458        | 0.9330           | 0.9805         | 0.5651              | 0.9095            | 0.7344                         | 0.9094              | 0.8242               | 0.9973           | 0.9559    | 0.4213         | 0.8289       | 0.6129                    | 0.8116         | 0.7240          | 0.9964      |
| 0.0671        | 22.93 | 1880 | 0.2633          | 0.7664   | 0.8517        | 0.9332           | 0.9787         | 0.5970              | 0.9067            | 0.7371                         | 0.9083              | 0.8360               | 0.9982           | 0.9559    | 0.4307         | 0.8286       | 0.6140                    | 0.8129         | 0.7261          | 0.9966      |
| 0.1123        | 23.17 | 1900 | 0.2462          | 0.7659   | 0.8489        | 0.9337           | 0.9790         | 0.5848              | 0.9088            | 0.7332                         | 0.9121              | 0.8253               | 0.9987           | 0.9556    | 0.4257         | 0.8275       | 0.6161                    | 0.8154         | 0.7251          | 0.9963      |
| 0.0476        | 23.41 | 1920 | 0.2498          | 0.7665   | 0.8490        | 0.9336           | 0.9789         | 0.5651              | 0.9133            | 0.7813                         | 0.8942              | 0.8124               | 0.9978           | 0.9557    | 0.4204         | 0.8297       | 0.6267                    | 0.8128         | 0.7238          | 0.9966      |
| 0.0999        | 23.66 | 1940 | 0.2556          | 0.7678   | 0.8539        | 0.9335           | 0.9779         | 0.6072              | 0.9123            | 0.7735                         | 0.8972              | 0.8109               | 0.9985           | 0.9561    | 0.4335         | 0.8291       | 0.6245                    | 0.8127         | 0.7223          | 0.9966      |
| 0.0639        | 23.9  | 1960 | 0.2467          | 0.7659   | 0.8480        | 0.9337           | 0.9799         | 0.5431              | 0.9126            | 0.8278                         | 0.8777              | 0.7960               | 0.9987           | 0.9547    | 0.4119         | 0.8279       | 0.6398                    | 0.8137         | 0.7167          | 0.9964      |
| 0.0718        | 24.15 | 1980 | 0.2469          | 0.7667   | 0.8484        | 0.9341           | 0.9804         | 0.5609              | 0.9068            | 0.7785                         | 0.8983              | 0.8160               | 0.9982           | 0.9546    | 0.4190         | 0.8271       | 0.6306                    | 0.8159         | 0.7232          | 0.9965      |
| 0.0578        | 24.39 | 2000 | 0.2466          | 0.7668   | 0.8490        | 0.9339           | 0.9795         | 0.5737              | 0.9089            | 0.7591                         | 0.9041              | 0.8194               | 0.9983           | 0.9551    | 0.4249         | 0.8271       | 0.6246                    | 0.8155         | 0.7241          | 0.9965      |
| 0.0664        | 24.63 | 2020 | 0.2530          | 0.7640   | 0.8449        | 0.9328           | 0.9784         | 0.5888              | 0.9101            | 0.7452                         | 0.9125              | 0.7808               | 0.9987           | 0.9549    | 0.4305         | 0.8255       | 0.6185                    | 0.8132         | 0.7088          | 0.9963      |
| 0.7601        | 24.88 | 2040 | 0.2531          | 0.7677   | 0.8502        | 0.9340           | 0.9810         | 0.5654              | 0.8995            | 0.7891                         | 0.8969              | 0.8221               | 0.9974           | 0.9535    | 0.4217         | 0.8288       | 0.6339                    | 0.8151         | 0.7244          | 0.9964      |


### Framework versions

- Transformers 4.37.0
- Pytorch 2.1.2
- Datasets 2.17.1
- Tokenizers 0.15.1