unreal-hug commited on
Commit
89d7e12
1 Parent(s): c619ec1

End of training

Browse files
README.md ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ base_model: nvidia/mit-b0
4
+ tags:
5
+ - vision
6
+ - image-segmentation
7
+ - generated_from_trainer
8
+ model-index:
9
+ - name: segformer-b0-finetuned-segments-ECHO-dev-05-v1
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # segformer-b0-finetuned-segments-ECHO-dev-05-v1
17
+
18
+ This model is a fine-tuned version of [nvidia/mit-b0](https://huggingface.co/nvidia/mit-b0) on the unreal-hug/REAL_DATASET_SEG dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.4592
21
+ - Mean Iou: 0.3826
22
+ - Mean Accuracy: 0.5892
23
+ - Overall Accuracy: 0.5467
24
+ - Accuracy Unlabeled: nan
25
+ - Accuracy Lv: 0.7143
26
+ - Accuracy Lr: 0.4323
27
+ - Accuracy Ra: 0.7629
28
+ - Accuracy La: 0.4472
29
+ - Iou Unlabeled: 0.0
30
+ - Iou Lv: 0.7065
31
+ - Iou Lr: 0.4317
32
+ - Iou Ra: 0.4223
33
+ - Iou La: 0.3527
34
+
35
+ ## Model description
36
+
37
+ More information needed
38
+
39
+ ## Intended uses & limitations
40
+
41
+ More information needed
42
+
43
+ ## Training and evaluation data
44
+
45
+ More information needed
46
+
47
+ ## Training procedure
48
+
49
+ ### Training hyperparameters
50
+
51
+ The following hyperparameters were used during training:
52
+ - learning_rate: 6e-05
53
+ - train_batch_size: 2
54
+ - eval_batch_size: 2
55
+ - seed: 42
56
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
57
+ - lr_scheduler_type: linear
58
+ - num_epochs: 50
59
+
60
+ ### Training results
61
+
62
+ | Training Loss | Epoch | Step | Validation Loss | Mean Iou | Mean Accuracy | Overall Accuracy | Accuracy Unlabeled | Accuracy Lv | Accuracy Lr | Accuracy Ra | Accuracy La | Iou Unlabeled | Iou Lv | Iou Lr | Iou Ra | Iou La |
63
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:-------------:|:----------------:|:------------------:|:-----------:|:-----------:|:-----------:|:-----------:|:-------------:|:------:|:------:|:------:|:------:|
64
+ | 1.1252 | 2.86 | 20 | 1.3259 | 0.1971 | 0.3379 | 0.4375 | nan | 0.0 | 0.6365 | 0.5291 | 0.1860 | 0.0 | 0.0 | 0.4923 | 0.3492 | 0.1439 |
65
+ | 0.9104 | 5.71 | 40 | 0.9589 | 0.1818 | 0.3421 | 0.3596 | nan | 0.0145 | 0.3590 | 0.7644 | 0.2304 | 0.0 | 0.0144 | 0.3436 | 0.3778 | 0.1731 |
66
+ | 0.7567 | 8.57 | 60 | 0.7761 | 0.2203 | 0.3739 | 0.3852 | nan | 0.0808 | 0.3882 | 0.6422 | 0.3844 | 0.0 | 0.0803 | 0.3778 | 0.4073 | 0.2360 |
67
+ | 0.7035 | 11.43 | 80 | 0.7442 | 0.2729 | 0.4718 | 0.4941 | nan | 0.2145 | 0.5077 | 0.8370 | 0.3279 | 0.0 | 0.2134 | 0.4817 | 0.4073 | 0.2619 |
68
+ | 0.5781 | 14.29 | 100 | 0.6260 | 0.2876 | 0.4446 | 0.4279 | nan | 0.4235 | 0.3777 | 0.5787 | 0.3986 | 0.0 | 0.3683 | 0.3761 | 0.4063 | 0.2873 |
69
+ | 0.5438 | 17.14 | 120 | 0.5559 | 0.3877 | 0.5412 | 0.5761 | nan | 0.5803 | 0.6504 | 0.5190 | 0.4149 | 0.0 | 0.5671 | 0.6193 | 0.4171 | 0.3352 |
70
+ | 0.5198 | 20.0 | 140 | 0.5617 | 0.3724 | 0.5617 | 0.5335 | nan | 0.6661 | 0.4532 | 0.7059 | 0.4216 | 0.0 | 0.6419 | 0.4532 | 0.4129 | 0.3540 |
71
+ | 0.4435 | 22.86 | 160 | 0.5393 | 0.4160 | 0.6198 | 0.6126 | nan | 0.7555 | 0.5832 | 0.6962 | 0.4442 | 0.0 | 0.7000 | 0.5705 | 0.4873 | 0.3221 |
72
+ | 0.5002 | 25.71 | 180 | 0.5126 | 0.4094 | 0.6080 | 0.6043 | nan | 0.6854 | 0.5833 | 0.6945 | 0.4687 | 0.0 | 0.6771 | 0.5761 | 0.4762 | 0.3176 |
73
+ | 0.4142 | 28.57 | 200 | 0.4874 | 0.3503 | 0.5361 | 0.4949 | nan | 0.6967 | 0.3895 | 0.6436 | 0.4147 | 0.0 | 0.6287 | 0.3895 | 0.4106 | 0.3228 |
74
+ | 0.3092 | 31.43 | 220 | 0.4819 | 0.3857 | 0.6001 | 0.5534 | nan | 0.7296 | 0.4267 | 0.8020 | 0.4423 | 0.0 | 0.7157 | 0.4267 | 0.4266 | 0.3595 |
75
+ | 0.2895 | 34.29 | 240 | 0.4969 | 0.3983 | 0.6220 | 0.5809 | nan | 0.7353 | 0.4689 | 0.8050 | 0.4787 | 0.0 | 0.7265 | 0.4677 | 0.4474 | 0.3498 |
76
+ | 0.3046 | 37.14 | 260 | 0.4767 | 0.4248 | 0.6412 | 0.6115 | nan | 0.7853 | 0.5270 | 0.7814 | 0.4711 | 0.0 | 0.7712 | 0.5199 | 0.4587 | 0.3742 |
77
+ | 0.3514 | 40.0 | 280 | 0.4531 | 0.3978 | 0.5989 | 0.5767 | nan | 0.7112 | 0.5082 | 0.7478 | 0.4282 | 0.0 | 0.6979 | 0.5024 | 0.4353 | 0.3537 |
78
+ | 0.2891 | 42.86 | 300 | 0.4629 | 0.3842 | 0.5885 | 0.5488 | nan | 0.7046 | 0.4397 | 0.7693 | 0.4403 | 0.0 | 0.6982 | 0.4366 | 0.4237 | 0.3623 |
79
+ | 0.2512 | 45.71 | 320 | 0.4584 | 0.3783 | 0.5794 | 0.5357 | nan | 0.7144 | 0.4199 | 0.7390 | 0.4443 | 0.0 | 0.7016 | 0.4196 | 0.4134 | 0.3568 |
80
+ | 0.2695 | 48.57 | 340 | 0.4592 | 0.3826 | 0.5892 | 0.5467 | nan | 0.7143 | 0.4323 | 0.7629 | 0.4472 | 0.0 | 0.7065 | 0.4317 | 0.4223 | 0.3527 |
81
+
82
+
83
+ ### Framework versions
84
+
85
+ - Transformers 4.35.2
86
+ - Pytorch 2.1.0+cu118
87
+ - Datasets 2.15.0
88
+ - Tokenizers 0.15.0
config.json ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "nvidia/mit-b0",
3
+ "architectures": [
4
+ "SegformerForSemanticSegmentation"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.0,
7
+ "classifier_dropout_prob": 0.1,
8
+ "decoder_hidden_size": 256,
9
+ "depths": [
10
+ 2,
11
+ 2,
12
+ 2,
13
+ 2
14
+ ],
15
+ "downsampling_rates": [
16
+ 1,
17
+ 4,
18
+ 8,
19
+ 16
20
+ ],
21
+ "drop_path_rate": 0.1,
22
+ "hidden_act": "gelu",
23
+ "hidden_dropout_prob": 0.0,
24
+ "hidden_sizes": [
25
+ 32,
26
+ 64,
27
+ 160,
28
+ 256
29
+ ],
30
+ "id2label": {
31
+ "0": "unlabeled",
32
+ "1": "LV",
33
+ "2": "LR",
34
+ "3": "RA",
35
+ "4": "LA"
36
+ },
37
+ "image_size": 224,
38
+ "initializer_range": 0.02,
39
+ "label2id": {
40
+ "LA": 4,
41
+ "LR": 2,
42
+ "LV": 1,
43
+ "RA": 3,
44
+ "unlabeled": 0
45
+ },
46
+ "layer_norm_eps": 1e-06,
47
+ "mlp_ratios": [
48
+ 4,
49
+ 4,
50
+ 4,
51
+ 4
52
+ ],
53
+ "model_type": "segformer",
54
+ "num_attention_heads": [
55
+ 1,
56
+ 2,
57
+ 5,
58
+ 8
59
+ ],
60
+ "num_channels": 3,
61
+ "num_encoder_blocks": 4,
62
+ "patch_sizes": [
63
+ 7,
64
+ 3,
65
+ 3,
66
+ 3
67
+ ],
68
+ "reshape_last_stage": true,
69
+ "semantic_loss_ignore_index": 255,
70
+ "sr_ratios": [
71
+ 8,
72
+ 4,
73
+ 2,
74
+ 1
75
+ ],
76
+ "strides": [
77
+ 4,
78
+ 2,
79
+ 2,
80
+ 2
81
+ ],
82
+ "torch_dtype": "float32",
83
+ "transformers_version": "4.35.2"
84
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2764b365eb79104c63292c4ae442de614f3617a859b3f852b9db95000b143e7
3
+ size 14887860
runs/Dec05_05-57-29_f0de80f3f16e/events.out.tfevents.1701755899.f0de80f3f16e.380.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dbde327d393a218a1a639148e766c673b8728242f7a2fe5cc024c976e7a5be1
3
+ size 76318
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b107468779ae721c626a7facc15bcf203ffcb2030309ecd5f5f61756a6c140d
3
+ size 4664