kiranpantha commited on
Commit
afd6aae
·
verified ·
1 Parent(s): b4e6165

End of training

Browse files
Files changed (1) hide show
  1. README.md +21 -31
README.md CHANGED
@@ -25,7 +25,7 @@ model-index:
25
  metrics:
26
  - name: Wer
27
  type: wer
28
- value: 0.25254629629629627
29
  ---
30
 
31
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -35,9 +35,9 @@ should probably proofread and complete it, then remove this comment. -->
35
 
36
  This model is a fine-tuned version of [facebook/w2v-bert-2.0](https://huggingface.co/facebook/w2v-bert-2.0) on the OpenSLR54 dataset.
37
  It achieves the following results on the evaluation set:
38
- - Loss: 0.2212
39
- - Wer: 0.2525
40
- - Cer: 0.0565
41
 
42
  ## Model description
43
 
@@ -60,7 +60,8 @@ The following hyperparameters were used during training:
60
  - train_batch_size: 8
61
  - eval_batch_size: 8
62
  - seed: 42
63
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 
64
  - lr_scheduler_type: linear
65
  - lr_scheduler_warmup_steps: 500
66
  - num_epochs: 2
@@ -70,33 +71,22 @@ The following hyperparameters were used during training:
70
 
71
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
72
  |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
73
- | 0.4436 | 0.0900 | 300 | 0.5638 | 0.5560 | 0.1447 |
74
- | 0.5495 | 0.1800 | 600 | 0.6876 | 0.6171 | 0.1641 |
75
- | 0.6148 | 0.2699 | 900 | 0.6872 | 0.6211 | 0.1724 |
76
- | 0.564 | 0.3599 | 1200 | 0.5503 | 0.5162 | 0.1326 |
77
- | 0.4964 | 0.4499 | 1500 | 0.5831 | 0.5319 | 0.1318 |
78
- | 0.4437 | 0.5399 | 1800 | 0.4913 | 0.4935 | 0.1202 |
79
- | 0.4441 | 0.6299 | 2100 | 0.4754 | 0.4764 | 0.1193 |
80
- | 0.3861 | 0.7199 | 2400 | 0.4357 | 0.4361 | 0.1055 |
81
- | 0.3811 | 0.8098 | 2700 | 0.4282 | 0.4137 | 0.0976 |
82
- | 0.3754 | 0.8998 | 3000 | 0.3905 | 0.4069 | 0.0975 |
83
- | 0.3511 | 0.9898 | 3300 | 0.3547 | 0.3692 | 0.0863 |
84
- | 0.2496 | 1.0798 | 3600 | 0.3297 | 0.3433 | 0.0796 |
85
- | 0.242 | 1.1698 | 3900 | 0.3125 | 0.3315 | 0.0770 |
86
- | 0.2378 | 1.2597 | 4200 | 0.3158 | 0.3336 | 0.0757 |
87
- | 0.2274 | 1.3497 | 4500 | 0.2871 | 0.3097 | 0.0722 |
88
- | 0.2142 | 1.4397 | 4800 | 0.3010 | 0.3058 | 0.0712 |
89
- | 0.1949 | 1.5297 | 5100 | 0.2767 | 0.2944 | 0.0678 |
90
- | 0.198 | 1.6197 | 5400 | 0.2487 | 0.2824 | 0.0639 |
91
- | 0.1806 | 1.7097 | 5700 | 0.2376 | 0.2674 | 0.0612 |
92
- | 0.1675 | 1.7996 | 6000 | 0.2293 | 0.2630 | 0.0595 |
93
- | 0.1671 | 1.8896 | 6300 | 0.2248 | 0.2581 | 0.0576 |
94
- | 0.1526 | 1.9796 | 6600 | 0.2212 | 0.2525 | 0.0565 |
95
 
96
 
97
  ### Framework versions
98
 
99
- - Transformers 4.45.0.dev0
100
- - Pytorch 2.4.1+cu121
101
- - Datasets 2.21.0
102
- - Tokenizers 0.19.1
 
25
  metrics:
26
  - name: Wer
27
  type: wer
28
+ value: 1.0004629629629629
29
  ---
30
 
31
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
35
 
36
  This model is a fine-tuned version of [facebook/w2v-bert-2.0](https://huggingface.co/facebook/w2v-bert-2.0) on the OpenSLR54 dataset.
37
  It achieves the following results on the evaluation set:
38
+ - Loss: 10.8771
39
+ - Wer: 1.0005
40
+ - Cer: 0.9690
41
 
42
  ## Model description
43
 
 
60
  - train_batch_size: 8
61
  - eval_batch_size: 8
62
  - seed: 42
63
+ - optimizer: Use OptimizerNames.SGD and the args are:
64
+ No additional optimizer arguments
65
  - lr_scheduler_type: linear
66
  - lr_scheduler_warmup_steps: 500
67
  - num_epochs: 2
 
71
 
72
  | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
73
  |:-------------:|:------:|:----:|:---------------:|:------:|:------:|
74
+ | 16.7814 | 0.1800 | 300 | 16.3800 | 1.0007 | 3.1059 |
75
+ | 16.2838 | 0.3599 | 600 | 15.8109 | 1.0005 | 2.9213 |
76
+ | 15.5569 | 0.5399 | 900 | 15.0093 | 1.0005 | 2.5754 |
77
+ | 15.0336 | 0.7199 | 1200 | 14.1309 | 1.0002 | 2.0061 |
78
+ | 13.9247 | 0.8998 | 1500 | 13.2986 | 1.0002 | 1.5023 |
79
+ | 13.1967 | 1.0798 | 1800 | 12.5663 | 1.0002 | 1.2076 |
80
+ | 12.4844 | 1.2597 | 2100 | 11.9662 | 1.0002 | 1.0769 |
81
+ | 11.8394 | 1.4397 | 2400 | 11.4978 | 1.0005 | 1.0134 |
82
+ | 11.4607 | 1.6197 | 2700 | 11.1599 | 1.0005 | 0.9855 |
83
+ | 11.2266 | 1.7996 | 3000 | 10.9534 | 1.0005 | 0.9733 |
84
+ | 11.0877 | 1.9796 | 3300 | 10.8771 | 1.0005 | 0.9690 |
 
 
 
 
 
 
 
 
 
 
 
85
 
86
 
87
  ### Framework versions
88
 
89
+ - Transformers 4.47.1
90
+ - Pytorch 2.5.1+cxx11.abi
91
+ - Datasets 3.2.0
92
+ - Tokenizers 0.21.0