VingeNie commited on
Commit
602287b
1 Parent(s): 8975eb1

End of training

Browse files
Files changed (1) hide show
  1. README.md +17 -16
README.md CHANGED
@@ -2,9 +2,9 @@
2
  language:
3
  - zh
4
  license: apache-2.0
 
5
  tags:
6
  - generated_from_trainer
7
- base_model: openai/whisper-tiny
8
  datasets:
9
  - mozilla-foundation/common_voice_16_1
10
  model-index:
@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the Common Voice 16.1 dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.8875
23
- - Cer Ortho: 39.1769
24
- - Cer: 34.5841
25
 
26
  ## Model description
27
 
@@ -40,29 +40,30 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - learning_rate: 1e-06
44
  - train_batch_size: 32
45
  - eval_batch_size: 32
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
- - lr_scheduler_type: constant_with_warmup
49
  - lr_scheduler_warmup_steps: 25
50
- - training_steps: 900
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Cer Ortho | Cer |
56
  |:-------------:|:------:|:----:|:---------------:|:---------:|:-------:|
57
- | 1.6067 | 0.3333 | 100 | 1.4840 | 49.7371 | 40.9228 |
58
- | 1.0099 | 0.6667 | 200 | 1.0139 | 45.3472 | 38.0811 |
59
- | 0.9724 | 1.0 | 300 | 0.9706 | 43.6654 | 36.6319 |
60
- | 0.9177 | 1.3333 | 400 | 0.9467 | 42.6622 | 35.9347 |
61
- | 0.9162 | 1.6667 | 500 | 0.9307 | 38.8232 | 35.3765 |
62
- | 0.9149 | 2.0 | 600 | 0.9164 | 40.0758 | 35.0824 |
63
- | 0.8773 | 2.3333 | 700 | 0.9059 | 40.3793 | 34.8833 |
64
- | 0.8278 | 2.6667 | 800 | 0.8954 | 39.1189 | 34.6122 |
65
- | 0.8801 | 3.0 | 900 | 0.8875 | 39.1769 | 34.5841 |
 
66
 
67
 
68
  ### Framework versions
 
2
  language:
3
  - zh
4
  license: apache-2.0
5
+ base_model: openai/whisper-tiny
6
  tags:
7
  - generated_from_trainer
 
8
  datasets:
9
  - mozilla-foundation/common_voice_16_1
10
  model-index:
 
19
 
20
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the Common Voice 16.1 dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.6244
23
+ - Cer Ortho: 28.9724
24
+ - Cer: 24.2287
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 0.0001
44
  - train_batch_size: 32
45
  - eval_batch_size: 32
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
+ - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_steps: 25
50
+ - training_steps: 6000
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Cer Ortho | Cer |
56
  |:-------------:|:------:|:----:|:---------------:|:---------:|:-------:|
57
+ | 0.783 | 0.4796 | 600 | 0.7962 | 54.2372 | 31.6835 |
58
+ | 0.6578 | 0.9592 | 1200 | 0.6968 | 32.3398 | 27.9872 |
59
+ | 0.5028 | 1.4388 | 1800 | 0.6624 | 40.8123 | 27.6832 |
60
+ | 0.4887 | 1.9185 | 2400 | 0.6265 | 31.8488 | 25.8712 |
61
+ | 0.3368 | 2.3981 | 3000 | 0.6200 | 31.5221 | 25.3234 |
62
+ | 0.3395 | 2.8777 | 3600 | 0.6106 | 38.9218 | 25.3534 |
63
+ | 0.2078 | 3.3573 | 4200 | 0.6184 | 28.7037 | 24.7440 |
64
+ | 0.1943 | 3.8369 | 4800 | 0.6139 | 32.2586 | 24.3287 |
65
+ | 0.1206 | 4.3165 | 5400 | 0.6272 | 30.4763 | 24.2656 |
66
+ | 0.102 | 4.7962 | 6000 | 0.6244 | 28.9724 | 24.2287 |
67
 
68
 
69
  ### Framework versions