benmajor27 commited on
Commit
246576b
1 Parent(s): be96de3

End of training

Browse files
README.md CHANGED
@@ -7,25 +7,35 @@ tags:
7
  - generated_from_trainer
8
  datasets:
9
  - mozilla-foundation/common_voice_17_0
 
 
10
  model-index:
11
- - name: Whisper Large-v3 Hu - snoopyben27
12
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
- # Whisper Large-v3 Hu - snoopyben27
19
 
20
  This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on the Common Voice 17.0 dataset.
21
  It achieves the following results on the evaluation set:
22
- - eval_loss: 0.1072
23
- - eval_wer: 11.8966
24
- - eval_runtime: 966.6053
25
- - eval_samples_per_second: 1.035
26
- - eval_steps_per_second: 0.259
27
- - epoch: 0.6596
28
- - step: 1000
29
 
30
  ## Model description
31
 
@@ -45,15 +55,24 @@ More information needed
45
 
46
  The following hyperparameters were used during training:
47
  - learning_rate: 1e-05
48
- - train_batch_size: 32
49
  - eval_batch_size: 4
50
  - seed: 42
 
 
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - lr_scheduler_warmup_steps: 100
54
- - training_steps: 2000
55
  - mixed_precision_training: Native AMP
56
 
 
 
 
 
 
 
 
57
  ### Framework versions
58
 
59
  - Transformers 4.41.2
 
7
  - generated_from_trainer
8
  datasets:
9
  - mozilla-foundation/common_voice_17_0
10
+ metrics:
11
+ - wer
12
  model-index:
13
+ - name: Whisper Large-v3 Hu_v2 - snoopyben27
14
+ results:
15
+ - task:
16
+ name: Automatic Speech Recognition
17
+ type: automatic-speech-recognition
18
+ dataset:
19
+ name: Common Voice 17.0
20
+ type: mozilla-foundation/common_voice_17_0
21
+ config: default
22
+ split: test
23
+ args: 'config: hu, split: test'
24
+ metrics:
25
+ - name: Wer
26
+ type: wer
27
+ value: 14.057158484889923
28
  ---
29
 
30
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
31
  should probably proofread and complete it, then remove this comment. -->
32
 
33
+ # Whisper Large-v3 Hu_v2 - snoopyben27
34
 
35
  This model is a fine-tuned version of [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) on the Common Voice 17.0 dataset.
36
  It achieves the following results on the evaluation set:
37
+ - Loss: 0.1284
38
+ - Wer: 14.0572
 
 
 
 
 
39
 
40
  ## Model description
41
 
 
55
 
56
  The following hyperparameters were used during training:
57
  - learning_rate: 1e-05
58
+ - train_batch_size: 8
59
  - eval_batch_size: 4
60
  - seed: 42
61
+ - gradient_accumulation_steps: 2
62
+ - total_train_batch_size: 16
63
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
64
  - lr_scheduler_type: linear
65
+ - lr_scheduler_warmup_steps: 10
66
+ - training_steps: 250
67
  - mixed_precision_training: Native AMP
68
 
69
+ ### Training results
70
+
71
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
72
+ |:-------------:|:------:|:----:|:---------------:|:-------:|
73
+ | 0.1306 | 0.0825 | 250 | 0.1284 | 14.0572 |
74
+
75
+
76
  ### Framework versions
77
 
78
  - Transformers 4.41.2
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1eb0dcdc38091ca5c0475407d19a365946dec4fb1aa5feab075e915c5189bfdd
3
  size 4993448880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:274d9b9115b2266d8d66129b8c4c93dc9fb9ea5ec72c3cd3cf134e8a519e5d75
3
  size 4993448880
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f8edc4309db958f881dac40a859408618cb91ea43b68c05fbb84e4131b62ce53
3
  size 1180663192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbde048a6f500acc3c2a3240fb0cc29e9a8c0885850c6c2115174cedb9acfcd6
3
  size 1180663192
runs/Jun27_15-41-36_c86079fec55a/events.out.tfevents.1719502907.c86079fec55a.490.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:51518977ce7d1f8e7e48af22417c7a0861b2313321547674d72b58c674314dae
3
- size 7998
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae0ff62a284bdbc081cd6a7b87585456ea64e584438148947a9ed2e7093bfdca
3
+ size 8352