kpriyanshu256 commited on
Commit
f60dc99
1 Parent(s): 0ea9080

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +95 -0
README.md ADDED
@@ -0,0 +1,95 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ga-IE
4
+ license: apache-2.0
5
+ tags:
6
+ - whisper-event
7
+ - generated_from_trainer
8
+ datasets:
9
+ - google/fleurs
10
+ - mozilla-foundation/common_voice_11_0
11
+ metrics:
12
+ - wer
13
+ model-index:
14
+ - name: whisper-large-v2-Irish
15
+ results:
16
+ - task:
17
+ name: Automatic Speech Recognition
18
+ type: automatic-speech-recognition
19
+ dataset:
20
+ name: Common Voice 11.0
21
+ type: google/fleurs
22
+ config: ga-IE
23
+ split: test
24
+ args: ga-IE
25
+ metrics:
26
+ - name: Wer
27
+ type: wer
28
+ value: 34.26248548199768
29
+ - task:
30
+ name: Automatic Speech Recognition
31
+ type: automatic-speech-recognition
32
+ dataset:
33
+ name: FLEURS
34
+ type: mozilla-foundation/common_voice_11_0
35
+ metrics:
36
+ - name: Wer
37
+ type: wer
38
+ value: 34.26248548199768
39
+ ---
40
+
41
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
42
+ should probably proofread and complete it, then remove this comment. -->
43
+
44
+ # whisper-large-v2-Irish
45
+
46
+ This model is a fine-tuned version of [kpriyanshu256/whisper-large-v2-cy-500-32-1e-05](https://huggingface.co/kpriyanshu256/whisper-large-v2-cy-500-32-1e-05) on the Common Voice 11.0 and the FLEURS datasets.
47
+ It achieves the following results on the evaluation set:
48
+ - Loss: 0.7879
49
+ - Wer: 34.2625
50
+
51
+ ## Model description
52
+
53
+ More information needed
54
+
55
+ ## Intended uses & limitations
56
+
57
+ More information needed
58
+
59
+ ## Training and evaluation data
60
+
61
+ More information needed
62
+
63
+ ## Training procedure
64
+
65
+ ### Training hyperparameters
66
+
67
+ The following hyperparameters were used during training:
68
+ - learning_rate: 1e-05
69
+ - train_batch_size: 16
70
+ - eval_batch_size: 8
71
+ - seed: 42
72
+ - distributed_type: multi-GPU
73
+ - gradient_accumulation_steps: 2
74
+ - total_train_batch_size: 32
75
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
76
+ - lr_scheduler_type: linear
77
+ - lr_scheduler_warmup_steps: 50
78
+ - training_steps: 1000
79
+
80
+ ### Training results
81
+
82
+ | Training Loss | Epoch | Step | Validation Loss | Wer |
83
+ |:-------------:|:-----:|:----:|:---------------:|:-------:|
84
+ | 0.3768 | 0.25 | 250 | 0.7143 | 39.4890 |
85
+ | 0.1498 | 1.15 | 500 | 0.7663 | 35.8014 |
86
+ | 0.0907 | 2.05 | 750 | 0.7730 | 35.2497 |
87
+ | 0.045 | 2.3 | 1000 | 0.7879 | 34.2625 |
88
+
89
+
90
+ ### Framework versions
91
+
92
+ - Transformers 4.26.0.dev0
93
+ - Pytorch 1.13.0+cu117
94
+ - Datasets 2.7.1.dev0
95
+ - Tokenizers 0.13.2