Lakoc commited on
Commit
dbce8f3
1 Parent(s): 07ebbf5

End of training

Browse files
README.md CHANGED
@@ -17,15 +17,15 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [](https://huggingface.co/) on the fleurs dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 7.9853
21
- - Cer: 0.9675
22
  - Wer: 1.0
23
  - Mer: 1.0
24
- - Wil: 1.0
25
- - Wip: 0.0
26
  - Hits: 0
27
- - Substitutions: 2
28
- - Deletions: 29
29
  - Insertions: 0
30
 
31
  ## Model description
@@ -55,10 +55,10 @@ The following hyperparameters were used during training:
55
 
56
  ### Training results
57
 
58
- | Training Loss | Epoch | Step | Validation Loss | Cer | Wer | Mer | Wil | Wip | Hits | Substitutions | Deletions | Insertions |
59
- |:-------------:|:-----:|:----:|:---------------:|:------:|:---:|:---:|:---:|:---:|:----:|:-------------:|:---------:|:----------:|
60
- | 8.1125 | 0.0 | 4 | 8.0293 | 1.0 | 1.0 | 1.0 | 1 | 0 | 0 | 0 | 31 | 0 |
61
- | 8.0111 | 0.01 | 8 | 7.9853 | 0.9675 | 1.0 | 1.0 | 1.0 | 0.0 | 0 | 2 | 29 | 0 |
62
 
63
 
64
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [](https://huggingface.co/) on the fleurs dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 7.9280
21
+ - Cer: 1.0
22
  - Wer: 1.0
23
  - Mer: 1.0
24
+ - Wil: 1
25
+ - Wip: 0
26
  - Hits: 0
27
+ - Substitutions: 0
28
+ - Deletions: 34
29
  - Insertions: 0
30
 
31
  ## Model description
 
55
 
56
  ### Training results
57
 
58
+ | Training Loss | Epoch | Step | Validation Loss | Cer | Wer | Mer | Wil | Wip | Hits | Substitutions | Deletions | Insertions |
59
+ |:-------------:|:-----:|:----:|:---------------:|:---:|:---:|:---:|:---:|:---:|:----:|:-------------:|:---------:|:----------:|
60
+ | 8.0922 | 0.0 | 4 | 7.9783 | 1.0 | 1.0 | 1.0 | 1 | 0 | 0 | 0 | 34 | 0 |
61
+ | 7.9733 | 0.01 | 8 | 7.9280 | 1.0 | 1.0 | 1.0 | 1 | 0 | 0 | 0 | 34 | 0 |
62
 
63
 
64
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ada001a56e5cc2dc6bbc769a5da1849b69869b10fde113e1f9cf2f98c4bd1fd1
3
  size 155523256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c8461ac73ace17c62c9399d9ef6973f5cb369023b9f0c7929a8c825be0f4058
3
  size 155523256
predictions_test_wer100.00.csv CHANGED
@@ -1,3 +1,3 @@
1
  label,prediction
2
- however due to the slow communication channels styles in the west could lag behind by 25 to 30 year,s
3
- all nouns alongside the word sie for you always begin with a capital letter even in the middle of a sentence,s
 
1
  label,prediction
2
+ however due to the slow communication channels styles in the west could lag behind by 25 to 30 year,
3
+ all nouns alongside the word sie for you always begin with a capital letter even in the middle of a sentence,
predictions_test_wer100.00_hyp.trn CHANGED
@@ -1,2 +1,2 @@
1
- s (utterance_0)
2
- s (utterance_1)
 
1
+ (utterance_0)
2
+ (utterance_1)
predictions_test_wer100.00_hyp.trn.dtl CHANGED
@@ -5,7 +5,7 @@ SENTENCE RECOGNITION PERFORMANCE
5
  sentences 2
6
  with errors 100.0% ( 2)
7
 
8
- with substitutions 100.0% ( 2)
9
  with deletions 100.0% ( 2)
10
  with insertions 0.0% ( 0)
11
 
@@ -16,23 +16,21 @@ Percent Total Error = 100.0% ( 40)
16
 
17
  Percent Correct = 0.0% ( 0)
18
 
19
- Percent Substitution = 5.0% ( 2)
20
- Percent Deletions = 95.0% ( 38)
21
  Percent Insertions = 0.0% ( 0)
22
  Percent Word Accuracy = 0.0%
23
 
24
 
25
  Ref. words = ( 40)
26
- Hyp. words = ( 2)
27
  Aligned words = ( 40)
28
 
29
- CONFUSION PAIRS Total (2)
30
- With >= 1 occurrences (2)
31
 
32
- 1: 1 -> sentence ==> s
33
- 2: 1 -> year ==> s
34
  -------
35
- 2
36
 
37
 
38
 
@@ -44,8 +42,8 @@ INSERTIONS Total (0)
44
 
45
 
46
 
47
- DELETIONS Total (32)
48
- With >= 1 occurrences (32)
49
 
50
  1: 4 -> the
51
  2: 2 -> a
@@ -72,37 +70,36 @@ DELETIONS Total (32)
72
  23: 1 -> middle
73
  24: 1 -> nouns
74
  25: 1 -> of
75
- 26: 1 -> sie
76
- 27: 1 -> slow
77
- 28: 1 -> styles
78
- 29: 1 -> west
79
- 30: 1 -> with
80
- 31: 1 -> word
81
- 32: 1 -> you
 
 
82
  -------
83
- 38
84
 
85
 
86
 
87
- SUBSTITUTIONS Total (2)
88
- With >= 1 occurrences (2)
89
 
90
- 1: 1 -> sentence
91
- 2: 1 -> year
92
  -------
93
- 2
94
 
95
 
96
  * NOTE: The 'Substitution' words are those reference words
97
  for which the recognizer supplied an incorrect word.
98
 
99
 
100
- FALSELY RECOGNIZED Total (1)
101
- With >= 1 occurrences (1)
102
 
103
- 1: 2 -> s
104
  -------
105
- 2
106
 
107
 
108
  * NOTE: The 'Falsely Recognized' words are those hypothesis words
 
5
  sentences 2
6
  with errors 100.0% ( 2)
7
 
8
+ with substitutions 0.0% ( 0)
9
  with deletions 100.0% ( 2)
10
  with insertions 0.0% ( 0)
11
 
 
16
 
17
  Percent Correct = 0.0% ( 0)
18
 
19
+ Percent Substitution = 0.0% ( 0)
20
+ Percent Deletions = 100.0% ( 40)
21
  Percent Insertions = 0.0% ( 0)
22
  Percent Word Accuracy = 0.0%
23
 
24
 
25
  Ref. words = ( 40)
26
+ Hyp. words = ( 0)
27
  Aligned words = ( 40)
28
 
29
+ CONFUSION PAIRS Total (0)
30
+ With >= 1 occurrences (0)
31
 
 
 
32
  -------
33
+ 0
34
 
35
 
36
 
 
42
 
43
 
44
 
45
+ DELETIONS Total (34)
46
+ With >= 1 occurrences (34)
47
 
48
  1: 4 -> the
49
  2: 2 -> a
 
70
  23: 1 -> middle
71
  24: 1 -> nouns
72
  25: 1 -> of
73
+ 26: 1 -> sentence
74
+ 27: 1 -> sie
75
+ 28: 1 -> slow
76
+ 29: 1 -> styles
77
+ 30: 1 -> west
78
+ 31: 1 -> with
79
+ 32: 1 -> word
80
+ 33: 1 -> year
81
+ 34: 1 -> you
82
  -------
83
+ 40
84
 
85
 
86
 
87
+ SUBSTITUTIONS Total (0)
88
+ With >= 1 occurrences (0)
89
 
 
 
90
  -------
91
+ 0
92
 
93
 
94
  * NOTE: The 'Substitution' words are those reference words
95
  for which the recognizer supplied an incorrect word.
96
 
97
 
98
+ FALSELY RECOGNIZED Total (0)
99
+ With >= 1 occurrences (0)
100
 
 
101
  -------
102
+ 0
103
 
104
 
105
  * NOTE: The 'Falsely Recognized' words are those hypothesis words
predictions_test_wer100.00_hyp.trn.snt.utt CHANGED
@@ -8,39 +8,39 @@
8
 
9
  SPEAKER utt
10
  id: (utterance_0)
11
- Scores: (#C #S #D #I) 0 1 18 0
12
  REF: HOWEVER DUE TO THE SLOW COMMUNICATION CHANNELS STYLES IN THE WEST COULD LAG BEHIND BY 25 TO 30 YEAR
13
- HYP: ******* *** ** *** **** ************* ******** ****** ** *** **** ***** *** ****** ** ** ** ** S
14
- Eval: D D D D D D D D D D D D D D D D D D S
15
 
16
  Correct = 0.0% 0 ( 0)
17
- Substitutions = 5.3% 1 ( 1)
18
- Deletions = 94.7% 18 ( 18)
19
  Insertions = 0.0% 0 ( 0)
20
 
21
  Errors = 100.0% 19 ( 19)
22
 
23
  Ref. words = 19 ( 19)
24
- Hyp. words = 1 ( 1)
25
  Aligned words = 19 ( 19)
26
 
27
  -------------------------------------------------------------------------------
28
 
29
  id: (utterance_1)
30
- Scores: (#C #S #D #I) 0 1 20 0
31
  REF: ALL NOUNS ALONGSIDE THE WORD SIE FOR YOU ALWAYS BEGIN WITH A CAPITAL LETTER EVEN IN THE MIDDLE OF A SENTENCE
32
- HYP: *** ***** ********* *** **** *** *** *** ****** ***** **** * ******* ****** **** ** *** ****** ** * S
33
- Eval: D D D D D D D D D D D D D D D D D D D D S
34
 
35
  Correct = 0.0% 0 ( 0)
36
- Substitutions = 4.8% 1 ( 2)
37
- Deletions = 95.2% 20 ( 38)
38
  Insertions = 0.0% 0 ( 0)
39
 
40
  Errors = 100.0% 21 ( 40)
41
 
42
  Ref. words = 21 ( 40)
43
- Hyp. words = 1 ( 2)
44
  Aligned words = 21 ( 40)
45
 
46
  -------------------------------------------------------------------------------
 
8
 
9
  SPEAKER utt
10
  id: (utterance_0)
11
+ Scores: (#C #S #D #I) 0 0 19 0
12
  REF: HOWEVER DUE TO THE SLOW COMMUNICATION CHANNELS STYLES IN THE WEST COULD LAG BEHIND BY 25 TO 30 YEAR
13
+ HYP: ******* *** ** *** **** ************* ******** ****** ** *** **** ***** *** ****** ** ** ** ** ****
14
+ Eval: D D D D D D D D D D D D D D D D D D D
15
 
16
  Correct = 0.0% 0 ( 0)
17
+ Substitutions = 0.0% 0 ( 0)
18
+ Deletions = 100.0% 19 ( 19)
19
  Insertions = 0.0% 0 ( 0)
20
 
21
  Errors = 100.0% 19 ( 19)
22
 
23
  Ref. words = 19 ( 19)
24
+ Hyp. words = 0 ( 0)
25
  Aligned words = 19 ( 19)
26
 
27
  -------------------------------------------------------------------------------
28
 
29
  id: (utterance_1)
30
+ Scores: (#C #S #D #I) 0 0 21 0
31
  REF: ALL NOUNS ALONGSIDE THE WORD SIE FOR YOU ALWAYS BEGIN WITH A CAPITAL LETTER EVEN IN THE MIDDLE OF A SENTENCE
32
+ HYP: *** ***** ********* *** **** *** *** *** ****** ***** **** * ******* ****** **** ** *** ****** ** * ********
33
+ Eval: D D D D D D D D D D D D D D D D D D D D D
34
 
35
  Correct = 0.0% 0 ( 0)
36
+ Substitutions = 0.0% 0 ( 0)
37
+ Deletions = 100.0% 21 ( 40)
38
  Insertions = 0.0% 0 ( 0)
39
 
40
  Errors = 100.0% 21 ( 40)
41
 
42
  Ref. words = 21 ( 40)
43
+ Hyp. words = 0 ( 0)
44
  Aligned words = 21 ( 40)
45
 
46
  -------------------------------------------------------------------------------
predictions_test_wer100.00_hyp.trn.sys CHANGED
@@ -8,11 +8,11 @@
8
  |----------------------------------------------------------------|
9
  | SPKR | # Snt # Wrd | Corr Sub Del Ins Err S.Err |
10
  |--------+-------------+-----------------------------------------|
11
- | utt | 2 40 | 0.0 5.0 95.0 0.0 100.0 100.0 |
12
  |================================================================|
13
- | Sum/Avg| 2 40 | 0.0 5.0 95.0 0.0 100.0 100.0 |
14
  |================================================================|
15
- | Mean | 2.0 40.0 | 0.0 5.0 95.0 0.0 100.0 100.0 |
16
  | S.D. | 0.0 0.0 | 0.0 0.0 0.0 0.0 0.0 0.0 |
17
- | Median | 2.0 40.0 | 0.0 5.0 95.0 0.0 100.0 100.0 |
18
  `----------------------------------------------------------------'
 
8
  |----------------------------------------------------------------|
9
  | SPKR | # Snt # Wrd | Corr Sub Del Ins Err S.Err |
10
  |--------+-------------+-----------------------------------------|
11
+ | utt | 2 40 | 0.0 0.0 100.0 0.0 100.0 100.0 |
12
  |================================================================|
13
+ | Sum/Avg| 2 40 | 0.0 0.0 100.0 0.0 100.0 100.0 |
14
  |================================================================|
15
+ | Mean | 2.0 40.0 | 0.0 0.0 100.0 0.0 100.0 100.0 |
16
  | S.D. | 0.0 0.0 | 0.0 0.0 0.0 0.0 0.0 0.0 |
17
+ | Median | 2.0 40.0 | 0.0 0.0 100.0 0.0 100.0 100.0 |
18
  `----------------------------------------------------------------'
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4179a06469074362514407ec541a49d6994af6469cacd297b1c659c7e514519c
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feceb463d3f87bbaf72465b1ebe7c4dd868138ed35e59376c411884e9781847a
3
  size 5496