Mirco commited on
Commit
2c50749
1 Parent(s): a87b222

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +80 -0
README.md CHANGED
@@ -0,0 +1,80 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: "en"
3
+ thumbnail:
4
+ tags:
5
+ - ASR
6
+ - CTC
7
+ - Attention
8
+ - Transformers
9
+ - pytorch
10
+ license: "apache-2.0"
11
+ datasets:
12
+ - librispeech
13
+ metrics:
14
+ - wer
15
+ - cer
16
+ ---
17
+
18
+ # Transformer for AISHELL (Mandarin Chinese)
19
+
20
+ This repository provides all the necessary tools to perform automatic speech
21
+ recognition from an end-to-end system pretrained on AISHELL (Mandarin Chinese)
22
+ within SpeechBrain. For a better experience, we encourage you to learn more about
23
+ [SpeechBrain](https://speechbrain.github.io). The given ASR model performance are:
24
+
25
+ | Release | Dev CER | Test CER | GPUs | Full Results |
26
+ |:-------------:|:--------------:|:--------------:|:--------:|:--------:|
27
+ | 05-03-21 | 5.60 | 6.04 | 2xV100 32GB | [Google Drive](https://drive.google.com/drive/folders/1zlTBib0XEwWeyhaXDXnkqtPsIBI18Uzs?usp=sharing)|
28
+
29
+
30
+
31
+ ## Pipeline description
32
+
33
+ This ASR system is composed of 2 different but linked blocks:
34
+ 1. Tokenizer (unigram) that transforms words into subword units and trained with
35
+ the train transcriptions of LibriSpeech.
36
+ 2. Acoustic model made of a transformer encoder and a joint decoder with CTC +
37
+ transformer. Hence, the decoding also incorporates the CTC probabilities.
38
+
39
+ To Train this system from scratch, [see our SpeechBrain recipe](https://github.com/speechbrain/speechbrain/tree/develop/recipes/AISHELL-1).
40
+
41
+ ## Intended uses & limitations
42
+
43
+ This model has been primarily developed to be run within SpeechBrain as a pretrained ASR model
44
+ for the Mandarin Chinese language. Thanks to the flexibility of SpeechBrain, any of the 3 blocks
45
+ detailed above can be extracted and connected to your custom pipeline as long as SpeechBrain is
46
+ installed.
47
+
48
+ ## Install SpeechBrain
49
+
50
+ First of all, please install SpeechBrain with the following command:
51
+
52
+ ```
53
+ pip install speechbrain
54
+ ```
55
+
56
+ Please notice that we encourage you to read our tutorials and learn more about
57
+ [SpeechBrain](https://speechbrain.github.io).
58
+
59
+ ### Transcribing your own audio files (in English)
60
+
61
+ ```python
62
+ from speechbrain.pretrained import TransformerASR
63
+
64
+ asr_model = TransformerASR.from_hparams(source="speechbrain/asr-transformer-aishell", savedir="pretrained_models/asr-transformer-aishell")
65
+ asr_model.transcribe_file("speechbrain/asr-transformer-aishell/example.wav")
66
+
67
+ ```
68
+
69
+ #### Referencing SpeechBrain
70
+
71
+ ```
72
+ @misc{SB2021,
73
+ author = {Ravanelli, Mirco and Parcollet, Titouan and Rouhe, Aku and Plantinga, Peter and Rastorgueva, Elena and Lugosch, Loren and Dawalatabad, Nauman and Ju-Chieh, Chou and Heba, Abdel and Grondin, Francois and Aris, William and Liao, Chien-Feng and Cornell, Samuele and Yeh, Sung-Lin and Na, Hwidong and Gao, Yan and Fu, Szu-Wei and Subakan, Cem and De Mori, Renato and Bengio, Yoshua },
74
+ title = {SpeechBrain},
75
+ year = {2021},
76
+ publisher = {GitHub},
77
+ journal = {GitHub repository},
78
+ howpublished = {\\\\url{https://github.com/speechbrain/speechbrain}},
79
+ }
80
+ ```