shuaijiang commited on
Commit
d4fea16
β€’
1 Parent(s): 3727550

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -0
README.md CHANGED
@@ -1,3 +1,64 @@
1
  ---
2
  license: apache-2.0
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ metrics:
4
+ - cer
5
  ---
6
+ ## Welcome
7
+ If you find this model helpful, please *like* this model and star us on https://github.com/LianjiaTech/BELLE and https://github.com/shuaijiang/Whisper-Finetune
8
+
9
+ # Belle-whisper-large-v3-zh
10
+ Fine tune whisper-large-v3 to enhance Chinese speech recognition capabilities,
11
+ Belle-whisper-large-v3-zh demonstrates a **24-65%** relative improvement in performance on Chinese ASR benchmarks, including AISHELL1, AISHELL2, WENETSPEECH, and HKUST.
12
+
13
+
14
+ ## Usage
15
+ ```python
16
+
17
+ from transformers import pipeline
18
+
19
+ transcriber = pipeline(
20
+ "automatic-speech-recognition",
21
+ model="BELLE-2/Belle-whisper-large-v3-zh"
22
+ )
23
+
24
+ transcriber.model.config.forced_decoder_ids = (
25
+ transcriber.tokenizer.get_decoder_prompt_ids(
26
+ language="zh",
27
+ task="transcribe"
28
+ )
29
+ )
30
+
31
+ transcription = transcriber("my_audio.wav")
32
+
33
+ ```
34
+
35
+ ## Fine-tuning
36
+ | Model | (Re)Sample Rate | Train Datasets | Fine-tuning (full or peft) |
37
+ |:----------------:|:-------:|:----------------------------------------------------------:|:-----------:|
38
+ | Belle-whisper-large-v3-zh | 16KHz | [AISHELL-1](https://openslr.magicdatatech.com/resources/33/) [AISHELL-2](https://www.aishelltech.com/aishell_2) [WenetSpeech](https://wenet.org.cn/WenetSpeech/) [HKUST](https://catalog.ldc.upenn.edu/LDC2005S15) | [full fine-tuning](https://github.com/shuaijiang/Whisper-Finetune) |
39
+
40
+ If you want to fine-thuning the model on your datasets, please reference to the [github repo](https://github.com/shuaijiang/Whisper-Finetune)
41
+
42
+
43
+ ## CER(%) ↓
44
+ | Model | Language Tag | aishell_1_test(↓) |aishell_2_test(↓)| wenetspeech_net(↓) | wenetspeech_meeting(↓) | HKUST_dev(↓)|
45
+ |:----------------:|:-------:|:-----------:|:-----------:|:--------:|:-----------:|:-------:|
46
+ | whisper-large-v3 | Chinese | 8.085 | 5.475 | 11.72 | 20.15 | 28.597 |
47
+ | Belle-whisper-large-v3-zh | Chinese | 2.781 | 3.786 | 8.865 | 11.246 | 16.440 |
48
+
49
+ It is worth mentioning that compared to Belle-whisper-large-v2-zh, Belle-whisper-v3-zh has a significant improvement in complex acoustic scenes(such as wenetspeech_meeting).
50
+
51
+ ## Citation
52
+
53
+ Please cite our paper and github when using our code, data or model.
54
+
55
+ ```
56
+ @misc{BELLE,
57
+ author = {BELLEGroup},
58
+ title = {BELLE: Be Everyone's Large Language model Engine},
59
+ year = {2023},
60
+ publisher = {GitHub},
61
+ journal = {GitHub repository},
62
+ howpublished = {\url{https://github.com/LianjiaTech/BELLE}},
63
+ }
64
+ ```