trip-fontaine
commited on
Commit
•
561b47e
1
Parent(s):
aa5793b
readme update
Browse files
README.md
CHANGED
@@ -620,12 +620,12 @@ The model has been tested for both in-distribution (Common Voice 17 and Multilin
|
|
620 |
|
621 |
| Model Name | RTFx | Common Voice 17 | Multilingual Librispeech | Voxpopuli | Fleurs |
|
622 |
| :----------------: | :-----: | :-------------: | :----------------------: | :-------: | :----: |
|
623 |
-
| distil-large-v3-fr | 310.127 | 12.681 | 5.865 | 10.851 | 7.984 |
|
624 |
| whisper-tiny | 280.576 | 56.757 | 37.512 | 32.505 | 46.173 |
|
625 |
| whisper-base | 261.235 | 42.447 | 25.2 | 26.434 | 27.851 |
|
626 |
| whisper-small | 249.676 | 22.469 | 14.097 | 14.61 | 14.283 |
|
627 |
| whisper-medium | 170.9 | 15.432 | 9.602 | 11.92 | 9.155 |
|
628 |
| whisper-large-v3 | 150.719 | 11.024 | 4.783 | 9.948 | 5.624 |
|
|
|
629 |
|
630 |
*the above datasets correspond to test splits
|
631 |
|
@@ -635,12 +635,13 @@ The model has been tested for both in-distribution (Common Voice 17 and Multilin
|
|
635 |
|
636 |
| Model Name | RTFx | [long-form test set](https://huggingface.co/datasets/eustlb/french-long-form-test) |
|
637 |
| :----------------: | :-----: | :--------------------------------------------------------------------------------: |
|
638 |
-
| distil-large-v3-fr | 169.692 | 11.385 |
|
639 |
| whisper-tiny | 125.367 | 28.277 |
|
640 |
| whisper-base | 110.139 | 19.228 |
|
641 |
| whisper-small | 83.417 | 12.467 |
|
642 |
| whisper-medium | 56.677 | 10.772 |
|
643 |
| whisper-large-v3 | 41.805 | 9.073 |
|
|
|
|
|
644 |
|
645 |
|
646 |
### Inference speed
|
@@ -682,6 +683,5 @@ If you use this model, please consider citing the [Distil-Whisper paper](https:/
|
|
682 |
* Hugging Face 🤗 [Transformers](https://github.com/huggingface/transformers) for the model integration
|
683 |
* [Georgi Gerganov](https://huggingface.co/ggerganov) for the Whisper cpp integration
|
684 |
* [Joshua Lochner](https://huggingface.co/xenova) for the Transformers.js integration
|
685 |
-
* [Laurent Mazare](https://huggingface.co/lmz) for the Candle integration
|
686 |
* [Vaibhav Srivastav](https://huggingface.co/reach-vb) for Distil-Whisper distribution
|
687 |
* [Raghav Sonavane](https://huggingface.co/rsonavane/distil-whisper-large-v2-8-ls) for an early iteration of Distil-Whisper on the LibriSpeech datasets
|
|
|
620 |
|
621 |
| Model Name | RTFx | Common Voice 17 | Multilingual Librispeech | Voxpopuli | Fleurs |
|
622 |
| :----------------: | :-----: | :-------------: | :----------------------: | :-------: | :----: |
|
|
|
623 |
| whisper-tiny | 280.576 | 56.757 | 37.512 | 32.505 | 46.173 |
|
624 |
| whisper-base | 261.235 | 42.447 | 25.2 | 26.434 | 27.851 |
|
625 |
| whisper-small | 249.676 | 22.469 | 14.097 | 14.61 | 14.283 |
|
626 |
| whisper-medium | 170.9 | 15.432 | 9.602 | 11.92 | 9.155 |
|
627 |
| whisper-large-v3 | 150.719 | 11.024 | 4.783 | 9.948 | 5.624 |
|
628 |
+
| distil-large-v3-fr | 310.127 | 12.681 | 5.865 | 10.851 | 7.984 |
|
629 |
|
630 |
*the above datasets correspond to test splits
|
631 |
|
|
|
635 |
|
636 |
| Model Name | RTFx | [long-form test set](https://huggingface.co/datasets/eustlb/french-long-form-test) |
|
637 |
| :----------------: | :-----: | :--------------------------------------------------------------------------------: |
|
|
|
638 |
| whisper-tiny | 125.367 | 28.277 |
|
639 |
| whisper-base | 110.139 | 19.228 |
|
640 |
| whisper-small | 83.417 | 12.467 |
|
641 |
| whisper-medium | 56.677 | 10.772 |
|
642 |
| whisper-large-v3 | 41.805 | 9.073 |
|
643 |
+
| distil-large-v3-fr | 169.692 | 11.385 |
|
644 |
+
|
645 |
|
646 |
|
647 |
### Inference speed
|
|
|
683 |
* Hugging Face 🤗 [Transformers](https://github.com/huggingface/transformers) for the model integration
|
684 |
* [Georgi Gerganov](https://huggingface.co/ggerganov) for the Whisper cpp integration
|
685 |
* [Joshua Lochner](https://huggingface.co/xenova) for the Transformers.js integration
|
|
|
686 |
* [Vaibhav Srivastav](https://huggingface.co/reach-vb) for Distil-Whisper distribution
|
687 |
* [Raghav Sonavane](https://huggingface.co/rsonavane/distil-whisper-large-v2-8-ls) for an early iteration of Distil-Whisper on the LibriSpeech datasets
|