Matthijs commited on
Commit
ae32963
1 Parent(s): 0e856d5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+ license: cc-by-nc-4.0
4
+ tags:
5
+ - mms
6
+ - vits
7
+ pipeline_tag: text-to-speech
8
+ ---
9
+
10
+ # Massively Multilingual Speech (MMS) : Text-to-Speech Models
11
+
12
+ This repository contains the **Korean (kor)** language text-to-speech (TTS) model checkpoint.
13
+
14
+ This model is part of Facebook's [Massively Multilingual Speech](https://arxiv.org/abs/2305.13516) project, aiming to
15
+ provide speech technology across a diverse range of languages. You can find more details about the supported languages
16
+ and their ISO 639-3 codes in the [MMS Language Coverage
17
+ Overview](https://dl.fbaipublicfiles.com/mms/misc/language_coverage_mms.html).
18
+
19
+ ## Usage
20
+
21
+ Using this checkpoint from Hugging Face Transformers:
22
+
23
+ ```python
24
+ from transformers import VitsModel, VitsMmsTokenizer
25
+ import torch
26
+
27
+ model = VitsModel.from_pretrained("Matthijs/mms-tts-kor")
28
+ tokenizer = VitsMmsTokenizer.from_pretrained("Matthijs/mms-tts-kor")
29
+
30
+ text = "some example text in the Korean language"
31
+ inputs = tokenizer(text, return_tensors="pt")
32
+
33
+ with torch.no_grad():
34
+ output = model(**inputs)
35
+
36
+ from IPython.display import Audio
37
+ Audio(output.audio[0], rate=16000)
38
+ ```
39
+
40
+ Note: For this checkpoint, the input text must be converted to the Latin alphabet first using the [uroman](https://github.com/isi-nlp/uroman) tool.
41
+
42
+ ## Model credits
43
+
44
+ This model was developed by Vineel Pratap et al. and is licensed as **CC-BY-NC 4.0**
45
+
46
+ @article{pratap2023mms,
47
+ title={Scaling Speech Technology to 1,000+ Languages},
48
+ author={Vineel Pratap and Andros Tjandra and Bowen Shi and Paden Tomasello and Arun Babu and Sayani Kundu and Ali Elkahky and Zhaoheng Ni and Apoorv Vyas and Maryam Fazel-Zarandi and Alexei Baevski and Yossi Adi and Xiaohui Zhang and Wei-Ning Hsu and Alexis Conneau and Michael Auli},
49
+ journal={arXiv},
50
+ year={2023}
51
+ }