File size: 2,182 Bytes
bc83d38 442e1a3 1a367bf bc83d38 60f050c d8309af 60f050c bc83d38 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 |
---
license: cc-by-nc-4.0
language:
- kbd
datasets:
- anzorq/kbd_speech
pipeline_tag: text-to-speech
---
# MMS-TTS Fine-tuned for Kabardian (Speaker: Sokhov Murat)
This repository contains a fine-tuned version of Facebook's MMS-TTS model, adapted for generating speech in the Kabardian language. The model is trained on a dataset of audio recordings by the speaker Sokhov Murat.
## Model Details
- Base Model: [facebook/mms-tts](https://huggingface.co/facebook/mms-tts)
- Fine-tuned on: [anzorq/kbd_speech](https://huggingface.co/datasets/anzorq/kbd_speech) dataset
- Training steps: 5,100
- Speaker: [Sokhov Murat](https://www.instagram.com/carbatay)
- Language: Circassian (Kabardian)
## Usage
To use this model for text-to-speech generation, you can leverage the `pipeline` functionality from the Transformers library. Here's an example:
```python
from transformers import pipeline
import scipy
model_id = "anzorq/mms_finetune_kbd_murat"
synthesiser = pipeline("text-to-speech", model_id, device=0) # add device=0 if you want to use a GPU
text = "дауэ ущыт?"
speech = synthesiser(text)
# Save the generated audio to a file
scipy.io.wavfile.write("finetuned_output.wav", rate=speech["sampling_rate"], data=speech["audio"][0])
```
This code will generate an audio file `finetuned_output.wav` containing the speech synthesis for the provided Kabardian text.
## Notes
- Fine-tuned following the guide at https://github.com/ylacombe/finetune-hf-vits
- Since no pre-trained MMS-TTS model was available for Kabardian, we fine-tuned a model for Chechen, which has the closest character set to Kabardian.
- Do not use in production. This model's performance is considerably worse than that of the fine-tuned VITS model [anzorq/kbd-vits-tts-male](https://huggingface.co/anzorq/kbd-vits-tts-male) for Kabardian text-to-speech.
## License
The original MMS-TTS model by Meta is licensed under the CC-BY-NC-4.0 License. This fine-tuned version inherits the same license.
## Acknowledgments
- [AI at Meta](https://ai.meta.com//) for the original MMS-TTS model.
- [Sokhov Murat](https://www.instagram.com/carbatay) for providing the audio recordings used for fine-tuning. |