|
--- |
|
license: apache-2.0 |
|
base_model: |
|
- coqui/XTTS-v2 |
|
--- |
|
# Auralis 🌌 |
|
|
|
## Model Details 🛠️ |
|
|
|
**Model Name:** Auralis |
|
|
|
**Model Architecture:** Based on [Coqui XTTS-v2](https://huggingface.co/coqui/XTTS-v2) |
|
|
|
**License:** |
|
- license: Apache 2.0 |
|
- base_model: XTTS-v2 Components [Coqui AI License](https://coqui.ai/cpml) |
|
|
|
**Language Support:** English, Spanish, French, German, Italian, Portuguese, Polish, Turkish, Russian, Dutch, Czech, Arabic, Chinese (Simplified), Hungarian, Korean, Japanese, Hindi |
|
|
|
**Developed by:** [AstraMind.ai](https://www.astramind.ai) |
|
|
|
**GitHub:** [AstraMind AI](https://github.com/astramind-ai/Auralis/tree/main) |
|
|
|
**Primary Use Case:** Text-to-Speech (TTS) generation for real-world applications, including books, dialogues, and multilingual tasks. |
|
|
|
--- |
|
|
|
## Model Description 🚀 |
|
|
|
Auralis transforms text into natural, high-quality speech with exceptional speed and scalability. It is powered by [Coqui XTTS-v2](https://huggingface.co/coqui/XTTS-v2) and optimized for both consumer-grade and high-performance GPUs. Auralis is designed to meet real-world needs like long-text processing, voice cloning, and concurrent request handling. |
|
|
|
### Key Features: |
|
- **Warp-Speed Processing:** Generate speech for an entire novel (e.g., Harry Potter) in ~10 minutes. |
|
- **Hardware Friendly:** Requires <10GB VRAM on a single NVIDIA RTX 3090. |
|
- **Scalable:** Handles multiple requests simultaneously. |
|
- **Streaming:** Seamlessly processes long texts in a streaming format. |
|
- **Custom Voices:** Enables voice cloning from short reference audio. |
|
|
|
--- |
|
|
|
## Quick Start ⭐ |
|
|
|
```python |
|
from auralis import TTS, TTSRequest |
|
|
|
# Initialize the model |
|
tts = TTS().from_pretrained("AstraMindAI/xtts2-gpt") |
|
|
|
# Create a TTS request |
|
request = TTSRequest( |
|
text="Hello Earth! This is Auralis speaking.", |
|
speaker_files=["reference.wav"] |
|
) |
|
|
|
# Generate speech |
|
output = tts.generate_speech(request) |
|
output.save("output.wav") |
|
``` |
|
|
|
--- |
|
|
|
## Ebook Generation 📚 |
|
|
|
Auralis converting ebooks into audio formats at lightning speed. For Python script, check out [ebook_audio_generator.py](https://github.com/astramind-ai/Auralis/blob/main/examples/vocalize_a_ebook.py). |
|
|
|
```python |
|
def process_book(chapter_file: str, speaker_file: str): |
|
# Read chapter |
|
with open(chapter_file, 'r') as f: |
|
chapter = f.read() |
|
|
|
# You can pass the whole book, auralis will take care of splitting |
|
|
|
request = TTSRequest( |
|
text=chapter, |
|
speaker_files=[speaker_file], |
|
audio_config=AudioPreprocessingConfig( |
|
enhance_speech=True, |
|
normalize=True |
|
) |
|
) |
|
|
|
output = tts.generate_speech(request) |
|
|
|
output.play() |
|
output.save("chapter_output.wav") |
|
|
|
# Example usage |
|
process_book("chapter1.txt", "reference_voice.wav") |
|
``` |
|
|
|
--- |
|
|
|
## Intended Use 🌟 |
|
|
|
Auralis is designed for: |
|
- **Content Creators:** Generate audiobooks, podcasts, or voiceovers. |
|
- **Developers:** Integrate TTS into applications via a simple Python API. |
|
- **Accessibility**: Providing audio versions of digital content for people with visual or reading difficulties. |
|
- **Multilingual Scenarios:** Convert text to speech in multiple supported languages. |
|
|
|
--- |
|
|
|
## Performance 📊 |
|
|
|
**Benchmarks on NVIDIA RTX 3090:** |
|
- Short phrases (<100 characters): ~1 second |
|
- Medium texts (<1,000 characters): ~5-10 seconds |
|
- Full books (~100,000 characters): ~10 minutes |
|
|
|
**Memory Usage:** |
|
- Base VRAM: ~4GB |
|
- Peak VRAM: ~10GB |
|
|
|
--- |
|
|
|
## Model Features 🛸 |
|
|
|
1. **Speed & Efficiency:** |
|
- Smart batching for rapid processing of long texts. |
|
- Memory-optimized for consumer GPUs. |
|
|
|
2. **Easy Integration:** |
|
- Python API with support for synchronous and asynchronous workflows. |
|
- Streaming mode for continuous playback during generation. |
|
|
|
3. **Audio Quality Enhancements:** |
|
- Background noise reduction. |
|
- Voice clarity and volume normalization. |
|
- Customizable audio preprocessing. |
|
|
|
4. **Multilingual Support:** |
|
- Automatic language detection. |
|
- High-quality speech in 15+ languages. |
|
|
|
5. **Customization:** |
|
- Voice cloning using short reference clips. |
|
- Adjustable parameters for tone, pacing, and language. |
|
|
|
--- |
|
|
|
## Limitations & Ethical Considerations ⚠️ |
|
|
|
- **Voice Cloning Risks:** Auralis supports voice cloning, which may raise ethical concerns about misuse. Use responsibly and ensure proper consent. |
|
- **Accent Limitations:** While robust for many languages, accents and intonations may vary based on the input. |
|
|
|
--- |
|
|
|
## Citation 📜 |
|
|
|
If you use Auralis in your research or projects, please cite: |
|
|
|
```bibtex |
|
@misc{auralis2024, |
|
author = {AstraMind AI}, |
|
title = {Auralis: High-Performance Text-to-Speech Engine}, |
|
year = {2024}, |
|
url = {https://huggingface.co/AstraMindAI/auralis} |
|
} |
|
``` |
