|
--- |
|
title: Seamless Streaming |
|
emoji: 📞 |
|
colorFrom: blue |
|
colorTo: yellow |
|
sdk: docker |
|
pinned: false |
|
suggested_hardware: t4-medium |
|
--- |
|
|
|
# Seamless Streaming demo |
|
## Running on HF spaces |
|
You can simply duplicate the space to run it. |
|
|
|
## Running locally |
|
### Install backend seamless_server dependencies |
|
|
|
> [!NOTE] |
|
> Please note: we *do not* recommend running the model on CPU. CPU inference will be slow and introduce noticable delays in the simultaneous translation. |
|
|
|
> [!NOTE] |
|
> The example below is for PyTorch stable (2.1.1) and variant cu118. |
|
> Check [here](https://pytorch.org/get-started/locally/) to find the torch/torchaudio command for your variant. |
|
> Check [here](https://github.com/facebookresearch/fairseq2#variants) to find the fairseq2 command for your variant. |
|
|
|
If running for the first time, create conda environment and install the desired torch version. Then install the rest of the requirements: |
|
``` |
|
cd seamless_server |
|
conda create --yes --name smlss_server python=3.8 libsndfile==1.0.31 |
|
conda activate smlss_server |
|
conda install --yes pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia |
|
pip install fairseq2 --pre --extra-index-url https://fair.pkg.atmeta.com/fairseq2/whl/nightly/pt2.1.1/cu118 |
|
pip install -r requirements.txt |
|
``` |
|
|
|
### Install frontend streaming-react-app dependencies |
|
``` |
|
conda install -c conda-forge nodejs |
|
cd streaming-react-app |
|
npm install |
|
npm run build # this will create the dist/ folder |
|
``` |
|
|
|
|
|
### Running the server |
|
|
|
The server can be run locally with uvicorn below. |
|
Run the server in dev mode: |
|
|
|
``` |
|
cd seamless_server |
|
uvicorn app_pubsub:app --reload --host localhost |
|
``` |
|
|
|
Run the server in prod mode: |
|
|
|
``` |
|
cd seamless_server |
|
uvicorn app_pubsub:app --host 0.0.0.0 |
|
``` |
|
|
|
To enable additional logging from uvicorn pass `--log-level debug` or `--log-level trace`. |
|
|
|
|
|
### Debuging |
|
|
|
If you enable "Server Debug Flag" when starting streaming from the client, this enables extensive debug logging and it saves audio files in /debug folder. |
