Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
# You can use any model that available to you and deployed on Hugging Face with compatible API | |
# X_NAME variables are optional for HuggingFace API you can use them for your convenience | |
# Make sure your key has permission to use all models | |
# Set up you key here: https://huggingface.co/docs/api-inference/en/quicktour#get-your-api-token | |
HF_API_KEY=hf_YOUR_HUGGINGFACE_API_KEY | |
# For example you can try public Inference API endpoint for Meta-Llama-3-70B-Instruct model | |
# This model quiality is comparable with GPT-4 | |
# But public API has strict limit for output tokens, so it is very hard to use it for this usecase | |
# You can use your private API endpoint for this model | |
# Or use any other Hugging Face model that supports Messages API | |
# Don't forget to add '/v1' to the end of the URL | |
LLM_URL=https://api-inference.huggingface.co/models/meta-llama/Meta-Llama-3-70B-Instruct/v1 | |
LLM_TYPE=HF_API | |
LLM_NAME=Meta-Llama-3-70B-Instruct | |
# The Open AI whisper family with more models is available on HuggingFace: | |
# https://huggingface.co/collections/openai/whisper-release-6501bba2cf999715fd953013 | |
# You can also use any other compatible STT model from HuggingFace | |
STT_URL=https://api-inference.huggingface.co/models/openai/whisper-tiny.en | |
STT_TYPE=HF_API | |
STT_NAME=whisper-tiny.en | |
# You can use compatible TTS model from HuggingFace | |
# For example you can try public Inference API endpoint for Facebook MMS-TTS model | |
# In my experience OS TTS models from HF sound much more robotic than OpenAI TTS models | |
TTS_URL=https://api-inference.huggingface.co/models/facebook/mms-tts-eng | |
TTS_TYPE=HF_API | |
TTS_NAME=Facebook-mms-tts-eng | |