Spaces:
Running
on
T4
Running
on
T4
Does it deployed on T4!
#4
by
mnwato
- opened
Hi, How did CohereForAI/aya-expanse-32b infered on T4 with 16GB of VRAM!
Did you deployed a quantized version? If yes, which quant?
hey we don't use T4 for aya expanse inference. We use our API. T4 is required for a TTS model inference.
shivalikasingh
changed discussion status to
closed