Whisper models for CTranslate2 with quantization INT8
This repository contains the conversion of OpenAI Whisper models to the CTranslate2 model format.
Conversion details
The original model was converted with the following command:
ct2-transformers-converter --model openai/<model name> --output_dir faster-<model name>-int8 \
--copy_files tokenizer.json --quantization int8
Note that the model weights are saved in INT8.
Models sources
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The HF Inference API does not support automatic-speech-recognition models for ctranslate2 library.