Whisper Engines
Collection
Compiled engines for running Whisper with TRT LLM for much faster inference.
•
243 items
•
Updated
Het Trivedi
htrivedi99
AI & ML interests
None yet
Recent Activity
updated
a collection
about 1 month ago
Whisper Engines
updated
a model
about 1 month ago
baseten/whisper_trt_large_v3_NVIDIA_T4_0_13_0
updated
a collection
about 2 months ago
Whisper Engines
Organizations
htrivedi99's activity
updated
a
collection
about 1 month ago
updated
a
model
about 1 month ago
updated
a
collection
about 2 months ago
updated
a
model
about 2 months ago
updated
5
models
6 months ago
updated
8
models
7 months ago
baseten/llama3-8b-i7000-o1000-with-lora-trtllm-0.11.0.dev2024052100-h100-mig-tp1-fixed-2
Updated
•
12
baseten/sdxl-1.0-trt-8.6.1-dynamic-sizing-with-refine-h100-mig
Updated
baseten/sdxl-1.0-trt-8.6.1-dynamic-sizing-h100-mig
Updated
baseten/writer_palmyra_med_70b_8k_i7192_o2048_bs42_fp16_A100_tp4-tllm_0.9.0.dev2024040200
Updated
•
10
baseten/slingshot-tokenizer
Updated
baseten/writer_palmyra_med_70b_32K_i25000_o7000_bs16_tp4_A100_0.9.0.dev2024040200
Updated
•
14
baseten/writer_llama3_70b_32K_i25000_o7000_bs16_tp4_A100_0.11.0.dev2024052100
Updated
•
14
baseten/mistral_i1600_o600_bs32_fp16_tp2_lora_tllm_0.11.0.dev2024052100
Updated
•
13
updated
3
models
8 months ago