Compiled engines for running Whisper with TRT LLM for much faster inference.
![baseten's profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten
company
AI & ML interests
None defined yet.
Collections
1
models
462
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Mistral-7B-Instruct-v0.2-A100-2a115dae-TP2-lora
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Mistral-7B-Instruct-v0.2-A100-2a115dae-TP1-lora
Updated
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/llama3-8b-i7000-o1000-with-lora-trtllm-0.11.0.dev2024052100-h100-mig-tp1-fixed-2
Updated
•
4
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/HR-finetune
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Mistral-7B-Instruct-v0.2-A100-2a115dae-TP2
Updated
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-Mistral-7B-Instruct-v0.2-A100-2a115dae-TP1
Updated
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-bloom-560m-A100-2a115dae-TP2
Updated
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/btest-bloom-560m-A100-2a115dae-TP1
Updated
•
8
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/llama3-70b-instruct_fp8_tp4_i7168_o1024_bs40_fmha-tllm_0.11.0.dev2024061800
Updated
•
21
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1679264816869-62eaffb6d22ea50786b2a30d.jpeg)
baseten/sdxl-1.0-trt-8.6.1-dynamic-sizing-with-refine-h100-mig
Updated
datasets
None public yet