FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
58
Aditya Kulshrestha
Aditya02
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
10 days ago
microsoft/orca-agentinstruct-1M-v1
liked
a model
about 1 month ago
numind/NuExtract
liked
a Space
about 2 months ago
LLM360/TxT360
Organizations
None yet