TheBloke
/

dolphin-2.1-mistral-7B-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

dolphin-2.1-mistral-7B-AWQ

1 contributor

History: 5 commits

TheBloke's picture

Update for Transformers AWQ support

143e975 12 months ago