Panchovix
/

airoboros-l2-70b-gpt4-1.4.1_5.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

airoboros-l2-70b-gpt4-1.4.1_5.0bpw-h6-exl2 / README.md

Panchovix's picture

Update README.md

5231bcb 11 months ago

|

No virus

101 Bytes

metadata

license: other

5 bit quantization of airoboros 70b 1.4.1, using exllama2.

More info to come.