Panchovix
/

airoboros-l2-70b-gpt4-1.4.1_5.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

airoboros-l2-70b-gpt4-1.4.1_5.0bpw-h6-exl2 / README.md

Panchovix's picture

Update README.md

5231bcb 12 months ago

|

No virus

101 Bytes

	---
	license: other
	---
	5 bit quantization of airoboros 70b 1.4.1, using exllama2.

	More info to come.