mobiuslabsgmbh
/

Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

mobicham commited on Dec 11, 2023

Commit

7d65ce3

•

1 Parent(s): ac9c768

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ inference: false
 pipeline_tag: text-generation
 ---
 ## Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ
-This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqq_blog/
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python

 pipeline_tag: text-generation
 ---
 ## Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ
+This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 4-bit via Half-Quadratic Quantization (HQQ).
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python