mobiuslabsgmbh
/

Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

mobicham commited on Dec 11, 2023

Commit

ac9c768

•

1 Parent(s): 7ce056f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ train: false
 inference: false
 pipeline_tag: text-generation
 ---
-## Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ/
 This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqq_blog/
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:

 inference: false
 pipeline_tag: text-generation
 ---
+## Mixtral-8x7B-v0.1-hf-4bit_g64-HQQ
 This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 4-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqq_blog/
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows: