mobiuslabsgmbh
/

Llama-2-13b-hf-4bit_g64-HQQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

mobicham commited on Nov 25, 2023

Commit

dcf12ef

•

1 Parent(s): fbb3ba7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ This model matches the quality of AWQ (same perplexity) but didn't use any data
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python
-from hqq.models.llama import LlamaHQQ
 import transformers
 model_id = 'mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ'

 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python
+from hqq.models.llama_hf import LlamaHQQ
 import transformers
 model_id = 'mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ'