mobicham commited on
Commit
70eff32
1 Parent(s): c25e831

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -10,7 +10,7 @@ This a version of the LLama2-7B model quantized to 4-bit via Half-Quadratic Quan
10
 
11
  To run the model, install the HQQ library from https://github.com/mobiusml/hqq/tree/main/code and load it as follows:
12
  ``` Python
13
- from hqq.models.llama import LlamaHQQ
14
  import transformers
15
 
16
  model_id = 'mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ'
 
10
 
11
  To run the model, install the HQQ library from https://github.com/mobiusml/hqq/tree/main/code and load it as follows:
12
  ``` Python
13
+ from hqq.models.llama import LlamaHQQ
14
  import transformers
15
 
16
  model_id = 'mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ'