mobiuslabsgmbh
/

Llama-2-7b-hf-4bit_g64-HQQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

mobicham commited on Nov 20, 2023

Commit

c25e831

•

1 Parent(s): 9b5ec91

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -22,9 +22,9 @@ model = LlamaHQQ.from_quantized(model_id)
 You can then use the model for text generation or to reproduce the benchmark numbers.
-*Limitations*:
--Only supports a single GPU runtime
--The model is not compatible with HuggingFace's PEFT.

 You can then use the model for text generation or to reproduce the benchmark numbers.
+*Limitations*: <br>
+-Only supports a single GPU runtime.<br>
+-Not compatible with HuggingFace's PEFT.<br>