predibase
/

Llama-2-7b-hf-dequantized

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

arnavgrg commited on Apr 17

Commit

4f8aab0

•

1 Parent(s): 7c87549

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ import torch
 from transformers import AutoModelForCausalLM
 model = AutoModelForCausalLM.from_pretrained(
-  "predibase/Llama-2-7b-dequantized",
   device_map="auto",
   torch_dtype=torch.float16,
 )

 from transformers import AutoModelForCausalLM
 model = AutoModelForCausalLM.from_pretrained(
+  "predibase/Llama-2-7b-hf-dequantized",
   device_map="auto",
   torch_dtype=torch.float16,
 )