sandbox-ai
/

Llama-3.1-Tango-8b-int4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

tatakof commited on 16 days ago

Commit

f6585d5

•

1 Parent(s): bb87e93

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -97,7 +97,7 @@ This code has been tested on Transformers v4.44.0, torch v2.4.0 and 2 A100 80GB
 # Use a pipeline as a high-level helper
 from transformers import pipeline
-pipe = pipeline("text-generation", model="sandbox-ai/Llama-3.1-Tango-8b-f16")
 ```

 # Use a pipeline as a high-level helper
 from transformers import pipeline
+pipe = pipeline("text-generation", model="sandbox-ai/Llama-3.1-Tango-8b-int4")
 ```