muhtasham
/

llama3-ins-8b-int4-trt-llm

Inference Endpoints

Model card Files Files and versions Community

muhtasham commited on Apr 25

Commit

5413819

•

1 Parent(s): e877667

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -2,7 +2,7 @@
 ```bash
 git clone https://github.com/NVIDIA/TensorRT-LLM.git
-python ./TensorRT-LLM/examples/run.py --engine_dir=llama3engine_bf16_1gpu \
   --max_output_len 5 \
   --tokenizer_dir llama3-hf \
   --input_text "How do I count to nine in French?" \

 ```bash
 git clone https://github.com/NVIDIA/TensorRT-LLM.git
+python ./TensorRT-LLM/examples/run.py --engine_dir=./ \
   --max_output_len 5 \
   --tokenizer_dir llama3-hf \
   --input_text "How do I count to nine in French?" \