ibm-fms
/

llama-13b-accelerator

Inference Endpoints

Model card Files Files and versions Community

JRosenkranz commited on Apr 10

Commit

5b1f722

•

1 Parent(s): a60bde1

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -116,4 +116,6 @@ python fms-extras/scripts/paged_speculative_inference.py \
     --speculator_source=hf \
     --batch_input \
     --compile \
-```

     --speculator_source=hf \
     --batch_input \
     --compile \
+```
+Sample code can be found here: [sample code](https://github.com/foundation-model-stack/fms-extras/blob/main/scripts/paged_speculative_inference.py)