ibm-fms
/

llama-160m-accelerator

Inference Endpoints

Model card Files Files and versions Community

sahilsuneja commited on Jul 24, 2024

Commit

62caecb

•

1 Parent(s): d8be53a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -109,7 +109,7 @@ _Note: first prompt may be slower as there is a slight warmup time_
 #### start the server
 ```bash
-model=ibm-fms/codellama-34b-accelerator
 volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
 docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:latest --model-id $model
 ```

 #### start the server
 ```bash
+model=ibm-fms/llama-160m-accelerator
 volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
 docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:latest --model-id $model
 ```