FriendliAI
/

Llama-2-7b-chat-hf-fp8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

yunmorning commited on Apr 18

Commit

c31cb5b

•

1 Parent(s): 8d17b2d

Remove HF_TOKEN

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -92,7 +92,6 @@ docker run \
   -p 8000:8000 \
   -v ~/.cache/huggingface:/root/.cache/huggingface \
   -e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
-  -e HF_TOKEN="YOUR HUGGING FACE TOKEN" \
   registry.friendli.ai/trial \
     --web-server-port 8000 \
     --hf-model-name meta-llama/Llama-2-7b-chat-hf-fp8

   -p 8000:8000 \
   -v ~/.cache/huggingface:/root/.cache/huggingface \
   -e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
   registry.friendli.ai/trial \
     --web-server-port 8000 \
     --hf-model-name meta-llama/Llama-2-7b-chat-hf-fp8