Access to model mistralai/Pixtral-12B-2409 is restricted.
""docker run --name pixtral --gpus "device=1" \
-v ~/.cache/huggingface_pixtral:/root/.cache/huggingface
-e HUGGINGFACE_HUB_TOKEN="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"
-p 8500:8000 --ipc=host
docker.io/vllm/vllm-openai:v0.6.6
--model mistralai/Pixtral-12B-2409
--gpu-memory-utilization 0.98
--max-model-len 32768
--config-format mistral
--load-format mistral
--tokenizer-mode mistral"" Currently, I am using this command to launch the Pixtral model with vLLM. It worked fine before, but I keep encountering the issue shown in the screenshot. Is there a solution for this?
I have already used the command to log in, but I am still encountering the issue shown in the screenshot.
Change the you access token settings and give it read and write permission,
first login to hugging face cli and then execute the same command