Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
yusufs
/
vllm-inference
like
0
Paused
App
Files
Files
493a5f1
vllm-inference
1 contributor
History:
27 commits
yusufs
feat(hf_token): set hf token during build
493a5f1
about 1 month ago
.gitignore
Safe
5 Bytes
feat(first-commit): follow examples and tutorials
about 1 month ago
Dockerfile
Safe
1.17 kB
feat(hf_token): set hf token during build
about 1 month ago
README.md
Safe
1.67 kB
feat(download-model): add download model at runtime
about 1 month ago
download_model.py
Safe
384 Bytes
feat(hf_token): set hf token during build
about 1 month ago
main.py
Safe
6.7 kB
feat(parse): parse output
about 1 month ago
openai_compatible_api_server.py
Safe
24.4 kB
feat(endpoint): add prefix /api on each endpoint
about 1 month ago
poetry.lock
Safe
426 kB
feat(refactor): move the files to root
about 1 month ago
pyproject.toml
Safe
416 Bytes
feat(refactor): move the files to root
about 1 month ago
requirements.txt
Safe
9.99 kB
feat(first-commit): follow examples and tutorials
about 1 month ago
run.sh
Safe
684 Bytes
feat(download-model): add download model at runtime
about 1 month ago