Spaces:

yusufs
/

vllm-inference

Paused

App Files Files

1 contributor

History: 47 commits

yusufs's picture

feat(runner.sh): add specific task and code revision

dc19c1d 8 days ago

.gitignore

19 Bytes

feat(download_model.py): remove download_model.py during build, it causing big image size about 1 month ago
Dockerfile

1.32 kB

feat(runner.sh): using runner.sh to select llm in the run time 14 days ago
README.md

1.73 kB

feat(add-model): always download model during build, it will be cached in the consecutive builds about 1 month ago
download_model.py

700 Bytes

feat(add-model): always download model during build, it will be cached in the consecutive builds about 1 month ago
main.py

6.7 kB

feat(parse): parse output about 1 month ago
openai_compatible_api_server.py

24.4 kB

feat(dep_sizes.txt): removes dep_sizes.txt during build, it not needed about 1 month ago
poetry.lock

426 kB

feat(refactor): move the files to root about 1 month ago
pyproject.toml

416 Bytes

feat(refactor): move the files to root about 1 month ago
requirements.txt

9.99 kB

feat(first-commit): follow examples and tutorials about 1 month ago
run-llama.sh

1.53 kB

feat(seed): Random seed for reproducibility. 14 days ago
run-sailor.sh

1.85 kB

feat(seed): Random seed for reproducibility. 14 days ago
runner.sh

1.73 kB

feat(runner.sh): add specific task and code revision 8 days ago