Spaces:

Hansimov
/

hf-llm-api

Runtime error

App Files Files Community

hf-llm-api / apis /chat_api.py

Commit History

:zap: [Enhance] New models: mistral-7b and openchat-3.5

e916990

Hansimov commited on Dec 20, 2023

:zap: [Enhance] Default models and max_new_tokens

6aa8b86

Hansimov commited on Dec 20, 2023

:gem: [Feature] New ArgParser: Specify server ip, port and running mode

e28221f

Hansimov commited on Dec 19, 2023

:gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call

3a09006

Hansimov commited on Dec 19, 2023