Hugging Face's logo

Spaces:
iseehf
/
hf-llm-api
Running

App Files Community
hf-llm-api

Commit History

:pencil: [Doc] Readme: New models, api key and no-stream mode, and models to support
cec776f

Hansimov commited on

:gem: [Feature] MessageComposer: Support openchat-3.5, and generalize preprocessing stages
30421b7

Hansimov commited on

:gem: [Feature] MessageStreamer: Support stop sequence and auto removal
4ba2ca6

Hansimov commited on

:zap: [Enhance] Update available models description
c769be6

Hansimov commited on

:zap: [Enhance] Support provide api_key with os env HF_TOKEN
bc384a3

Hansimov commited on

:gem: [Feature] Support call hf api with api_key via HTTP Bearer
2da6968

Hansimov commited on

:gem: [Feature] Support no-stream mode with dict response
d2b20f2

Hansimov commited on

:boom: [Fix] Suppress ping message by increasing ping interval
489b65b

Hansimov commited on

:pencil: [Doc] Readme for features, and comments for references
e820e51

Hansimov commited on

:zap: [Enhance] Cleaner logger output
b96cef7

Hansimov commited on

:zap: [Enhance] New models: mistral-7b and openchat-3.5
e916990

Hansimov commited on

:zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug
047008b

Hansimov commited on

:pencil: [Comment] References of requests params
395ee29

Hansimov commited on

:zap: [Enhance] Default models and max_new_tokens
6aa8b86

Hansimov commited on

:zap: [Enhance] API: Ensure temperature to be positive
3dfcb72

Hansimov commited on

:gem: [Feature] New ArgParser: Specify server ip, port and running mode
e28221f

Hansimov commited on

:boom: [Fix] Module apis not found
937bc45

Hansimov commited on

:gem: [Feature] New Github Actions: Sync to huggingface hub spaces
b1de8a0

Hansimov commited on

:pencil: [Doc] Readme: Features, deployment, api usage examples, and huggingface space configs
a16695d

Hansimov commited on

:gem: [Feature] New examples: chat with openai and post
f3b1386

Hansimov commited on

:gem: [Feature] Enable Docker deployment, and add requirements
5a836c3

Hansimov commited on

:gem: [Feature] New ChatAPIApp: Enable fastapi for openai format api call
3a09006

Hansimov commited on

:gem: [Feature] New MessageOutputer: Support Openai Stream format
eb3e513

Hansimov commited on

:gem: [Feature] New MessageStreamer: Enable requests inference api with requests
9f341cc

Hansimov commited on

:gem: [Feature] New enver: set_envs()
9bc229a

Hansimov commited on

:gem: [Feature] New MessageComposer: Merge and split messages in mixtral-instruct format
9e62d8e

Hansimov commited on

:gem: [Feature] New enver and logger system
5b642ff

Hansimov commited on