add history of conversation to prompt
e3f7cd8
makaveli10
commited on
Spaces:
Paused
Paused
Commit History
send llm response with eos
3a0cae9
makaveli10
commited on
integrate whisperspeech
16388cf
makaveli10
commited on
optimizations
9dcd6a2
makaveli10
commited on
add prompt formating
ea46c22
unverified
makaveli
commited on
Update llm_service.py to tensorrt-llm 0.7.1
855f306
unverified
makaveli
commited on
add whisper output to queue for llm process
f1e930a
makaveli10
commited on
add sleep to backg thread
e5e84e9
makaveli10
commited on
add multiprocess communication
7cc82ad
makaveli10
commited on