Make sure that the user can choose an LLM that automatically creates the chat title.

#427
by yumenojmd - opened

I mainly use CohereForAI/c4ai-command-r-plus, but lately I've been having trouble generating chat titles properly. I think it's probably because we're dealing with content that would be limited in other models.
I want the LLM of the user's choice to be used to generate the chat title. Otherwise, I'd like to let the user choose an LLM for chat title generation.

deleted

used for title generation is llama3-8B - if you can choose at will, doesn't it mean that even if you generate a title, you have to use a 105B model such as cR+?

Sign up or log in to comment