Specific models may not be compatible.

#364
by shapermindai - opened

While using Pygmalion/pygmalion-1.3b I noticed that the model would generate text successfully, but would not respond to the user. This means the prompts must be preformatted differently. This could be made easier by adding a variable "PROMPT_FORMAT" where the developer can input different prompt types, such as "You are a helpful assistant. Respond to [prompt]," or "You are chatting with the user. User: [prompt] You: respond." It should not be too difficult to implement this.

Sign up or log in to comment