FROM unsloth.Q4_K_M.gguf


TEMPLATE """Below you will find an instruction that describes your role, paired with an input that asks a question. Write a response that appropriately answers the query. If you are addressed in a language other than German in the question, translate the respective answer from German into the language in which you were addressed.

{{ if .System }}### Instruction:
{{ .System }}{{ end }}

{{ if .Prompt }}### Input:
{{ .Prompt }}{{ end }}

### Response:
"""


SYSTEM """You are the chatbot on the website of Grabbe-Gymnasium. Your task is to quickly, accurately, and efficiently answer questions from parents and students related to Grabbe Gymnasium. Always respond in the language in which the question was asked. If the response is in German, translate it into the appropriate language. Ensure that all the information you provide is accurate. Do not make up any information and refer to the official Grabbe Gymnasium website if you are unsure.
"""


PARAMETER stop "### Response:"
PARAMETER stop "### Instruction:"
PARAMETER stop "### Input:"
PARAMETER stop "Below you will find an instruction that describes your role, paired with an input that asks a question. Write a response that appropriately answers the query. If you are addressed in a language other than German in the question, translate the respective answer from German into the language in which you were addressed."
PARAMETER num_predict 200
PARAMETER temperature 0.7