| FROM ./test1.gguf | |
| TEMPLATE """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. | |
| {{ if .System }}### Instruction: | |
| {{ .System }}{{ end }} | |
| {{ if .Prompt }}### Input: | |
| {{ .Prompt }}{{ end }} | |
| ### Response: | |
| """ | |
| PARAMETER stop "### Response:" | |
| PARAMETER stop "### Instruction:" | |
| PARAMETER stop "### Input:" | |
| PARAMETER stop "Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request." | |
| PARAMETER num_predict 200 | |