File size: 645 Bytes
3180cf5
3d09d93
 
 
 
 
 
3180cf5
 
 
 
 
ea032b5
 
3d09d93
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Prompt template:
```
[INST] Corrects and rephrase user text grammar errors delimited by triple backticks to standard English.
### Input: Text=\`\`\`she no went to market\`\`\` [/INST]
[INST] ### Output: She didn’t go the market. [/INST]
[INST] ### Input: Text=\`\`\`${input}\`\`\` [/INST]
[INST] ### Output:
```

To use the fine-tuned model, you need to get a downloadable link for the model from HF and update it accordingly in the shell script. 
For example:
```
MODEL_URL="https://huggingface.co/mzbac/mistral-grammar/resolve/main/Mistral-7B-Grammar-Checker-v1.1.2.Q5_K_M.gguf"
MODEL_FILE="Mistral-7B-Grammar-Checker-v1.1.2.Q5_K_M.gguf"
```