GEITje-7B-ultra-GGUF / Modelfile_q5_k_m
BramVanroy's picture
Upload Modelfile_q5_k_m with huggingface_hub
28859e1 verified
raw
history blame
279 Bytes
FROM ./geitje-7b-ultra-q5_k_m.gguf
TEMPLATE """{{- if .System }}
<|system|>
{{ .System }}</s>
{{ end }}
<|user|>
{{ .Prompt }}</s>
<|assistant|>
"""
PARAMETER num_ctx 8192
PARAMETER stop "<|system|>"
PARAMETER stop "<|user|>"
PARAMETER stop "<|assistant|>"
PARAMETER stop "</s>"