Senku-70B-iMat.GGUF / README.md
dranger003's picture
Update README.md
72146a8 verified
|
raw
history blame
367 Bytes
metadata
license: cc-by-2.0
library_name: gguf
pipeline_tag: text-generation

GGUF importance matrix (imatrix) quants for https://huggingface.co/ShinojiResearch/Senku-70B-Full

Prompt templates: ChatML (recommended), Mistral

<|im_start|>system
{instructions}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
 
[INST] {prompt} [/INST]