hpcgroup
/

hpc-coder-v2-6.7b-Q4_K_S-GGUF

Inference Endpoints

Model card Files Files and versions Community

daniellnichols commited on Jul 18

Commit

ce1822d

•

1 Parent(s): deee96b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,5 +19,5 @@ See the [llama.cpp repo](https://github.com/ggerganov/llama.cpp) for installatio
 You can then use the model as:
 ```bash
-llama-cli --hf-repo hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF --hf-file hpc-coder-v2-6.7b-q4_k_s.gguf -r "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:" --in-prefix "\n" --in-suffix "### Response:\n" -c 8096
 ```

 You can then use the model as:
 ```bash
+llama-cli --hf-repo hpcgroup/hpc-coder-v2-6.7b-Q4_K_S-GGUF --hf-file hpc-coder-v2-6.7b-q4_k_s.gguf -r "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:" --in-prefix "\n" --in-suffix "\n### Response:\n" -c 8096 -p "your prompt here"
 ```