dranger003
/

c4ai-command-r7b-12-2024-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on 3 days ago

Commit

c9c968b

•

1 Parent(s): a8e103e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ pipeline_tag: text-generation
 ---
 2025-01-04: Support for cohere2 has now been merged into master [46be942](https://github.com/ggerganov/llama.cpp/commit/46be942214e295cd34660bbbd6b846155d1c36a0)
-GGUF version of [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024) from CohereForAI for testing until llama.cpp adds official support.
 ```sh
 ./build/bin/llama-cli -fa --no-display-prompt -c 0 -m ggml-c4ai-command-r-7b-12-2024-q4_k.gguf -p "<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Tell me all about yourself.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_RESPONSE|>"

 ---
 2025-01-04: Support for cohere2 has now been merged into master [46be942](https://github.com/ggerganov/llama.cpp/commit/46be942214e295cd34660bbbd6b846155d1c36a0)
+GGUF version of [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024) from CohereForAI.
 ```sh
 ./build/bin/llama-cli -fa --no-display-prompt -c 0 -m ggml-c4ai-command-r-7b-12-2024-q4_k.gguf -p "<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Tell me all about yourself.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_RESPONSE|>"