dranger003
/

c4ai-command-r-v01-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Mar 15

Commit

4d0d193

•

1 Parent(s): 1ac51f3

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -4,7 +4,9 @@ pipeline_tag: text-generation
 library_name: gguf
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
-The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using a [wiki.train.raw](https://huggingface.co/datasets/wikitext).
 > C4AI Command-R is a research release of a 35 billion parameter highly performant generative model. Command-R is a large language model with open weights optimized for a variety of use cases including reasoning, summarization, and question answering. Command-R has the capability for multilingual generation evaluated in 10 languages and highly performant RAG capabilities.

 library_name: gguf
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
+The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
+**NOTE**: This is a preview of upcoming [PR#6033](https://github.com/ggerganov/llama.cpp/pull/6033).
 > C4AI Command-R is a research release of a 35 billion parameter highly performant generative model. Command-R is a large language model with open weights optimized for a variety of use cases including reasoning, summarization, and question answering. Command-R has the capability for multilingual generation evaluated in 10 languages and highly performant RAG capabilities.