dranger003
/

c4ai-command-r-v01-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Mar 15

Commit

62bcfc7

•

1 Parent(s): ce94b17

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -4,8 +4,9 @@ pipeline_tag: text-generation
 library_name: gguf
 base_model: CohereForAI/c4ai-command-r-v01
 ---
-GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
-The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
 **NOTE**: This is a preview of upcoming [PR#6033](https://github.com/ggerganov/llama.cpp/pull/6033).

 library_name: gguf
 base_model: CohereForAI/c4ai-command-r-v01
 ---
+* GGUF importance matrix (imatrix) quants for https://huggingface.co/CohereForAI/c4ai-command-r-v01
+* The importance matrix was trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
+* [Which GGUF is right for me? (Opinionated, from Artefact2)](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
 **NOTE**: This is a preview of upcoming [PR#6033](https://github.com/ggerganov/llama.cpp/pull/6033).