dranger003
/

dbrx-instruct-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Apr 12

Commit

5614812

•

1 Parent(s): 359da21

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -7,9 +7,7 @@ pipeline_tag: text-generation
 base_model: databricks/dbrx-instruct
 ---
 **2024-04-12**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
-We are currently testing quants and I will upload them once they are working.
-<u>**NOTE**: Do not download the model unless it states above that testing is conclusive, otherwise the model won't work.</u>
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).

 base_model: databricks/dbrx-instruct
 ---
 **2024-04-12**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
+Testing of the quants appears to currently work, however the PR has not yet been merged.
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).