dranger003
/

dbrx-instruct-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Apr 11

Commit

d2aa163

•

1 Parent(s): b8185c1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ base_model: databricks/dbrx-instruct
 **2024-04-11**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
 We are currently testing quants and I will upload them once they are working.
-**NOTE**: Do not download the model unless it states above that testing is conclusive, otherwise the model won't work.
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).

 **2024-04-11**: Support for this model is still being worked on - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
 We are currently testing quants and I will upload them once they are working.
+<u>**NOTE**: Do not download the model unless it states above that testing is conclusive, otherwise the model won't work.</u>
 * GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
 * The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).