Commit
•
9719d53
1
Parent(s):
e7d0b3e
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,8 +7,8 @@ pipeline_tag: text-generation
|
|
| 7 |
base_model: databricks/dbrx-instruct
|
| 8 |
---
|
| 9 |
**2024-04-13**: Support for this model has just being merged - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
|
| 10 |
-
**<u>You will need this llama.cpp commit [`4bd0f93e`](https://github.com/ggerganov/llama.cpp/commit/4bd0f93e4ab4fe6682e7d0241c1bdec1397e954a) to run this model</u>**
|
| 11 |
-
**Apple/Metal support task is still open, missing clamp op implementation.**
|
| 12 |
|
| 13 |
* GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
|
| 14 |
* The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
|
|
|
|
| 7 |
base_model: databricks/dbrx-instruct
|
| 8 |
---
|
| 9 |
**2024-04-13**: Support for this model has just being merged - [`PR #6515`](https://github.com/ggerganov/llama.cpp/pull/6515).
|
| 10 |
+
**<u>You will need this llama.cpp commit [`4bd0f93e`](https://github.com/ggerganov/llama.cpp/commit/4bd0f93e4ab4fe6682e7d0241c1bdec1397e954a) to run this model</u>**
|
| 11 |
+
**Apple/Metal support task is still open, missing clamp op implementation - this means some quants here won't work on Metal.**
|
| 12 |
|
| 13 |
* GGUF importance matrix (imatrix) quants for https://huggingface.co/databricks/dbrx-instruct
|
| 14 |
* The importance matrix is trained for ~100K tokens (200 batches of 512 tokens) using [wiki.train.raw](https://huggingface.co/datasets/wikitext).
|