dranger003
/

dbrx-instruct-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

dranger003 commited on Apr 7

Commit

76431e2

•

1 Parent(s): 01aa3c8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ base_model: databricks/dbrx-instruct
 | Layers | Context | Template |
 | --- | --- | --- |
-| <pre> </pre> | <pre>32768</pre> | <pre>\<\|im_start\|\> system<br>{system} \<\|im_end\|\><br>\<\|im_start\|\> user<br>{prompt} \<\|im_end\|\><br>\<\|im_start\|\> assistant<br> </pre> |
 * 16x12B MoE
 * 16 experts (12B params per single expert; top_k=4 routing)

 | Layers | Context | Template |
 | --- | --- | --- |
+| <pre>40</pre> | <pre>32768</pre> | <pre>\<\|im_start\|\> system<br>{system} \<\|im_end\|\><br>\<\|im_start\|\> user<br>{prompt} \<\|im_end\|\><br>\<\|im_start\|\> assistant<br> </pre> |
 * 16x12B MoE
 * 16 experts (12B params per single expert; top_k=4 routing)