BlueNipples
/

DaringLotus-SnowLotus-10.7b-IQ-GGUF

Inference Endpoints

Model card Files Files and versions Community

BlueNipples commited on Jan 23

Commit

946837d

•

1 Parent(s): e7e3dfd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ Thanks to lucyknada for helping me get the imatrix quants done quicker!
 ## Importance Matrix Note
-Imatrix currently does not run with Koboldcpp although bound to tbe supported in the future as it is supported by Llamacpp (and I'm guessing therefor ooba). Those quants should provide a perplexity boost especially to the smaller quants. The dat files are also there so if you make a fp16 gguf from the main model cards you might be able to save yourself some time producing your own imatrix quants.
 ### Format Notes

 ## Importance Matrix Note
+Imatrix currently does not run with Koboldcpp although bound to be supported in the future as it is supported by Llamacpp (and I'm guessing therefor ooba). Those quants should provide a perplexity boost especially to the smaller quants. The dat files are also there so if you make a fp16 gguf from the main model cards you might be able to save yourself some time producing your own imatrix quants.
 ### Format Notes