Update README.md
Browse files
README.md
CHANGED
|
@@ -23,6 +23,8 @@ extra_gated_fields:
|
|
| 23 |
license: other
|
| 24 |
---
|
| 25 |
|
|
|
|
|
|
|
| 26 |
Original model card below.
|
| 27 |
|
| 28 |
***
|
|
|
|
| 23 |
license: other
|
| 24 |
---
|
| 25 |
|
| 26 |
+
This is [StableLM 2 Chat 1.6B](https://huggingface.co/stabilityai/stablelm-2-1_6b-chat), quantized with the help of imatrix so it could offer better performance for being quantized, and have quantization levels available for lower-memory devices to run. [Kalomaze's "groups_merged.txt"](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) was used for the importance matrix, with context set to 4,096 (the context length according to [their paper](https://drive.google.com/file/d/1JYJHszhS8EFChTbNAf8xmqhKjogWRrQF/view)).
|
| 27 |
+
|
| 28 |
Original model card below.
|
| 29 |
|
| 30 |
***
|