inflatebot
commited on
Commit
•
294d461
1
Parent(s):
ba7f2d6
Update README.md
Browse files
README.md
CHANGED
@@ -6,4 +6,6 @@ base_model_relation: quantized
|
|
6 |
|
7 |
GGUFs for [MoE-Girl.](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT)
|
8 |
|
9 |
-
|
|
|
|
|
|
6 |
|
7 |
GGUFs for [MoE-Girl.](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT)
|
8 |
|
9 |
+
~~**Note: Until KoboldCPP merges the latest llama.cpp version, these won't work with it.** Use vLLM instead until then, see their page on [GGUF](https://docs.vllm.ai/en/latest/quantization/gguf.html)~~
|
10 |
+
|
11 |
+
These now work with KoboldCPP 1.76!
|