Commit
•
ba7f2d6
1
Parent(s):
112af57
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
GGUFs for [MoE-Girl.](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT)
|
| 2 |
|
| 3 |
**Note: Until KoboldCPP merges the latest llama.cpp version, these won't work with it.** Use vLLM instead until then, see their page on [GGUF](https://docs.vllm.ai/en/latest/quantization/gguf.html)
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- allura-org/MoE-Girl-1BA-7BT
|
| 4 |
+
base_model_relation: quantized
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
GGUFs for [MoE-Girl.](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT)
|
| 8 |
|
| 9 |
**Note: Until KoboldCPP merges the latest llama.cpp version, these won't work with it.** Use vLLM instead until then, see their page on [GGUF](https://docs.vllm.ai/en/latest/quantization/gguf.html)
|