inflatebot's picture
Update README.md
294d461 verified
metadata
base_model:
  - allura-org/MoE-Girl-1BA-7BT
base_model_relation: quantized

GGUFs for MoE-Girl.

Note: Until KoboldCPP merges the latest llama.cpp version, these won't work with it. Use vLLM instead until then, see their page on GGUF

These now work with KoboldCPP 1.76!