YuLan-Mini-GGUF / README.md
quantflex's picture
Update README.md
449d32b verified
metadata
license: mit
language:
  - en
  - zh
base_model: yulan-team/YuLan-Mini

QuantFlex Banner

GGUF Quants for: yulan-team/YuLan-Mini

Model by: RUC-GSAI-YuLan (thank you!)

Quants by: quantflex

Run with llama.cpp

No K-Quants included because the tensor cols are not divisible by 256.