EastAsia-4x7B-Moe-experiment / mergekit_moe_config.yml
Heng666's picture
Upload folder using huggingface_hub
44d2f9b verified
gate_mode: hidden
dtype: bfloat16
base_model: mlabonne/Marcoro14-7B-slerp
experts:
- source_model: MediaTek-Research/Breeze-7B-Instruct-v0.1
positive_prompts:
- "翻譯"
- source_model: augmxnt/shisa-7b-v1
positive_prompts:
- "翻訳"
- source_model: beomi/OPEN-SOLAR-KO-10.7B
positive_prompts:
- "번역"