State-of-the-MoE_RP-2x7B / mergekit_moe_config.yml
WesPro's picture
Update mergekit_moe_config.yml
8ef6372 verified
raw
history blame contribute delete
259 Bytes
base_model: H:\merge\TheSpice-7b-FT-v0.3.1
gate_mode: random
dtype: bfloat16
experts:
- source_model: H:\merge\daybreak-kunoichi-2dpo-7b
positive_prompts:
- "play"
- source_model: H:\merge\Noromaid-7B-0.4-DPO
positive_prompts:
- "role"