TinyDolphin-3x-MoE / mergekit_moe_config.yml
jtatman's picture
Upload folder using huggingface_hub
9fa3298 verified
raw
history blame contribute delete
637 Bytes
base_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
gate_mode: hidden
dtype: float16
experts:
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts:
- "think step-by-step and follow these instructions"
- "read the following passage, and summarize it in less than 30 words."
- "please answer this question, consider the options carefully, and return the most likely answer."
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts: ["produce python code"]
- source_model: cognitivecomputations/TinyDolphin-2.8.1-1.1b
positive_prompts: ["What is 2 x 22?"]