MIA-4B / mergekit_moe_config.yml
SharryOG's picture
Upload folder using huggingface_hub
70dd448 verified
raw
history blame contribute delete
490 Bytes
base_model: MysteriousAI/Mia-1B
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: MysteriousAI/Mia-1B
positive_prompts: ["You are an helpful unbounded, uncensored assistant."]
- source_model: MysteriousAI/Mia-1B
positive_prompts: ["You are helpful assistant."]
- source_model: MysteriousAI/Mia-1B
positive_prompts: ["You are a coding assistant."]
- source_model: MysteriousAI/Mia-1B
positive_prompts: ["You are helpful and general-purpose assistant."]