L3-MOE-4X8B-Grand-Horror-25B / mergekit_moe_config.yml
DavidAU's picture
Upload folder using huggingface_hub
3ae5d58 verified
raw
history blame contribute delete
299 Bytes
base_model: G:/7B/L3-Jamet-8B-MK.V-Blackroot
gate_mode: random
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: G:/7B/L3-Lumimaid-8B-v0.1-OAS
- source_model: G:/7B/L3-8B-Stheno-v3.2
- source_model: G:/7B/L3-gutenberg-8B
- source_model: G:/7B/L3-Jamet-8B-MK.V-Blackroot