Magnolia-v5-12B / mergekit_config.yml
grimjim's picture
Initial release
e3059e8
base_model: grimjim/mistralai-Mistral-Nemo-Base-2407
dtype: bfloat16
merge_method: task_arithmetic
parameters:
normalize: true
models:
- model: grimjim/mistralai-Mistral-Nemo-Base-2407
- model: grimjim/Magnolia-v3-12B
parameters:
weight: 0.85
- model: Nitral-AI/Captain_BMO-12B
parameters:
weight: 0.1
- model: natong19/Mistral-Nemo-Instruct-2407-abliterated
parameters:
weight: 0.05