Intelligence-QwQ / mergekit_config.yml
ClaudioItaly's picture
Upload folder using huggingface_hub
f70895b verified
models:
- model: ClaudioItaly/intelligence-cod-rag-7b-v3
- model: prithivMLmods/QwQ-LCoT-7B-Instruct
merge_method: slerp
base_model: ClaudioItaly/intelligence-cod-rag-7b-v3
dtype: bfloat16
parameters:
t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers