README.md

metadata

license: apache-2.0
tags:
  - merge
base_model:
  - meta-math/MetaMath-Mistral-7B
  - Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B

MetaMath-OpenHermes-2.5-neural-chat-7b-v3-1-7B-Linear

This is the model for MetaMath-OpenHermes-2.5-neural-chat-7b-v3-1-7B-Linear. I used mergekit to merge models.

Yaml Config

models:
  - model: meta-math/MetaMath-Mistral-7B
    parameters:
      weight: 0.5
  - model: Weyaxi/OpenHermes-2.5-neural-chat-7b-v3-1-7B
    parameters:
      weight: 0.3
merge_method: linear
dtype: float16