README.md

metadata

base_model: []
license: apache-2.0
datasets:
  - argilla/distilabel-intel-orca-dpo-pairs

WestLakeX-7B-EvoMerge

This is the result of a small-scale EvoMerge.
(Experiment Conclusion: Higher mutation strength does not seem to improve performance so far. Average eval score is below all candidates in initial population. Though this is a single experiment, it is not definitive that higher mutation strength is unnecessary. For example, it could be useful at a bigger scale.)

Zoom in to view the family tree: