DenisTheDev's picture
Upload folder using huggingface_hub
4cead74 verified
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - openchat/openchat-3.5-1210
  - openchat/openchat-3.5-0106

Openchat-Passthrough-2

Openchat-Passthrough-2 is a merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
    - model: openchat/openchat-3.5-1210
      layer_range: [0, 24]
  - sources:
    - model: openchat/openchat-3.5-0106
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16