Experiment26-7B-passthrough-6slice / mergekit_config.yml
babybirdprd's picture
Upload folder using huggingface_hub
9ddf2a9 verified
raw
history blame contribute delete
528 Bytes
slices:
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [0, 7]
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [5, 12]
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [10, 17]
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [15, 22]
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [20, 27]
- sources:
- model: yam-peleg/Experiment26-7B
layer_range: [25, 32]
merge_method: passthrough
dtype: bfloat16