Luminum-v0.1-123B / mergekit_config.yml
FluffyKaeloky's picture
Upload folder using huggingface_hub
4d02594 verified
raw
history blame
390 Bytes
models:
- model: S:\Models\anthracite-orgmagnum-v2-123b
parameters:
weight: 0.19
density: 0.5
- model: S:\Models\NeverSleepLumimaid-v0.2-123B
parameters:
weight: 0.34
density: 0.8
merge_method: della_linear
base_model: S:\Models\mistralaiMistral-Large-Instruct-2407
parameters:
epsilon: 0.05
lambda: 1
int8_mask: true
dtype: bfloat16