Text Generation
Transformers
Safetensors
5 languages
mixtral
mixtral-8x22b
mixtral-8x7b
instruct
Mixture of Experts
Merge
conversational
text-generation-inference
Inference Endpoints
ehristoforu commited on
Commit
b57ea87
1 Parent(s): 62b83d0

Delete mergekit_config.yml

Browse files
Files changed (1) hide show
  1. mergekit_config.yml +0 -9
mergekit_config.yml DELETED
@@ -1,9 +0,0 @@
1
- slices:
2
- - sources:
3
- - model: alpindale/WizardLM-2-8x22B
4
- layer_range: [0, 32]
5
- - sources:
6
- - model: cognitivecomputations/dolphin-2.7-mixtral-8x7b
7
- layer_range: [20, 32]
8
- merge_method: passthrough
9
- dtype: bfloat16