yashmarathe
/

Mistral-Quantum-dpo

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mistral-Quantum-dpo / mergekit_config.yml

yash21's picture

Upload folder using huggingface_hub

0213ba8 10 months ago

212 Bytes


	slices:
	- sources:
	- model: quantumaikr/quantum-dpo-v0.1
	layer_range: [0, 32]
	- sources:
	- model: mncai/mistral-7b-dpo-v6
	layer_range: [24, 32]
	merge_method: passthrough
	dtype: bfloat16