shidowake
/

test-240114-phi2-mergekit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

test-240114-phi2-mergekit / mergekit_config.yml

shidowake's picture

Upload folder using huggingface_hub

9e51bbf verified 10 months ago

history blame contribute delete

214 Bytes


	slices:
	- sources:
	- model: microsoft/phi-2
	layer_range: [0, 32]
	- sources:
	- model: microsoft/phi-2
	layer_range: [24, 32]
	merge_method: passthrough
	dtype: bfloat16
	trust_remote_code: True