mlabonne
/

Meta-Llama-3-12B-Instruct

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Meta-Llama-3-12B-Instruct / mergekit_config.yml

mlabonne's picture

Upload folder using huggingface_hub

e5846ff verified about 1 month ago

raw history blame contribute delete

No virus

503 Bytes


	slices:
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [0,9]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [5,14]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [10,19]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [15,24]
	- sources:
	- model: NousResearch/Meta-Llama-3-8B-Instruct
	layer_range: [20,32]
	merge_method: passthrough
	dtype: bfloat16