SteelStorage
/

Aura-llama

Text Generation

NousResearch/Meta-Llama-3-8B-Instruct

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Aura-llama / mergekit_config.yml

Steelskull's picture

Upload folder using huggingface_hub

84c6752 verified 6 months ago

227 Bytes

	slices:
	- sources:
	- model: meta-llama/Meta-Llama-3-8B-Instruct
	layer_range: [0, 23]
	- sources:
	- model: meta-llama/Meta-Llama-3-8B-Instruct
	layer_range: [7, 31]
	merge_method: passthrough
	dtype: bfloat16