kromcomp
/

Llama-3.1-Instruct-fp32-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Instruct-fp32-8B / mergekit_config.yml

kromeurus's picture

Upload folder using huggingface_hub

34467dc verified 23 days ago

history blame contribute delete

159 Bytes

	dtype: float32
	merge_method: passthrough
	parameters:
	int8_mask: 1.0
	slices:
	- sources:
	- layer_range: [0, 32]
	model: unsloth/Meta-Llama-3.1-8B-Instruct