MachoMaheen
/

devdock4bit

devdock4bit / examples /inference /llama3_vllm.yaml

Upload folder using huggingface_hub

bc55b34 verified 3 months ago

118 Bytes

	model_name_or_path: meta-llama/Meta-Llama-3-8B-Instruct
	template: llama3
	infer_backend: vllm
	vllm_enforce_eager: true