fakezeta
/

Phi-3-medium-4k-instruct-ov-int8

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Phi-3-medium-4k-instruct-ov-int8 / model.yaml

fakezeta's picture

Update model.yaml

043ae1b verified 5 months ago

history blame contribute delete

229 Bytes

	name: phi3-medium
	backend: transformers
	parameters:
	model: fakezeta/Phi-3-medium-4k-instruct-ov-int8
	context_size: 4096
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true
	stopwords:
	- "<\|end\|>"
	- "<\|endoftext\|>"