fakezeta
/

Yi-1.5-9B-Chat-ov-int4

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Yi-1.5-9B-Chat-ov-int4 / model.yaml

fakezeta's picture

Upload 13 files

4cf0d6c verified 8 days ago

raw history blame contribute delete

No virus

173 Bytes

	name: Yi-9B
	backend: transformers
	parameters:
	model: fakezeta/Yi-1.5-9B-Chat-ov-int4
	context_size: 8192
	type: OVModelForCausalLM
	template:
	use_tokenizer_template: true