fakezeta
/

Phi-3-mini-128k-instruct-ov-int4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

fakezeta commited on Apr 23

Commit

cba18ad

•

1 Parent(s): f17eb63

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ name: phi3
 backend: transformers
 parameters:
 model: fakezeta/Phi-3-mini-128k-instruct-ov-int4
-context_size: 4096
 threads: 6
 trust_remote_code: true
 type: OVModelForCausalLM

 backend: transformers
 parameters:
 model: fakezeta/Phi-3-mini-128k-instruct-ov-int4
+context_size: 131072
 threads: 6
 trust_remote_code: true
 type: OVModelForCausalLM