philschmid

/

flan-ul2-20b-fp16

like 26

Receiving the following error when deployed the model & trying to run predict method:

An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (400) from primary with message "{
  "code": 400,
  "type": "InternalServerException",
  "message": "Could not load model /.sagemaker/mms/models/philschmid__flan-ul2-20b-fp16 with any of the following classes: (\u003cclass \u0027transformers.models.auto.modeling_auto.AutoModelForSeq2SeqLM\u0027\u003e, \u003cclass \u0027transformers.models.t5.modeling_t5.T5ForConditionalGeneration\u0027\u003e)."
}```

--

Edit: Used incorrect deployment strategy. Followed your blog. Thank you Phil.