Deployment failed
#4
by
RupakRath
- opened
I used sagemaker SDK code to deploy the model.
I copied that code and pasted over my jupyter notebook but its failings
I am facing Failed to start shard error.
Same error for me, any resolution on this?
provide below in config : https://www.philschmid.de/sagemaker-awq-medusa
qunatize:awq