Sagemaker deployment to GPU
#23
by
chaitanya87
- opened
The provided script for inference ,in the sample deploy.py for sagemaker is wrong. The correct payload is
predictor.predict(data={
"query":"What is a Panda?",
"texts":["China is a great country and I want to live in there.","The giant panda (Ailuropoda melanoleuca), sometimes called a panda bear or simply panda, is a bear species endemic to China."]
})
# [{'index': 1, 'score': 0.9863105}, {'index': 0, 'score': 1.6061611e-05}]