BAAI
/

Sagemaker deployment to GPU

#23
by chaitanya87 - opened

The provided script for inference ,in the sample deploy.py for sagemaker is wrong. The correct payload is

predictor.predict(data={
    "query":"What is a Panda?",
    "texts":["China is a great country and I want to live in there.","The giant panda (Ailuropoda melanoleuca), sometimes called a panda bear or simply panda, is a bear species endemic to China."]
})


# [{'index': 1, 'score': 0.9863105}, {'index': 0, 'score': 1.6061611e-05}]

Sign up or log in to comment