Batch inference

#1
by SeeingFarther - opened

Could you provide information on available APIs or methods for performing batch inference, or is it not supported?

Efficient-Large-Model org

Sure, I just updated the doc and usage.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment