wizardcoder is slow

#32

by tareesh - opened Dec 30, 2023

Dec 30, 2023

I have made an api using the wizardcoder llm for evaluating codes. I am facing an issue as the model is taking more than 2mins generate a response.

Does anyone have a solution to reduce the time for generating a response?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment