Support for larger models

#5
by ChuckMcSneed - opened

Do you support larger models? You currently only have small models(7-13b), and all larger models fail the evaluation for some reason.

Patronus AI org

Hey, our backend was down temporarily which is why a lot of requests failed. I have set it up to do a re-run of all the failed requests.

Are you sure that it's fixed? No new models have been added and there are still pending requests.

Now it seems to be working, just very slow.

ChuckMcSneed changed discussion status to closed

Still doesn't work. All 70b models fail.

ChuckMcSneed changed discussion status to open

Sign up or log in to comment