Judge Arena: Benchmarking LLMs as Evaluators
•
53
kyle PRO
kaikaidai
AI & ML interests
None yet
Recent Activity
updated
a Space
14 days ago
AtlaAI/judge-arena
new activity
17 days ago
AtlaAI/judge-arena:Promotion to get more voters
posted
an
update
29 days ago
📈 Early results on the 8B evaluation model we've been training...
@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.
Next up: training Llama-3.1-70B 👀
Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator
Articles
Organizations
kaikaidai's activity
upvoted
an
article
2 months ago
Article
Experimenting with different training objectives for an AI evaluator
By
•
•
2