Judge Arena: Benchmarking LLMs as Evaluators
•
53
kyle PRO
kaikaidai
AI & ML interests
None yet
Recent Activity
updated
a Space
14 days ago
AtlaAI/judge-arena
new activity
17 days ago
AtlaAI/judge-arena:Promotion to get more voters
posted
an
update
29 days ago
📈 Early results on the 8B evaluation model we've been training...
@NinaCalvi wrote about the progress we've made this quarter towards training the best 'LLM-as-a-judge' evaluator. We've significantly improved against the baseline and are approaching state-of-the-art evaluation performance with an 8B model.
Next up: training Llama-3.1-70B 👀
Here's the full article: https://www.atla-ai.com/post/evaluating-the-evaluator
Articles
Organizations
kaikaidai's activity
Promotion to get more voters
1
#7 opened 19 days ago
by
softclone
About adding a judge model to the leaderboard
1
#6 opened about 1 month ago
by
wangpf3
Which models do you want to see on here?
12
#2 opened about 1 month ago
by
kaikaidai
Apply for community grant: Company project (gpu and storage)
#5 opened about 1 month ago
by
kaikaidai
What are Meta-Llama-3.1-Instruct "Turbo" models?
3
#4 opened about 1 month ago
by
m-ric