Running
3
🛠️
SE-Arena
The chatbot arena for software engineering
Software Engineering Arena
community
AI & ML interests
Model Evaluation
Recent Activity
SE-Arena's activity
zhiminy
updated
a
Space
25 days ago
zhiminy
updated
2
datasets
25 days ago
Post
2211
Hey everyone,
We're thrilled to introduce our latest project: a hand-curated list of the best production-level machine-learning open-source toolkits! 🚀
Check it out here: zhiminy/Awesome-Production-Machine-Learning-Search
We're thrilled to introduce our latest project: a hand-curated list of the best production-level machine-learning open-source toolkits! 🚀
Check it out here: zhiminy/Awesome-Production-Machine-Learning-Search
zhiminy
updated
a
Space
28 days ago
Post
1165
We're thrilled to introduce our latest project: SE Arena! 🎉
SE Arena is an interactive platform designed to evaluate and compare software engineering chatbots powered by foundation models. With a transparent, open-source leaderboard, support for multi-round conversations, and head-to-head model comparisons, SE Arena is here to bring clarity to the evaluation process for FMs in software engineering tasks.
Check it out here: SE-Arena/Software-Engineering-Arena
We’d love your feedback and contributions! 🚀
SE Arena is an interactive platform designed to evaluate and compare software engineering chatbots powered by foundation models. With a transparent, open-source leaderboard, support for multi-round conversations, and head-to-head model comparisons, SE Arena is here to bring clarity to the evaluation process for FMs in software engineering tasks.
Check it out here: SE-Arena/Software-Engineering-Arena
We’d love your feedback and contributions! 🚀
Post
794
Hey everyone,
We're thrilled to introduce our latest project: a hand-curated list of the best-curated lists related to artificial intelligence! 🚀
Check it out here: https://github.com/zhimin-z/awesome-awesome-artificial-intelligence
We're thrilled to introduce our latest project: a hand-curated list of the best-curated lists related to artificial intelligence! 🚀
Check it out here: https://github.com/zhimin-z/awesome-awesome-artificial-intelligence
Post
1996
Hey everyone!
Our team just dropped something cool! 🎉 We've published a new paper on arxiv diving into the foundation model leaderboards across different platforms. We've analyzed the content, operational workflows, and common issues of these leaderboards. From this, we came up with two new concepts: Leaderboard Operations (LBOps) and leaderboard smells.
We also put together an awesome list with nearly 300 of the latest leaderboards, development tools, and publishing organizations. You can check it out here: https://github.com/SAILResearch/awesome-foundation-model-leaderboards
If you find it useful or interesting, give us a follow or drop a comment. We'd love to hear your thoughts and get your support! ✨
Link to the paper: https://arxiv.org/abs/2407.04065
Our team just dropped something cool! 🎉 We've published a new paper on arxiv diving into the foundation model leaderboards across different platforms. We've analyzed the content, operational workflows, and common issues of these leaderboards. From this, we came up with two new concepts: Leaderboard Operations (LBOps) and leaderboard smells.
We also put together an awesome list with nearly 300 of the latest leaderboards, development tools, and publishing organizations. You can check it out here: https://github.com/SAILResearch/awesome-foundation-model-leaderboards
If you find it useful or interesting, give us a follow or drop a comment. We'd love to hear your thoughts and get your support! ✨
Link to the paper: https://arxiv.org/abs/2407.04065
zhiminy
updated
a
Space
6 months ago