Spaces:
Sleeping
Sleeping
add grok models
Browse files- app.py +1 -1
- context_window.json +3 -1
app.py
CHANGED
@@ -519,7 +519,7 @@ with gr.Blocks() as app:
|
|
519 |
# ⚔️ Software Engineering (SE) Arena: Explore and Test the Best SE Chatbots with Long-Context Interactions
|
520 |
|
521 |
## 📜How It Works
|
522 |
-
- **Blind Comparison**: Submit a SE-related query to two anonymous chatbots randomly selected from up to {len(available_models)} top models, including OpenAI-o3, Gemini-2.0, Claude-3.
|
523 |
- **Interactive Voting**: Engage in multi-turn dialogues with both chatbots and compare their responses. You can continue the conversation until you confidently choose the better model.
|
524 |
- **Fair Play Rules**: Votes are counted only if chatbot identities remain anonymous. Revealing a chatbot's identity disqualifies the session.
|
525 |
|
|
|
519 |
# ⚔️ Software Engineering (SE) Arena: Explore and Test the Best SE Chatbots with Long-Context Interactions
|
520 |
|
521 |
## 📜How It Works
|
522 |
+
- **Blind Comparison**: Submit a SE-related query to two anonymous chatbots randomly selected from up to {len(available_models)} top models, including OpenAI-o3, Grok-2, Gemini-2.0, Claude-3.7, Deepseek-r1, Mistral-large, Llama-3.3, Qwen-2.5, and others.
|
523 |
- **Interactive Voting**: Engage in multi-turn dialogues with both chatbots and compare their responses. You can continue the conversation until you confidently choose the better model.
|
524 |
- **Fair Play Rules**: Votes are counted only if chatbot identities remain anonymous. Revealing a chatbot's identity disqualifies the session.
|
525 |
|
context_window.json
CHANGED
@@ -5,13 +5,15 @@
|
|
5 |
"gpt-4o-mini": 128000,
|
6 |
"claude-3-5-haiku-20241022" : 200000,
|
7 |
"claude-3-5-sonnet-20241022" : 200000,
|
8 |
-
"claude-3-
|
|
|
9 |
"deepseek-chat": 64000,
|
10 |
"deepseek-r1": 64000,
|
11 |
"gemini-1.5-flash": 1048576,
|
12 |
"gemini-1.5-pro": 2097152,
|
13 |
"gemini-2.0-flash-lite-preview": 1048576,
|
14 |
"gemini-2.0-pro-exp": 2097152,
|
|
|
15 |
"llama-3.1-8b": 128000,
|
16 |
"llama-3.1-405b": 128000,
|
17 |
"llama-3.1-70b": 128000,
|
|
|
5 |
"gpt-4o-mini": 128000,
|
6 |
"claude-3-5-haiku-20241022" : 200000,
|
7 |
"claude-3-5-sonnet-20241022" : 200000,
|
8 |
+
"claude-3-7-sonnet-latest": 200000,
|
9 |
+
"claude-3-opus-20240229": 200000,
|
10 |
"deepseek-chat": 64000,
|
11 |
"deepseek-r1": 64000,
|
12 |
"gemini-1.5-flash": 1048576,
|
13 |
"gemini-1.5-pro": 2097152,
|
14 |
"gemini-2.0-flash-lite-preview": 1048576,
|
15 |
"gemini-2.0-pro-exp": 2097152,
|
16 |
+
"grok-2-1212": 131072,
|
17 |
"llama-3.1-8b": 128000,
|
18 |
"llama-3.1-405b": 128000,
|
19 |
"llama-3.1-70b": 128000,
|