zhiminy commited on
Commit
ea8b371
·
1 Parent(s): ab10f2f

add grok models

Browse files
Files changed (2) hide show
  1. app.py +1 -1
  2. context_window.json +3 -1
app.py CHANGED
@@ -519,7 +519,7 @@ with gr.Blocks() as app:
519
  # ⚔️ Software Engineering (SE) Arena: Explore and Test the Best SE Chatbots with Long-Context Interactions
520
 
521
  ## 📜How It Works
522
- - **Blind Comparison**: Submit a SE-related query to two anonymous chatbots randomly selected from up to {len(available_models)} top models, including OpenAI-o3, Gemini-2.0, Claude-3.5, Deepseek-r1, Mistral-large, Llama-3.3, Qwen-2.5, and others.
523
  - **Interactive Voting**: Engage in multi-turn dialogues with both chatbots and compare their responses. You can continue the conversation until you confidently choose the better model.
524
  - **Fair Play Rules**: Votes are counted only if chatbot identities remain anonymous. Revealing a chatbot's identity disqualifies the session.
525
 
 
519
  # ⚔️ Software Engineering (SE) Arena: Explore and Test the Best SE Chatbots with Long-Context Interactions
520
 
521
  ## 📜How It Works
522
+ - **Blind Comparison**: Submit a SE-related query to two anonymous chatbots randomly selected from up to {len(available_models)} top models, including OpenAI-o3, Grok-2, Gemini-2.0, Claude-3.7, Deepseek-r1, Mistral-large, Llama-3.3, Qwen-2.5, and others.
523
  - **Interactive Voting**: Engage in multi-turn dialogues with both chatbots and compare their responses. You can continue the conversation until you confidently choose the better model.
524
  - **Fair Play Rules**: Votes are counted only if chatbot identities remain anonymous. Revealing a chatbot's identity disqualifies the session.
525
 
context_window.json CHANGED
@@ -5,13 +5,15 @@
5
  "gpt-4o-mini": 128000,
6
  "claude-3-5-haiku-20241022" : 200000,
7
  "claude-3-5-sonnet-20241022" : 200000,
8
- "claude-3-opus-20240229" : 200000,
 
9
  "deepseek-chat": 64000,
10
  "deepseek-r1": 64000,
11
  "gemini-1.5-flash": 1048576,
12
  "gemini-1.5-pro": 2097152,
13
  "gemini-2.0-flash-lite-preview": 1048576,
14
  "gemini-2.0-pro-exp": 2097152,
 
15
  "llama-3.1-8b": 128000,
16
  "llama-3.1-405b": 128000,
17
  "llama-3.1-70b": 128000,
 
5
  "gpt-4o-mini": 128000,
6
  "claude-3-5-haiku-20241022" : 200000,
7
  "claude-3-5-sonnet-20241022" : 200000,
8
+ "claude-3-7-sonnet-latest": 200000,
9
+ "claude-3-opus-20240229": 200000,
10
  "deepseek-chat": 64000,
11
  "deepseek-r1": 64000,
12
  "gemini-1.5-flash": 1048576,
13
  "gemini-1.5-pro": 2097152,
14
  "gemini-2.0-flash-lite-preview": 1048576,
15
  "gemini-2.0-pro-exp": 2097152,
16
+ "grok-2-1212": 131072,
17
  "llama-3.1-8b": 128000,
18
  "llama-3.1-405b": 128000,
19
  "llama-3.1-70b": 128000,