Gregor Betz commited on
Commit
61a673a
1 Parent(s): db03c68

description

Browse files
Files changed (1) hide show
  1. src/display/about.py +4 -6
src/display/about.py CHANGED
@@ -8,8 +8,6 @@ class Task:
8
  col_name: str
9
 
10
 
11
-
12
-
13
  # Init: to update with your specific keys
14
  class Tasks(Enum):
15
  # task_key in the json file, metric_key in the json file, name to display in the leaderboard
@@ -68,10 +66,10 @@ This is a leaderboard for Open LLMs, and we'd love for as many people as possibl
68
  ### 4) Fill up your model card
69
  When we add extra information about models to the leaderboard, it will be automatically taken from the model card
70
 
71
- ## In case of model failure
72
- If your model is displayed in the `FAILED` category, its execution stopped.
73
- Make sure you have followed the above steps first.
74
- If everything is done, check you can launch the EleutherAIHarness on your model locally, using the above command without modifications (you can add `--limit` to limit the number of examples per task).
75
  """
76
 
77
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"
 
8
  col_name: str
9
 
10
 
 
 
11
  # Init: to update with your specific keys
12
  class Tasks(Enum):
13
  # task_key in the json file, metric_key in the json file, name to display in the leaderboard
 
66
  ### 4) Fill up your model card
67
  When we add extra information about models to the leaderboard, it will be automatically taken from the model card
68
 
69
+ ## Your model is stuck in the pending queue?
70
+
71
+ We're populating the Open CoT Leaderboard step by step. The idea is to grow a diverse and informative sample of the LLM space. Plus, with limited compute, we're currently prioritizing models that are popular, promising, and relatively small.
72
+
73
  """
74
 
75
  CITATION_BUTTON_LABEL = "Copy the following snippet to cite these results"