devingulliver
commited on
Commit
•
4fd57b2
1
Parent(s):
8c47a7a
Update app.py
Browse files
app.py
CHANGED
@@ -76,11 +76,14 @@ with gr.Blocks(css=".tab-buttons button{font-size:1.3em}") as demo:
|
|
76 |
|
77 |
with gr.Tab("📝 About"):
|
78 |
gr.Markdown("""
|
79 |
-
The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic/attention-free architectures (
|
80 |
evaluation results while the architectures themselves are pending inclusion/release in the 🤗 Transformers library.
|
|
|
81 |
The metrics are the same as the Open LLM Leaderboard: ARC 25-shot, HellaSwag 10-shot, MMLU 5-shot, TruthfulQA zeroshot, Winogrande 5-shot, and GSM8K 5-shot.
|
|
|
82 |
This leaderboard is maintained by Devin Gulliver and is perpetually under construction, check back regularly for further improvements!
|
83 |
-
|
|
|
84 |
""")
|
85 |
|
86 |
with gr.Tab("🚀 Submit here!"):
|
|
|
76 |
|
77 |
with gr.Tab("📝 About"):
|
78 |
gr.Markdown("""
|
79 |
+
The **Subquadratic LLM Leaderboard** evaluates LLMs with subquadratic/attention-free architectures (i.e. RWKV & Mamba) with the goal of providing open
|
80 |
evaluation results while the architectures themselves are pending inclusion/release in the 🤗 Transformers library.
|
81 |
+
|
82 |
The metrics are the same as the Open LLM Leaderboard: ARC 25-shot, HellaSwag 10-shot, MMLU 5-shot, TruthfulQA zeroshot, Winogrande 5-shot, and GSM8K 5-shot.
|
83 |
+
|
84 |
This leaderboard is maintained by Devin Gulliver and is perpetually under construction, check back regularly for further improvements!
|
85 |
+
|
86 |
+
Compute for evaluating RWKV models is generously provided by [Recursal AI](https://recursal.io/).
|
87 |
""")
|
88 |
|
89 |
with gr.Tab("🚀 Submit here!"):
|