Hugging Face's logo

Spaces:
allenai
/
ZebraLogic
Running

App Files Community
2
yuchenlin commited on
Commit
4d69201
•
1 Parent(s): d06e2e9

zebra

Browse files
Files changed (2) hide show
  1. _header.md +2 -1
  2. constants.py +17 -7
_header.md CHANGED
@@ -1,5 +1,6 @@
1
  <br/>
2
 
3
  # 🦓 ZebraLogic Bench: Testing the Limits of LLMs in Logical Reasoning
4
- [📑 Blog](https://allenai.github.io/WildBench/WildBench_paper.pdf) | [💻 GitHub](https://github.com/allenai/WildBench) | [🤗 HuggingFace](https://huggingface.co/collections/allenai/wildbench-65e8f2fa9c1260a85a933627) | [🐦 X]() | [💬 Discussion](https://huggingface.co/spaces/allenai/ZebraLogicBench-Leaderboard/discussions) | Updated: **{LAST_UPDATED}**
 
5
 
 
1
  <br/>
2
 
3
  # 🦓 ZebraLogic Bench: Testing the Limits of LLMs in Logical Reasoning
4
+ <!-- [📑 FnF Paper](https://arxiv.org/abs/2305.18654) | -->
5
+ [💻 GitHub](https://github.com/yuchenlin/ZeroEval) | [🤗 HuggingFace](https://huggingface.co/collections/allenai/zebra-logic-bench-6697137cbaad0b91e635e7b0) | [🐦 X](https://twitter.com/billyuchenlin/) | [💬 Discussion](https://huggingface.co/spaces/allenai/ZebraLogicBench-Leaderboard/discussions) | Updated: **{LAST_UPDATED}**
6
 
constants.py CHANGED
@@ -7,16 +7,26 @@ DEFAULT_K = "∞"
7
  banner_url = "https://github.com/yuchenlin/ZeroEval/blob/main/docs/zebra/zebra_banner.png?raw=true" # the same repo here.
8
  BANNER = f'<div style="display: flex; justify-content: flex-start;"><img src="{banner_url}" alt="Banner" style="width: 70vw; min-width: 300px; max-width: 1000px;border: 3px solid gray; border-color: gray black;"> </div>'
9
 
10
- TITLE = "<html> <head> <style> h1 {text-align: center;} </style> </head> <body> <h1> 🦁 AI2 WildBench Leaderboard </b> </body> </html>"
11
-
12
- WINRATE_HEATMAP = "<div><img src='https://github.com/WildEval/WildBench-Leaderboard/blob/main/gradio/pairwise_win_fractions.png?raw=true' style='width:100%;'></div>"
 
13
 
14
- CITATION_TEXT = """@article{tbd,
15
- title={tbd},
16
- author={tbd},
17
- journal={tbd},
18
  year={2024}
19
  }
 
 
 
 
 
 
 
 
 
20
  """
21
 
22
  # make column_names as an ordered dict
 
7
  banner_url = "https://github.com/yuchenlin/ZeroEval/blob/main/docs/zebra/zebra_banner.png?raw=true" # the same repo here.
8
  BANNER = f'<div style="display: flex; justify-content: flex-start;"><img src="{banner_url}" alt="Banner" style="width: 70vw; min-width: 300px; max-width: 1000px;border: 3px solid gray; border-color: gray black;"> </div>'
9
 
10
+ # TITLE = "<html> <head> <style> h1 {text-align: center;} </style> </head> <body> <h1> 🦁 AI2 WildBench Leaderboard </b> </body> </html>"
11
+
12
+
13
+ CITATION_TEXT = """
14
 
15
+ @misc{zebralogicbench2024,
16
+ title={ZebraLogic Bench: Testing the Limits of LLMs in Logical Reasoning},
17
+ author={Bill Yuchen Lin, Ronan Le Bras, Yejin Choi},
18
+ url={https://hf.co/spaces/allenai/ZebraLogicBench-Leaderboard},
19
  year={2024}
20
  }
21
+
22
+ @article{dziri2024faith,
23
+ title={Faith and fate: Limits of transformers on compositionality},
24
+ author={Nouha Dziri and Ximing Lu and Melanie Sclar and Xiang Lorraine Li and Liwei Jian and Bill Yuchen Lin and Peter West and Chandra Bhagavatula and Ronan Le Bras and Jena D. Hwang and Soumya Sanyal and Sean Welleck and Xiang Ren and Allyson Ettinger and Za{\"i}d Harchaoui and Yejin Choi},
25
+ journal={Advances in Neural Information Processing Systems},
26
+ volume={36},
27
+ year={2024}
28
+ }
29
+
30
  """
31
 
32
  # make column_names as an ordered dict