Yonatan Bitton's picture
8 4

Yonatan Bitton

Yonatan-Bitton
ยท

AI & ML interests

None yet

Recent Activity

Organizations

Google's profile picture

Yonatan-Bitton's activity

upvoted an article 7 months ago
view article
Article

Docmatix - a huge dataset for Document Visual Question Answering

โ€ข 72
New activity in google/imageinwords-explorer 8 months ago

Update app.py

#7 opened 8 months ago by
roopalgarg
New activity in google/imageinwords-explorer 10 months ago

Update README.md

#6 opened 10 months ago by
roopalgarg

Update app.py

#5 opened 10 months ago by
roopalgarg

Update app.py

#4 opened 10 months ago by
roopalgarg
updated a Space 10 months ago
reacted to gsarti's post with ๐Ÿ‘ about 1 year ago
view post
Post
๐Ÿ” Today's pick in Interpretability & Analysis of LMs: A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains by @alonjacovi @yonatanbitton B. Bohnet J. Herzig @orhonovic M. Tseng M. Collins @roeeaharoni @mega

This work introduces a new methodology for human verification of reasoning chains and adopts it to annotate a dataset of chain-of-thought reasoning chains produced by 3 LMs. The annotated dataset, REVEAL, can be used to benchmark automatic verifiers of reasoning in LMs.

In their analysis, the authors find that LM-produced CoTs generally contain faulty steps, often leading to incorrect automatic verification. In particular, CoT-generating LMs are found to produce non-attributable reasoning steps often, and reasoning verifiers generally struggle to verify logical correctness.

๐Ÿ“„ Paper: A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains (2402.00559)
๐Ÿ”ก Dataset: google/reveal
New activity in mlfoundations/VisIT-Bench about 1 year ago

image urls failed to load

1
#2 opened about 1 year ago by
luodian
New activity in nlphuji/flickr30k about 1 year ago

Thank you

2
#1 opened over 1 year ago by
mikehemberger
New activity in google/docci over 1 year ago

Upload docci.csv

#1 opened over 1 year ago by
Yonatan-Bitton