Iftach Arbel

iarbel

AI & ML interests

Optimization Algorithms, NLP, LLMs, CV

Recent Activity

Organizations

Cimphony's profile picture Project Didi's profile picture Neradot ltd's profile picture Chaos Labs's profile picture

iarbel's activity

New activity in cimphony-ai-admin/Cimphony-Mistral-Law-7B 2 months ago

Fail to run on vLLM

5
#1 opened 3 months ago by
yaronr
New activity in microsoft/Phi-3-mini-4k-instruct 5 months ago
replied to DmitryRyumin's post 7 months ago
view reply

The evaluation benchmarks use zero-shot, where usually few-shot is used. This raises the question whether the few-shot results weren't as good, compared to similar-sized models.

Hopefully the authors will release few-shot results, aligned with common practice (e.g. HF Open LLM Leaderboard)

New activity in Equall/Saul-7B-Instruct-v1 9 months ago