open-llm-leaderboard/open_llm_leaderboard

#1122 opened 3 days ago by

Amu

Any news about CUDA error fix?

#1121 opened 3 days ago by

icefog72

Problem evaluating 72B, please help

6

#1117 opened 5 days ago by

Marsouuu

Error in benchmarking model - rubenroy/Gilgamesh-72B

2

#1115 opened 6 days ago by

Spestly

models not being evaluated ?

6

#1114 opened 7 days ago by

LeroyDyer

Eval error in Qwen2.5 Coder 32B based model

#1113 opened 7 days ago by

tomasmcm

Same eval error?

#1112 opened 8 days ago by

icefog72

meta-llama/Meta-Llama-3-8B-Instruct model links are mixed up

#1101 opened 18 days ago by

SandInTheDunes

Spurious `trust_remote_code=True` objection when submitting a model?

#1100 opened 19 days ago by

grimjim

[FLAG] contamination MATH `bond005/meno-tiny-0.1`

#1094 opened 24 days ago by

fblgit

Unable to submit byroneverson/Yi-1.5-34B-Chat-abliterated

#1080 opened about 1 month ago by

CombinHorizon

Qwen2.5-32B merge eval error

#1078 opened about 1 month ago by

ehristoforu

Model results missing

#1075 opened about 2 months ago by

maldv

fix-gptq

#1072 opened about 2 months ago by

alozowski

Bug in Parameters count for GPTQ quantized model

#1068 opened about 2 months ago by

Qubitium

Resubmitting a model to use `chat_template` doesn't re-evaluate, but does change `chat_template` column

#1066 opened about 2 months ago by

xzuyn

failed models, check logs

#1062 opened about 2 months ago by

CombinHorizon

docker-container-test

#1047 opened 2 months ago by

alozowski

Normalization for MuSR object placement

#1040 opened 3 months ago by

recojt

update ranking number when editing filters

#1036 opened 3 months ago by

clem

Requested feature: searchable tags for official supported languages for each model.

#1035 opened 3 months ago by

Reza2kn

Proposal for new column

#1032 opened 3 months ago by

Yuma42

merged models marked as non merged in the leaderboard

#993 opened 4 months ago by

fblgit

Feature Request: change request file format to disambiguate chat and non-chat models?

#954 opened 5 months ago by

CombinHorizon

Feature request: Add toggle to only show models with linked dataset

#763 opened 9 months ago by

ThiloteE

Feature request: Hide models with insufficient model card from default view in leaderboard

#762 opened 9 months ago by

ThiloteE

Discussion: naming pattern to converge on to better identify fine-tunes

17

#761 opened 9 months ago by

ThiloteE

Crowd-Source Hardware for the LeaderBoard?

#570 opened about 1 year ago by

ibivibiv

Feature request: Using weights hash to identify duplicates