HyeonwooKim

#68 opened 2 months ago by

crom1543

Update leaderboard so can support newer models?

#69 opened about 1 month ago by

CombinHorizon

Model "xxx" was not found on hub! error.

#70 opened 26 days ago by

lcw99

Model "kimdeokgi/ko-pt-model-test1" was not found on hub!

#71 opened 25 days ago by

kimdeokgi

New activity in PJMixers/Math-Multiturn-100K-ShareGPT 2 months ago

License?

#2 opened 2 months ago by

New activity in upstage/open-ko-llm-leaderboard 2 months ago

리스트 수정 문의

9

#66 opened 2 months ago by

yhkim9362

LLM Benchmark 에 결과가 보이지 않습니다.

#67 opened 2 months ago by

mssma

New activity in MaziyarPanahi/WizardLM_evol_instruct_V2_196k 2 months ago

GPT License?

#3 opened 2 months ago by

New activity in TIGER-Lab/MATH-plus 2 months ago

GPT is OpenAI or Azure?

#2 opened 2 months ago by

New activity in upstage/open-ko-llm-leaderboard 3 months ago

모델 평가 실패 문의

#65 opened 3 months ago by

yhkim9362

모델 업로드 문의

#64 opened 3 months ago by

ParkTaeEon

모델 평가 실패 문의

#63 opened 3 months ago by

12thD

New activity in dhiruHF/docqa_train 3 months ago

Hello, How to make a dataset?

#1 opened 3 months ago by

New activity in yuyijiong/Long-Instruction-with-Paraphrasing 3 months ago

Load error.

#3 opened 3 months ago by

Data License?

#2 opened 3 months ago by

New activity in upstage/open-ko-llm-leaderboard 3 months ago

제출 에러

#58 opened 4 months ago by

jylee420

Model Evaluation Speed

#61 opened 3 months ago by

hkss

Benchmark links

#60 opened 3 months ago by

oiwio

New activity in choco9966/open-ko-llm-leaderboard 3 months ago

Any idea what's going on?

#2 opened 3 months ago by

zhiminy

New activity in upstage/open-ko-llm-leaderboard 3 months ago

Update requirements.txt

#59 opened 3 months ago by

New activity in upstage/open-ko-llm-leaderboard 4 months ago

evaluation prompt의 형식이 어떻게 되는지요?

#56 opened 4 months ago by

beomgon

모델 평가 실패

#57 opened 4 months ago by

sel303

모델 제출 관련 문의

5

#54 opened 4 months ago by

julleong

Update requirements.txt

5

#55 opened 4 months ago by

[GPU 이슈 관련 해결 공지]

#53 opened 4 months ago by

New activity in upstage/open-ko-llm-leaderboard 5 months ago

⁉️ FAQ ⁉️ - Start here before opening an issue

10

#1 opened 10 months ago by

BearSean

Update src/submission/submit.py

#52 opened 5 months ago by

Orion-14B-Base 평가 지원을 위한 trust code 활성화 문의

#51 opened 5 months ago by

rippertnt

Can I check the failure log?

7

#39 opened 6 months ago by

JeongwonChoi

instructkr/ko-wand-136M 모델 제출 불가

#50 opened 5 months ago by

Seeking Clarification on a Model Flagging Issue

#47 opened 5 months ago by

beomi

Wrong model flag.

#41 opened 6 months ago by

Update src/leaderboard/read_evals.py

#48 opened 5 months ago by

평가지표 자체 학습 관련 건

8

#44 opened 6 months ago by

Januaryyyy

New activity in upstage/open-ko-llm-leaderboard 6 months ago

Update src/submission/submit.py

#46 opened 6 months ago by

Update src/leaderboard/filter_models.py

#45 opened 6 months ago by

모델 재평가 문의

#42 opened 6 months ago by

DopeorNope

모델들 관련 점검이 필요합니다.

#40 opened 6 months ago by

DopeorNope

Cannot submit model.

6

#26 opened 7 months ago by

[Suggestion] Add requirement for model card.

#37 opened 6 months ago by

New activity in open-ko-llm-leaderboard/requests 6 months ago

pr/5

#5 opened 6 months ago by

refs/pr/4

#4 opened 6 months ago by

refs/pr/3

#3 opened 6 months ago by

New activity in upstage/open-ko-llm-leaderboard 6 months ago

[FLAG] dasomysky/unv_test_v0.1.0

#35 opened 6 months ago by

kyujinpy

model evaluation failed

#36 opened 6 months ago by

realPCH

Evaluation prompt 관련 문의

#38 opened 6 months ago by

JaeyeonKang

New activity in open-ko-llm-leaderboard/results 6 months ago

Delete kyujinpy/Mistral-7B-ko-v1/result_2023-11-17 02:55:15.json

#3 opened 6 months ago by

kyujinpy

New activity in upstage/open-ko-llm-leaderboard 6 months ago

Model was not found on hub

7

#31 opened 6 months ago by

JaeyeonKang

Does MoE model supported?

#34 opened 6 months ago by

[Add] upstage model forbidden feat

#32 opened 6 months ago by

Stop submitting upstage models

#33 opened 6 months ago by

BearSean

How to download the leaderboard results as csv or json format?

#30 opened 7 months ago by

zhiminy

New activity in upstage/open-ko-llm-leaderboard 7 months ago

순위 탭이 있다면 좋을것 같습니다

#25 opened 8 months ago by

The-matt

How many shots are used for the evaluation?

#29 opened 7 months ago by

zhiminy

Can I get the error log for my failed model?

#27 opened 7 months ago by

heavytail

New activity in upstage/open-ko-llm-leaderboard 8 months ago

maywell/koOpenChat-sft model keep failing on benchmark.

#24 opened 8 months ago by

revision update

#21 opened 8 months ago by

lcw99

no failed category

#22 opened 8 months ago by

The-matt

[Feat] add fail category

#23 opened 8 months ago by

New activity in choco9966/open-ko-llm-leaderboard 8 months ago

[Feat] Add Failed Category

#1 opened 8 months ago by