Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 12k

Running on CPU Upgrade

Hi!
Have you tried toggling "Show flagged models"?
In case it's not a flag issue, to help our investigation, can you follow the steps in the FAQ? (point to the request file, eventual result file if existing?)

no. showing flagged models does not show my model and only toggling "show private/gated models" option shows model(which is, in my knowledge, not gated or private).
in FAQ, there is no further steps I can follow(my model is, already evaluated many days ago and properly shown at that time). I am not trying to rename/resubmit model. only changing visibility on leaderboard
seems my model is not "flagged", can you investigate further?

Wait, just to make sure, your model was shown on the leaderboard before but stopped showing?
This is very weird, could you please point to the results and request files?

I too submitted vikash06/llama-2-7b-small-model-new for evaluation 12 hours ago. I am not able to see it either in queue or in evaluated list. I am sure it has not failed.

Hi @vikash06 ,
Your problem is unrelated, as it's likely your model failed because we are having connectivity problems on the cluster - the leaderboard has been put on hold temporarily for this reason.
Please open a dedicated issue next time (with a pointer to the request and result files of your models (following the FAQ))

| Wait, just to make sure, your model was shown on the leaderboard before but stopped showing?
this is correct
| This is very weird, could you please point to the results and request files?
I dont know what this actually means, but I can give you the result link.
https://huggingface.co/datasets/open-llm-leaderboard/details_leejunhyeok__MoMo-70B-LoRA-V1.2_1
thank you
@clefourrier

Hi, The request file is the file used by the leaderboard to store model metadata. It can be found here, can you please link to the file corresponding to your model ?

yes.
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/leejunhyeok/MoMo-70B-LoRA-V1.2_1_eval_request_False_bfloat16_Adapter.json
maybe this is the file @SaylorTwift you are requesting(I really hope so)

It is ! We will look into why your model isn't showing asap :)

This problem seems to be fixed as I can now display your model in the leaderboard! Closing but feel free to reopen if needed :)

it is visible now. thank you