Spaces:
Running
on
CPU Upgrade
Model evaluation failed for 4bit model
My model evaluation for vihangd/smart-dan-sft-v0.1 has unfortunately failed.
The requests file with FAILED status can be found here: https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/vihangd/smart-dan-sft-v0.1_eval_request_False_4bit_Original.json
I would greatly appreciate any assistance in identifying the cause of the failure. Any insights or suggestions would be very helpful.
Thank you for your time and expertise.
Thanks for the quick response!
@alozowski
I noticed that the evaluation for my model ( vihangd/smart-dan-sft-v0.1 https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/vihangd/smart-dan-sft-v0.1_eval_request_False_4bit_Original.json) appears to have failed again.
Could you please shed some light on the potential cause? I'm unsure if it's related to the model itself or some other factor. Any insights you could provide would be greatly appreciated.
@alozowski Following up on the previous issue, I wanted to let you know that the model appears to have been resubmitted yesterday. While it entered a running state, it unfortunately failed again. I thought it would be helpful to keep you informed.