Hugging Face's logo

Spaces:
kmfoda
/
bittensor_lmeh_evaluations
Runtime error

App Files Community
bittensor_lmeh_evaluations / README.md
kmfoda's picture
kmfoda
Initial upload
9866f52
preview code
|
raw
history blame
697 Bytes
metadata
title: Bittensor Lmeh Evaluations
emoji: 🏆
colorFrom: green
colorTo: indigo
sdk: gradio
sdk_version: 3.33.1
app_file: app.py
pinned: false

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

HF LLM Leaderboard Evluation Scripts for Bittensor Validatos

Install LM-Eval 

git clone https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .

Running Evaluations on Bittensor's Validator 

python3 eval_bittensor.py --validator opentensor_foundation

Running Evaluations on Bittensor's Validator 

export BITAPAI_KEY = XXXX
python3 eval_bittensor.py --validator tasostats