Hugging Face's logo

Spaces:
kmfoda
/
bittensor_lmeh_evaluations
Runtime error

App Files Community
bittensor_lmeh_evaluations
File size: 697 Bytes 
9866f52
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
 
---
title: Bittensor Lmeh Evaluations
emoji: 🏆
colorFrom: green
colorTo: indigo
sdk: gradio
sdk_version: 3.33.1
app_file: app.py
pinned: false
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

# HF LLM Leaderboard Evluation Scripts for Bittensor Validatos

### Install LM-Eval

```
git clone https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .
```

### Running Evaluations on Bittensor's Validator

```
python3 eval_bittensor.py --validator opentensor_foundation
```

### Running Evaluations on Bittensor's Validator

```
export BITAPAI_KEY = XXXX
python3 eval_bittensor.py --validator tasostats
```