lewtun HF staff commited on
Commit
03fee00
1 Parent(s): bf9c36b

Add evaluation results on the squad_v2 config of squad_v2

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the squad_v2 config of the [squad_v2](https://huggingface.co/datasets/squad_v2) dataset by

@nbroad

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-project-squad_v2-1e2c143e-1305549899).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=squad_v2).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=squad_v2).

Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -22,6 +22,23 @@ model-index:
22
  type: f1
23
  value: 55.135
24
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  task:
26
  - question-answering
27
  datasets:
 
22
  type: f1
23
  value: 55.135
24
  verified: true
25
+ - task:
26
+ type: question-answering
27
+ name: Question Answering
28
+ dataset:
29
+ name: squad_v2
30
+ type: squad_v2
31
+ config: squad_v2
32
+ split: validation
33
+ metrics:
34
+ - name: Exact Match
35
+ type: exact_match
36
+ value: 79.2432
37
+ verified: true
38
+ - name: F1
39
+ type: f1
40
+ value: 82.336
41
+ verified: true
42
  task:
43
  - question-answering
44
  datasets: