File size: 475 Bytes
fd18680
 
 
 
 
 
550ef55
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
Dataset Size: 204416 Examples from squadv2 and NQ dataset

Trained for 1 epoch on TPU

Accuracy on Squadv2 dev

{'exact': 80.2998399730481,
 'f1': 83.4402145786235,
 'total': 11873,
 'HasAns_exact': 79.08232118758434,
 'HasAns_f1': 85.37207619635592,
 'HasAns_total': 5928,
 'NoAns_exact': 81.5138772077376,
 'NoAns_f1': 81.5138772077376,
 'NoAns_total': 5945,
 'best_exact': 80.2998399730481,
 'best_exact_thresh': 0.0,
 'best_f1': 83.44021457862335,
 'best_f1_thresh': 0.0}