Update README.md
Browse files
README.md
CHANGED
@@ -100,9 +100,31 @@ Using the official [question answering notebook](https://github.com/huggingface/
|
|
100 |
'exact': 79.92082877116145,
|
101 |
'f1': 82.91749890730917,
|
102 |
'total': 11873}
|
103 |
-
|
|
|
|
|
104 |
|
105 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
106 |
|
107 |
## Authors
|
108 |
**Branden Chan:** branden.chan@deepset.ai
|
|
|
100 |
'exact': 79.92082877116145,
|
101 |
'f1': 82.91749890730917,
|
102 |
'total': 11873}
|
103 |
+
```
|
104 |
+
|
105 |
+
which is consistent with the officially reported results. Using the question answering `Evaluator` from `evaluate` gives:
|
106 |
|
107 |
+
```
|
108 |
+
{'HasAns_exact': 77.91835357624831,
|
109 |
+
'HasAns_f1': 84.07820736158186,
|
110 |
+
'HasAns_total': 5928,
|
111 |
+
'NoAns_exact': 81.91757779646763,
|
112 |
+
'NoAns_f1': 81.91757779646763,
|
113 |
+
'NoAns_total': 5945,
|
114 |
+
'best_exact': 79.92082877116145,
|
115 |
+
'best_exact_thresh': 0.996823787689209,
|
116 |
+
'best_f1': 82.99634576260925,
|
117 |
+
'best_f1_thresh': 0.996823787689209,
|
118 |
+
'exact': 79.92082877116145,
|
119 |
+
'f1': 82.9963457626089,
|
120 |
+
'latency_in_seconds': 0.016523243643392558,
|
121 |
+
'samples_per_second': 60.52080460605492,
|
122 |
+
'total': 11873,
|
123 |
+
'total_time_in_seconds': 196.18047177799986}
|
124 |
+
```
|
125 |
+
|
126 |
+
which is also consistent with the officially reported results.
|
127 |
+
|
128 |
|
129 |
## Authors
|
130 |
**Branden Chan:** branden.chan@deepset.ai
|