Add evaluation results on the autoevaluate--squad-sample config and test split of autoevaluate/squad-sample

#2
by autoevaluator HF staff - opened
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -5,6 +5,33 @@ tags:
5
  datasets:
6
  - squad
7
  duplicated_from: autoevaluate/extractive-question-answering
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
5
  datasets:
6
  - squad
7
  duplicated_from: autoevaluate/extractive-question-answering
8
+ model-index:
9
+ - name: autoevaluate/extractive-question-answering-not-evaluated
10
+ results:
11
+ - task:
12
+ type: question-answering
13
+ name: Question Answering
14
+ dataset:
15
+ name: autoevaluate/squad-sample
16
+ type: autoevaluate/squad-sample
17
+ config: autoevaluate--squad-sample
18
+ split: test
19
+ metrics:
20
+ - type: f1
21
+ value: 76.9929
22
+ name: F1
23
+ verified: true
24
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWY4NmY3MmUxMTI1YjYxOGQ4ZGJiNTExZWE2MGQ3NWY1MGNkMGZiNDA1M2FiNjM2ODBmMmM3NTM0MTIzYTE3OSIsInZlcnNpb24iOjF9.KCqAF5uiJ5MErIARbRt7ZQQZyMCxyQosMzoDk6Z-_-mLBJ3x8DTJYUKbSgd2QvA7tjnWhIq81ba4tJ0D5OvmBg
25
+ - type: exact_match
26
+ value: 70.0
27
+ name: Exact Match
28
+ verified: true
29
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTRmNTIxNDFhYzBmNDdkOGJmNmQ2YTBjODMxZWZkYzA5Njg2MDVlZjFmZTllMDQ4MzExM2MzMjcwMTc3NmY1MyIsInZlcnNpb24iOjF9.WwsKGMpmxBLVfpwA9qH7f_uVIpECcmkxxUUutHjLnraxZiPG-B_Z7InQ0dWtrtseEIkcEx-Y3u3rnEtzYhNbBA
30
+ - type: loss
31
+ value: 1.203058123588562
32
+ name: loss
33
+ verified: true
34
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODcxZDRiNDcxNjY1MDhmZmZiMDY1NTQyOGFlMmY1NjA2ZDc0NzhlMzNhNjA5YzUyOWFhMTM1ZTM5ZjhiYjJhZCIsInZlcnNpb24iOjF9.mnJ3PJgb_sGpFEv8BYL9FAm7citwMfkCOL73aoEQxr8pQYLcdGllnq98F8fKfkfp9Z05H0xVxTdKlMGYO7XXCA
35
  ---
36
 
37
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You