smaximo commited on
Commit
afb5f2f
1 Parent(s): 03be9a1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: es
3
+ datasets:
4
+ - squad_es
5
+ ---
6
+ # roberta-base es for QA
7
+ This model is a fine-tuned version of [PlanTL-GOB-ES/roberta-base-bne](https://huggingface.co/PlanTL-GOB-ES/roberta-base-bne) on the [squad_es(v2)] (https://huggingface.co/datasets/squad_es) training dataset.
8
+
9
+
10
+ ## Hyperparameters
11
+
12
+ The hyperparameters were chosen based on those used in [deepset/roberta-base-squad2](https://huggingface.co/deepset/roberta-base-squad2), an english-based model trained for similar purposes
13
+
14
+ ```
15
+ --num_train_epochs 2
16
+ --learning_rate 3e-5
17
+ --max_seq_length 386
18
+ --doc_stride 128
19
+ ```
20
+
21
+ ## Performance
22
+
23
+ Evaluated on the [squad_es(v2)] (https://huggingface.co/datasets/squad_es) dev set.
24
+
25
+ ```
26
+ eval_exact": 62.13526733007252,
27
+ eval_f1": 69.38515019522332,
28
+
29
+
30
+ eval_HasAns_exact": 53.07017543859649,
31
+ eval_HasAns_f1": 67.57238714827123,
32
+ eval_HasAns_total": 5928,
33
+ eval_NoAns_exact": 71.19730185497471,
34
+ eval_NoAns_f1": 71.19730185497471,
35
+ eval_NoAns_total": 5930,
36
+
37
+ ```
38
+
39
+ ## Team
40
+
41
+ Santiago Maximo: [smaximo](https://huggingface.co/smaximo)