huseinzol05 commited on
Commit
61855d5
1 Parent(s): 83df426

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -16
README.md CHANGED
@@ -7,14 +7,15 @@ metrics:
7
  - sacrebleu
8
  ---
9
 
10
- # finetune-paraphrase-t5-base-standard-bahasa-cased
11
 
12
- Finetuned T5 base on MS paraphrase tasks.
13
 
14
  ## Dataset
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
 
18
 
19
  ## Finetune details
20
 
@@ -28,23 +29,23 @@ Scripts at https://github.com/huseinzol05/malaya/tree/master/session/paraphrase/
28
 
29
  ## Evaluation
30
 
31
- Evaluated on MRPC validation set and PAWS test set.
32
 
33
  ```
34
  {'name': 'BLEU',
35
- 'score': 58.764876478744064,
36
  '_mean': -1.0,
37
  '_ci': -1.0,
38
- '_verbose': '84.5/65.8/53.0/43.1 (BP = 0.984 ratio = 0.985 hyp_len = 138828 ref_len = 141004)',
39
- 'bp': 0.9844481274610702,
40
- 'counts': [117307, 86700, 66087, 50665],
41
- 'totals': [138828, 131754, 124680, 117606],
42
- 'sys_len': 138828,
43
- 'ref_len': 141004,
44
- 'precisions': [84.49808396000807,
45
- 65.80445375472472,
46
- 53.00529355149182,
47
- 43.080285019471795],
48
- 'prec_str': '84.5/65.8/53.0/43.1',
49
- 'ratio': 0.9845678136790446}
50
  ```
 
7
  - sacrebleu
8
  ---
9
 
10
+ # finetune-paraphrase-t5-tiny-standard-bahasa-cased
11
 
12
+ Finetuned T5 tiny on MS paraphrase tasks.
13
 
14
  ## Dataset
15
 
16
  1. translated PAWS, https://huggingface.co/datasets/mesolitica/translated-PAWS
17
  2. translated MRPC, https://huggingface.co/datasets/mesolitica/translated-MRPC
18
+ 3. translated ParaSCI, https://huggingface.co/datasets/mesolitica/translated-paraSCI
19
 
20
  ## Finetune details
21
 
 
29
 
30
  ## Evaluation
31
 
32
+ Evaluated on MRPC validation set and ParaSCI Arxiv test set.
33
 
34
  ```
35
  {'name': 'BLEU',
36
+ 'score': 35.95965899952292,
37
  '_mean': -1.0,
38
  '_ci': -1.0,
39
+ '_verbose': '61.7/41.3/32.0/25.8 (BP = 0.944 ratio = 0.946 hyp_len = 95593 ref_len = 101064)',
40
+ 'bp': 0.9443747373110852,
41
+ 'counts': [59014, 37157, 27016, 20383],
42
+ 'totals': [95593, 90049, 84505, 78961],
43
+ 'sys_len': 95593,
44
+ 'ref_len': 101064,
45
+ 'precisions': [61.73464584226878,
46
+ 41.263090095392506,
47
+ 31.969705934560086,
48
+ 25.81400944770203],
49
+ 'prec_str': '61.7/41.3/32.0/25.8',
50
+ 'ratio': 0.9458659859099184}
51
  ```