JackBAI commited on
Commit
2296863
1 Parent(s): bdb1101

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -30,7 +30,7 @@ Other training configuration:
30
  | ADAM_WEIGHT_DECAY | 0.01 |
31
  | PEAK_LR | 1e-3 |
32
 
33
- Evaluation Results on GLUE after pretraining (30k steps):
34
 
35
  | Model | MRPC-F1 | STS-B-Pearson | SST-2-Acc | QQP-F1 | MNLI-m | MNLI-mm | QNLI-Acc | WNLI-Acc | RTE-Acc |
36
  |----------------|---------|---------------|-----------|--------|--------|---------|----------|----------|---------|
 
30
  | ADAM_WEIGHT_DECAY | 0.01 |
31
  | PEAK_LR | 1e-3 |
32
 
33
+ We achieve very similar performance as the official BERT-Medium release on GLUE:
34
 
35
  | Model | MRPC-F1 | STS-B-Pearson | SST-2-Acc | QQP-F1 | MNLI-m | MNLI-mm | QNLI-Acc | WNLI-Acc | RTE-Acc |
36
  |----------------|---------|---------------|-----------|--------|--------|---------|----------|----------|---------|