patrickvonplaten
commited on
Commit
•
6c73355
1
Parent(s):
663799f
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ datasets:
|
|
10 |
# FNet base model
|
11 |
|
12 |
Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was
|
13 |
-
introduced in [this paper](https://arxiv.org/abs/2105.03824) and first released in [this repository](https://github.com/google-research/f_net).
|
14 |
This model is uncased: it does not make a difference between english and English. The model achieves 0.58 accuracy on MLM objective and 0.80 on NSP objective.
|
15 |
|
16 |
Disclaimer: This model card has been written by [gchhablani](https://huggingface.co/gchhablani).
|
|
|
10 |
# FNet base model
|
11 |
|
12 |
Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was
|
13 |
+
introduced in [this paper](https://arxiv.org/abs/2105.03824) and first released in [this repository](https://github.com/google-research/google-research/tree/master/f_net).
|
14 |
This model is uncased: it does not make a difference between english and English. The model achieves 0.58 accuracy on MLM objective and 0.80 on NSP objective.
|
15 |
|
16 |
Disclaimer: This model card has been written by [gchhablani](https://huggingface.co/gchhablani).
|