language: | |
- zh | |
tags: | |
- bert | |
license: "apache-2.0" | |
# Please use 'Bert' related functions to load this model! | |
## Chinese BERT with Whole Word Masking Fix MLM Parameters | |
Init parameters by https://huggingface.co/hfl/chinese-roberta-wwm-ext-large | |
miss mlm parameters issue https://github.com/ymcui/Chinese-BERT-wwm/issues/98 | |
Only train MLM parameters and freeze other parameters | |
More info in github https://github.com/genggui001/chinese_roberta_wwm_large_ext_fix_mlm | |