mbert_trim_ende_wwm
该模型基于bert-base-multilingual-cased,使用TextPruner对词表进行裁剪,保留iwslt14德英数据集,用于测试bert-fused的翻译效果。 并且在iwslt14德英数据集上使用全词掩码wwm微调,数据的拼接方式是: de, en, de[sep]en, en[sep]de。
Model Details
lang:德英
vocab_size: 119547 -> 21443
model_size: 682M -> 392M
iwslt14 de_en BLEU: ?
- Downloads last month
- 4
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.