Update README.md
Browse files
README.md
CHANGED
@@ -5,9 +5,9 @@ licenses:
|
|
5 |
- cc-by-nc-sa-4.0
|
6 |
---
|
7 |
|
8 |
-
# BanglaBERT (
|
9 |
|
10 |
-
This repository contains the pretrained discriminator checkpoint of the model **BanglaBERT (
|
11 |
|
12 |
For finetuning on different downstream tasks such as `Sentiment classification`, `Named Entity Recognition`, `Natural Language Inference` etc., refer to the scripts in the official GitHub [repository](https://github.com/csebuetnlp/banglabert).
|
13 |
|
|
|
5 |
- cc-by-nc-sa-4.0
|
6 |
---
|
7 |
|
8 |
+
# BanglaBERT (small)
|
9 |
|
10 |
+
This repository contains the pretrained discriminator checkpoint of the model **BanglaBERT (small)**. This is an [ELECTRA](https://openreview.net/pdf?id=r1xMH1BtvB) discriminator model pretrained with the Replaced Token Detection (RTD) objective. Finetuned models using this checkpoint achieve state-of-the-art results on many of the NLP tasks in bengali.
|
11 |
|
12 |
For finetuning on different downstream tasks such as `Sentiment classification`, `Named Entity Recognition`, `Natural Language Inference` etc., refer to the scripts in the official GitHub [repository](https://github.com/csebuetnlp/banglabert).
|
13 |
|