Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
1 |
# Bangla-Electra
|
2 |
|
3 |
This is a second attempt at a Bangla/Bengali language model trained with
|
@@ -5,10 +9,9 @@ Google Research's [ELECTRA](https://github.com/google-research/electra).
|
|
5 |
|
6 |
Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
|
7 |
|
8 |
-
V1 - 120,000 steps
|
9 |
-
V2 - 190,000 steps
|
10 |
|
11 |
-
##
|
12 |
|
13 |
Classification with SimpleTransformers: https://colab.research.google.com/drive/1vltPI81atzRvlALv4eCvEB0KdFoEaCOb
|
14 |
|
@@ -17,6 +20,11 @@ On Soham Chatterjee's [news classification task](https://github.com/soham96/Bang
|
|
17 |
|
18 |
Similar to mBERT on some tasks and configurations described in https://arxiv.org/abs/2004.07807
|
19 |
|
|
|
|
|
|
|
|
|
|
|
20 |
## Corpus
|
21 |
|
22 |
Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)
|
|
|
1 |
+
---
|
2 |
+
language: bn
|
3 |
+
---
|
4 |
+
|
5 |
# Bangla-Electra
|
6 |
|
7 |
This is a second attempt at a Bangla/Bengali language model trained with
|
|
|
9 |
|
10 |
Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
|
11 |
|
12 |
+
V1 - 120,000 steps; V2 - 190,000 steps
|
|
|
13 |
|
14 |
+
## Classification
|
15 |
|
16 |
Classification with SimpleTransformers: https://colab.research.google.com/drive/1vltPI81atzRvlALv4eCvEB0KdFoEaCOb
|
17 |
|
|
|
20 |
|
21 |
Similar to mBERT on some tasks and configurations described in https://arxiv.org/abs/2004.07807
|
22 |
|
23 |
+
## Question Answering
|
24 |
+
|
25 |
+
This model can be used for Question Answering - this notebook uses Bangla questions from Google's TyDi dataset:
|
26 |
+
https://colab.research.google.com/drive/1i6fidh2tItf_-IDkljMuaIGmEU6HT2Ar
|
27 |
+
|
28 |
## Corpus
|
29 |
|
30 |
Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)
|