system HF staff commited on
Commit
6b1473a
1 Parent(s): a6591f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -3
README.md CHANGED
@@ -1,3 +1,7 @@
 
 
 
 
1
  # Bangla-Electra
2
 
3
  This is a second attempt at a Bangla/Bengali language model trained with
@@ -5,10 +9,9 @@ Google Research's [ELECTRA](https://github.com/google-research/electra).
5
 
6
  Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
7
 
8
- V1 - 120,000 steps
9
- V2 - 190,000 steps
10
 
11
- ## Benchmarks
12
 
13
  Classification with SimpleTransformers: https://colab.research.google.com/drive/1vltPI81atzRvlALv4eCvEB0KdFoEaCOb
14
 
@@ -17,6 +20,11 @@ On Soham Chatterjee's [news classification task](https://github.com/soham96/Bang
17
 
18
  Similar to mBERT on some tasks and configurations described in https://arxiv.org/abs/2004.07807
19
 
 
 
 
 
 
20
  ## Corpus
21
 
22
  Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)
 
1
+ ---
2
+ language: bn
3
+ ---
4
+
5
  # Bangla-Electra
6
 
7
  This is a second attempt at a Bangla/Bengali language model trained with
 
9
 
10
  Tokenization and pre-training CoLab: https://colab.research.google.com/drive/1gpwHvXAnNQaqcu-YNx1kafEVxz07g2jL
11
 
12
+ V1 - 120,000 steps; V2 - 190,000 steps
 
13
 
14
+ ## Classification
15
 
16
  Classification with SimpleTransformers: https://colab.research.google.com/drive/1vltPI81atzRvlALv4eCvEB0KdFoEaCOb
17
 
 
20
 
21
  Similar to mBERT on some tasks and configurations described in https://arxiv.org/abs/2004.07807
22
 
23
+ ## Question Answering
24
+
25
+ This model can be used for Question Answering - this notebook uses Bangla questions from Google's TyDi dataset:
26
+ https://colab.research.google.com/drive/1i6fidh2tItf_-IDkljMuaIGmEU6HT2Ar
27
+
28
  ## Corpus
29
 
30
  Trained on a web crawl from https://oscar-corpus.com/ (deduped version, 5.8GB) and 1 July 2020 dump of bn.wikipedia.org (414MB)