Update README.md
Browse files
README.md
CHANGED
@@ -11,10 +11,12 @@ widget:
|
|
11 |
|
12 |
# Arabic BERT Model
|
13 |
|
14 |
-
**AraBERTMo** is an Arabic pre-trained language model based on [Google's BERT architechture](https://github.com/google-research/bert).
|
|
|
15 |
|
16 |
-
AraBERTMo_base now comes in 10 new variants
|
17 |
-
All models are available on the `HuggingFace` model page under the [Ebtihal](https://huggingface.co/Ebtihal/) name.
|
|
|
18 |
|
19 |
|
20 |
## Pretraining Corpus
|
@@ -43,7 +45,6 @@ tokenizer = AutoTokenizer.from_pretrained("Ebtihal/AraBertMo_base_V1")
|
|
43 |
model = AutoModelForMaskedLM.from_pretrained("Ebtihal/AraBertMo_base_V1")
|
44 |
```
|
45 |
|
46 |
-
|
47 |
## This model was built for master's degree research in an organization:
|
48 |
- [University of kufa](https://uokufa.edu.iq/).
|
49 |
- [Faculty of Computer Science and Mathematics](https://mathcomp.uokufa.edu.iq/).
|
|
|
11 |
|
12 |
# Arabic BERT Model
|
13 |
|
14 |
+
**AraBERTMo** is an Arabic pre-trained language model based on [Google's BERT architechture](https://github.com/google-research/bert).
|
15 |
+
- AraBERTMo_base uses the same BERT-Base config.
|
16 |
|
17 |
+
- AraBERTMo_base now comes in 10 new variants
|
18 |
+
- All models are available on the `HuggingFace` model page under the [Ebtihal](https://huggingface.co/Ebtihal/) name.
|
19 |
+
- Checkpoints are available in PyTorch formats.
|
20 |
|
21 |
|
22 |
## Pretraining Corpus
|
|
|
45 |
model = AutoModelForMaskedLM.from_pretrained("Ebtihal/AraBertMo_base_V1")
|
46 |
```
|
47 |
|
|
|
48 |
## This model was built for master's degree research in an organization:
|
49 |
- [University of kufa](https://uokufa.edu.iq/).
|
50 |
- [Faculty of Computer Science and Mathematics](https://mathcomp.uokufa.edu.iq/).
|