Updating README with 2.0 in name
Browse files
README.md
CHANGED
@@ -11,14 +11,14 @@ datasets:
|
|
11 |
- HPLT/HPLT2.0_cleaned
|
12 |
---
|
13 |
|
14 |
-
# HPLT
|
15 |
|
16 |
<img src="https://hplt-project.org/_next/static/media/logo-hplt.d5e16ca5.svg" width=12.5%>
|
17 |
|
18 |
This is one of the encoder-only monolingual language models trained as a second release by the [HPLT project](https://hplt-project.org/).
|
19 |
It is a so called masked language model. In particular, we used the modification of the classic BERT model named [LTG-BERT](https://aclanthology.org/2023.findings-eacl.146/).
|
20 |
|
21 |
-
|
22 |
|
23 |
All the HPLT encoder-only models use the same hyper-parameters, roughly following the BERT-base setup:
|
24 |
- hidden size: 768
|
|
|
11 |
- HPLT/HPLT2.0_cleaned
|
12 |
---
|
13 |
|
14 |
+
# HPLT v2.0 BERT for Armenian
|
15 |
|
16 |
<img src="https://hplt-project.org/_next/static/media/logo-hplt.d5e16ca5.svg" width=12.5%>
|
17 |
|
18 |
This is one of the encoder-only monolingual language models trained as a second release by the [HPLT project](https://hplt-project.org/).
|
19 |
It is a so called masked language model. In particular, we used the modification of the classic BERT model named [LTG-BERT](https://aclanthology.org/2023.findings-eacl.146/).
|
20 |
|
21 |
+
We present monolingual LTG-BERT models for more than 50 languages out of 191 total in the [HPLT v2.0 dataset](https://hplt-project.org/datasets/v2.0).
|
22 |
|
23 |
All the HPLT encoder-only models use the same hyper-parameters, roughly following the BERT-base setup:
|
24 |
- hidden size: 768
|