Commit
·
59baefe
1
Parent(s):
38cb5e6
Update README.md
Browse files
README.md
CHANGED
@@ -10,4 +10,18 @@ metrics:
|
|
10 |
- recall
|
11 |
- f1
|
12 |
pipeline_tag: text-classification
|
13 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
- recall
|
11 |
- f1
|
12 |
pipeline_tag: text-classification
|
13 |
+
---
|
14 |
+
|
15 |
+
## Introduction
|
16 |
+
|
17 |
+
Tupi-Bert-Base is a fine-tuned BERT model based on [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) base.For further information or requests, please go to [BERTimbau repository](https://github.com/neuralmind-ai/portuguese-bert/)."
|
18 |
+
|
19 |
+
The performance of Language Models can change drastically when there is a domain shift between training and test data. In order create a Portuguese Language Model adapted to a Legal domain, the original BERTimbau model was submitted to a fine-tuning stage where it was performed 1 "PreTraining" epoch over 30 000 legal Portuguese Legal documents available online.
|
20 |
+
|
21 |
+
|
22 |
+
## Available models
|
23 |
+
|
24 |
+
| Model | Arch. | #Layers | #Params |
|
25 |
+
| ---------------------------------------- | ---------- | ------- | ------- |
|
26 |
+
| `FpOliveira/tupi-bert-base-portuguese-cased` | BERT-Base |12 |110M|
|
27 |
+
| `FpOliveira/tupi-bert-large-portuguese-cased` | BERT-Large | 24 | 335M |
|