FpOliveira commited on
Commit
59baefe
·
1 Parent(s): 38cb5e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -10,4 +10,18 @@ metrics:
10
  - recall
11
  - f1
12
  pipeline_tag: text-classification
13
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  - recall
11
  - f1
12
  pipeline_tag: text-classification
13
+ ---
14
+
15
+ ## Introduction
16
+
17
+ Tupi-Bert-Base is a fine-tuned BERT model based on [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased) base.For further information or requests, please go to [BERTimbau repository](https://github.com/neuralmind-ai/portuguese-bert/)."
18
+
19
+ The performance of Language Models can change drastically when there is a domain shift between training and test data. In order create a Portuguese Language Model adapted to a Legal domain, the original BERTimbau model was submitted to a fine-tuning stage where it was performed 1 "PreTraining" epoch over 30 000 legal Portuguese Legal documents available online.
20
+
21
+
22
+ ## Available models
23
+
24
+ | Model | Arch. | #Layers | #Params |
25
+ | ---------------------------------------- | ---------- | ------- | ------- |
26
+ | `FpOliveira/tupi-bert-base-portuguese-cased` | BERT-Base |12 |110M|
27
+ | `FpOliveira/tupi-bert-large-portuguese-cased` | BERT-Large | 24 | 335M |