matejklemen
commited on
Commit
•
6d2c5e4
1
Parent(s):
caee8e7
Update README.md
Browse files
README.md
CHANGED
@@ -6,3 +6,14 @@ language:
|
|
6 |
|
7 |
license: cc-by-4.0
|
8 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
|
7 |
license: cc-by-4.0
|
8 |
---
|
9 |
+
|
10 |
+
# crosloengual-bert-si-nli
|
11 |
+
|
12 |
+
CroSloEngual BERT model finetuned on the SI-NLI dataset for Slovene natural language inference.
|
13 |
+
Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs, using validation set accuracy for model selection.
|
14 |
+
Optimized using the AdamW optimizer (learning rate 2e-5) and cross-entropy loss.
|
15 |
+
Using batch size `82` (selected based on the available GPU memory) and maximum sequence length `107` (99th percentile of the lengths in the training set).
|
16 |
+
|
17 |
+
Achieves the following metrics:
|
18 |
+
- best validation accuracy: `0.660`
|
19 |
+
- test accuracy = `0.673`
|