cjvt
/

matejklemen commited on
Commit
6d2c5e4
1 Parent(s): caee8e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -6,3 +6,14 @@ language:
6
 
7
  license: cc-by-4.0
8
  ---
 
 
 
 
 
 
 
 
 
 
 
 
6
 
7
  license: cc-by-4.0
8
  ---
9
+
10
+ # crosloengual-bert-si-nli
11
+
12
+ CroSloEngual BERT model finetuned on the SI-NLI dataset for Slovene natural language inference.
13
+ Fine-tuned in a classic sequence pair classification setting on the official training/validation/test split for 10 epochs, using validation set accuracy for model selection.
14
+ Optimized using the AdamW optimizer (learning rate 2e-5) and cross-entropy loss.
15
+ Using batch size `82` (selected based on the available GPU memory) and maximum sequence length `107` (99th percentile of the lengths in the training set).
16
+
17
+ Achieves the following metrics:
18
+ - best validation accuracy: `0.660`
19
+ - test accuracy = `0.673`