fluency-score-classification-ja

README.md

@@ -15,8 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [line-corporation/line-distilbert-base-japanese](https://huggingface.co/line-corporation/line-distilbert-base-japanese) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.5616
-- Roc Auc: 0.9615
+- Loss: 0.1912
+- Roc Auc: 0.9811
 
 ## Model description
 
@@ -36,20 +36,23 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 1e-05
-- train_batch_size: 8
+- train_batch_size: 64
 - eval_batch_size: 8
 - seed: 42
 - distributed_type: tpu
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 2
+- num_epochs: 5
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Roc Auc |
 |:-------------:|:-----:|:----:|:---------------:|:-------:|
-| No log        | 1.0   | 175  | 0.5897          | 0.9561  |
-| No log        | 2.0   | 350  | 0.5616          | 0.9615  |
+| 0.4582        | 1.0   | 647  | 0.2887          | 0.9679  |
+| 0.2664        | 2.0   | 1294 | 0.2224          | 0.9761  |
+| 0.2177        | 3.0   | 1941 | 0.2047          | 0.9793  |
+| 0.1899        | 4.0   | 2588 | 0.1944          | 0.9807  |
+| 0.1865        | 5.0   | 3235 | 0.1912          | 0.9811  |
 
 
 ### Framework versions