BATCH_SIZE=8

LEARNING_RATE=5e-05
MAX_LENGTH=512
FOLD=5

README.md

@@ -15,7 +15,7 @@ model-index:
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.7
+      value: 0.4
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -25,8 +25,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.9865
-- Accuracy: 0.7
+- Loss: 3.7283
+- Accuracy: 0.4
 
 ## Model description
 
@@ -57,16 +57,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 57   | 0.9709          | 0.56     |
-| No log        | 2.0   | 114  | 0.9606          | 0.56     |
-| No log        | 3.0   | 171  | 0.8709          | 0.58     |
-| No log        | 4.0   | 228  | 1.1197          | 0.64     |
-| No log        | 5.0   | 285  | 1.5820          | 0.7      |
-| No log        | 6.0   | 342  | 1.9291          | 0.66     |
-| No log        | 7.0   | 399  | 2.3598          | 0.62     |
-| No log        | 8.0   | 456  | 1.9134          | 0.7      |
-| 0.4021        | 9.0   | 513  | 1.9678          | 0.7      |
-| 0.4021        | 10.0  | 570  | 1.9865          | 0.7      |
+| No log        | 1.0   | 57   | 0.9481          | 0.56     |
+| No log        | 2.0   | 114  | 1.0163          | 0.56     |
+| No log        | 3.0   | 171  | 1.1452          | 0.38     |
+| No log        | 4.0   | 228  | 1.9038          | 0.54     |
+| No log        | 5.0   | 285  | 2.5529          | 0.4      |
+| No log        | 6.0   | 342  | 3.3545          | 0.42     |
+| No log        | 7.0   | 399  | 3.4529          | 0.44     |
+| No log        | 8.0   | 456  | 3.5855          | 0.4      |
+| 0.3564        | 9.0   | 513  | 3.7481          | 0.38     |
+| 0.3564        | 10.0  | 570  | 3.7283          | 0.4      |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8d1a252ace05a112d3a334b6db2f5f29d46c70610b6b7291ecbaa3f0bf1780b7
+oid sha256:926b8fb185544d418286ecfb2a9ad25abbda2fc9fab2cf0f37f99bab4c36f9fc
 size 438022317

runs/Sep12_10-55-48_f75bc58113e9/events.out.tfevents.1631445033.f75bc58113e9.87.17

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6afed96e90acb0d672af5e420af343886f5ada1a970d2c937180147698cdb78
+size 363

runs/Sep12_11-10-36_f75bc58113e9/1631445041.696324/events.out.tfevents.1631445041.f75bc58113e9.87.19

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3e010376db194c146714f68dd2dbf7a76d8db1fd4f8567b076beccca2462d11
+size 4247

runs/Sep12_11-10-36_f75bc58113e9/events.out.tfevents.1631445041.f75bc58113e9.87.18

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d8ce911fce81943a3232605450fd9e3fba6bb667122c2e160945c49f86f0aaf
+size 6878

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e6922478907bf9498297695bac0643622f67ab1bcaebc8edea9a94519f7ab8a0
+oid sha256:e3b1c67ade52b42ac09b58505530c2d501396654041c23fd3248d63a7d9eca4e
 size 2735