Alfahluzi/bert2bert-extreme train 5 epochs with 4 batch size

README.md

@@ -4,18 +4,18 @@ tags:
 datasets:
 - id_liputan6
 model-index:
-- name: bert2bert-extreme-dropout-0.5-lr-5e-05-batchsize-4-encmaxlen-2048-decmaxlen-512
+- name: bert2bert-extreme
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# bert2bert-extreme-dropout-0.5-lr-5e-05-batchsize-4-encmaxlen-2048-decmaxlen-512
+# bert2bert-extreme
 
 This model was trained from scratch on the id_liputan6 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 8.6177
+- Loss: 9.4148
 - R1 Precision: 0.0188
 - R1 Recall: 0.0105
 - R1 Fmeasure: 0.0133
@@ -23,7 +23,7 @@ It achieves the following results on the evaluation set:
 - R2 Recall: 0.0
 - R2 Fmeasure: 0.0
 - Rl Precision: 0.0188
-- Rl Recall: 0.0105
+- Rl Recall: 0.0106
 - Rl Fmeasure: 0.0133
 
 ## Model description
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step   | Validation Loss | R1 Precision | R1 Recall | R1 Fmeasure | R2 Precision | R2 Recall | R2 Fmeasure | Rl Precision | Rl Recall | Rl Fmeasure |
 |:-------------:|:-----:|:------:|:---------------:|:------------:|:---------:|:-----------:|:------------:|:---------:|:-----------:|:------------:|:---------:|:-----------:|
-| 7.0769        | 1.0   | 96942  | 7.5336          | 0.0          | 0.0       | 0.0         | 0.0          | 0.0       | 0.0         | 0.0          | 0.0       | 0.0         |
-| 7.1014        | 2.0   | 193884 | 7.6800          | 0.0          | 0.0       | 0.0         | 0.0          | 0.0       | 0.0         | 0.0          | 0.0       | 0.0         |
-| 7.0648        | 3.0   | 290826 | 8.1448          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0105    | 0.0133      |
-| 7.0594        | 4.0   | 387768 | 8.4518          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0105    | 0.0133      |
-| 7.0322        | 5.0   | 484710 | 8.6177          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0105    | 0.0133      |
+| 7.0391        | 1.0   | 96942  | 8.9423          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0106    | 0.0133      |
+| 7.0611        | 2.0   | 193884 | 8.9023          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0106    | 0.0133      |
+| 7.0266        | 3.0   | 290826 | 9.4047          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0106    | 0.0133      |
+| 7.0237        | 4.0   | 387768 | 9.2888          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0106    | 0.0133      |
+| 6.9911        | 5.0   | 484710 | 9.4148          | 0.0188       | 0.0105    | 0.0133      | 0.0          | 0.0       | 0.0         | 0.0188       | 0.0106    | 0.0133      |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
+- Transformers 4.39.0
 - Pytorch 2.2.1
 - Datasets 2.18.0
 - Tokenizers 0.15.2

generation_config.json

@@ -3,5 +3,5 @@
   "decoder_start_token_id": 3,
   "eos_token_id": 4,
   "pad_token_id": 0,
-  "transformers_version": "4.38.2"
+  "transformers_version": "4.39.0"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ef30c55fce47b6deca001f00f5874c8a01be1363ee3ff25185e20ed372ad2a33
+oid sha256:3732a3ae46de8c6c9b75d474292dc59c500f0edce6145dd69c8b27809ab788a9
 size 1002850732

runs/Mar22_09-10-17_5379a042e07e/events.out.tfevents.1711098617.5379a042e07e.339.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e95cad0832240b027cc1d495bbb4d78a3977d8a235fa7d5062fa5937e4c8f453
-size 220231
+oid sha256:3adc93df362b4e25cd35e1b675a22e64a577dc1d9cdc1e0f7c77e8dd01fc8d04
+size 221368