kepinsam commited on
Commit
83c735b
1 Parent(s): 10be92b

End of training

Browse files
README.md ADDED
@@ -0,0 +1,87 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model: facebook/nllb-200-distilled-600M
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - nusatranslation_mt
8
+ metrics:
9
+ - sacrebleu
10
+ model-index:
11
+ - name: ind-to-bbc-nmt-v6
12
+ results:
13
+ - task:
14
+ name: Sequence-to-sequence Language Modeling
15
+ type: text2text-generation
16
+ dataset:
17
+ name: nusatranslation_mt
18
+ type: nusatranslation_mt
19
+ config: nusatranslation_mt_btk_ind_source
20
+ split: test
21
+ args: nusatranslation_mt_btk_ind_source
22
+ metrics:
23
+ - name: Sacrebleu
24
+ type: sacrebleu
25
+ value: 31.0331
26
+ ---
27
+
28
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
29
+ should probably proofread and complete it, then remove this comment. -->
30
+
31
+ # ind-to-bbc-nmt-v6
32
+
33
+ This model is a fine-tuned version of [facebook/nllb-200-distilled-600M](https://huggingface.co/facebook/nllb-200-distilled-600M) on the nusatranslation_mt dataset.
34
+ It achieves the following results on the evaluation set:
35
+ - Loss: 1.1587
36
+ - Sacrebleu: 31.0331
37
+ - Gen Len: 45.1815
38
+
39
+ ## Model description
40
+
41
+ More information needed
42
+
43
+ ## Intended uses & limitations
44
+
45
+ More information needed
46
+
47
+ ## Training and evaluation data
48
+
49
+ More information needed
50
+
51
+ ## Training procedure
52
+
53
+ ### Training hyperparameters
54
+
55
+ The following hyperparameters were used during training:
56
+ - learning_rate: 5e-05
57
+ - train_batch_size: 8
58
+ - eval_batch_size: 16
59
+ - seed: 42
60
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
61
+ - lr_scheduler_type: linear
62
+ - lr_scheduler_warmup_ratio: 0.1
63
+ - num_epochs: 10
64
+ - mixed_precision_training: Native AMP
65
+
66
+ ### Training results
67
+
68
+ | Training Loss | Epoch | Step | Validation Loss | Sacrebleu | Gen Len |
69
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:-------:|
70
+ | 4.3415 | 1.0 | 825 | 1.6110 | 27.0363 | 45.267 |
71
+ | 1.415 | 2.0 | 1650 | 1.2550 | 30.5956 | 45.5 |
72
+ | 1.1044 | 3.0 | 2475 | 1.1769 | 31.2342 | 45.4315 |
73
+ | 0.951 | 4.0 | 3300 | 1.1532 | 31.8633 | 45.149 |
74
+ | 0.8409 | 5.0 | 4125 | 1.1340 | 31.5171 | 45.355 |
75
+ | 0.7582 | 6.0 | 4950 | 1.1273 | 31.0686 | 45.222 |
76
+ | 0.6937 | 7.0 | 5775 | 1.1387 | 31.3129 | 45.1355 |
77
+ | 0.6433 | 8.0 | 6600 | 1.1479 | 31.444 | 45.233 |
78
+ | 0.6056 | 9.0 | 7425 | 1.1521 | 31.3122 | 45.0945 |
79
+ | 0.5819 | 10.0 | 8250 | 1.1587 | 31.0331 | 45.1815 |
80
+
81
+
82
+ ### Framework versions
83
+
84
+ - Transformers 4.41.2
85
+ - Pytorch 2.3.0+cu121
86
+ - Datasets 2.14.6
87
+ - Tokenizers 0.19.1
generation_config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 0,
3
+ "decoder_start_token_id": 2,
4
+ "eos_token_id": 2,
5
+ "max_length": 200,
6
+ "pad_token_id": 1,
7
+ "transformers_version": "4.41.2"
8
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:389d4f1635368a67e9e0aacd60a8e0b67fecf110171bdf47e266a8add00ab65d
3
  size 2460354912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:733c6c7b9d1756dc08f747c960d266d36ebd214842cdddd76a6581039b7dc4b4
3
  size 2460354912
runs/Jul12_16-08-14_30f4c8624028/events.out.tfevents.1720800496.30f4c8624028.1417.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:41087573c84afeef25482b1a08fb6333cce2a65f9c8474f7bd526aff3d62df07
3
- size 11073
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b16448f2d28d667aef64878d66c522f2d684d678f11f52f8f39bc5628d647f8e
3
+ size 11427