End of training
Browse files
README.md
CHANGED
@@ -20,9 +20,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
20 |
|
21 |
This model is a fine-tuned version of [google/madlad400-3b-mt](https://huggingface.co/google/madlad400-3b-mt) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
-
- Loss: 4.
|
24 |
-
- Bleu:
|
25 |
-
- Gen Len: 7.
|
26 |
|
27 |
## Model description
|
28 |
|
@@ -41,9 +41,9 @@ More information needed
|
|
41 |
### Training hyperparameters
|
42 |
|
43 |
The following hyperparameters were used during training:
|
44 |
-
- learning_rate: 0.
|
45 |
- train_batch_size: 18
|
46 |
-
- eval_batch_size:
|
47 |
- seed: 42
|
48 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
49 |
- lr_scheduler_type: linear
|
@@ -53,9 +53,9 @@ The following hyperparameters were used during training:
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
|
55 |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:-------:|
|
56 |
-
| 2.
|
57 |
-
| 2.
|
58 |
-
| 1.
|
59 |
|
60 |
|
61 |
### Framework versions
|
|
|
20 |
|
21 |
This model is a fine-tuned version of [google/madlad400-3b-mt](https://huggingface.co/google/madlad400-3b-mt) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 4.1804
|
24 |
+
- Bleu: 4.0833
|
25 |
+
- Gen Len: 7.1314
|
26 |
|
27 |
## Model description
|
28 |
|
|
|
41 |
### Training hyperparameters
|
42 |
|
43 |
The following hyperparameters were used during training:
|
44 |
+
- learning_rate: 0.00016
|
45 |
- train_batch_size: 18
|
46 |
+
- eval_batch_size: 18
|
47 |
- seed: 42
|
48 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
49 |
- lr_scheduler_type: linear
|
|
|
53 |
|
54 |
| Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
|
55 |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:-------:|
|
56 |
+
| 2.1185 | 1.0 | 4957 | 4.1772 | 3.9348 | 7.1858 |
|
57 |
+
| 2.0246 | 2.0 | 9914 | 4.1778 | 4.1343 | 7.1091 |
|
58 |
+
| 1.9755 | 3.0 | 14871 | 4.1804 | 4.0833 | 7.1314 |
|
59 |
|
60 |
|
61 |
### Framework versions
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 37803600
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f66d3d5a00637884dc5f28f0b9d33e3e5e5e6cb8283d0eebda00b55c154ad782
|
3 |
size 37803600
|
runs/Jun28_04-16-41_bd278a7072d8/events.out.tfevents.1719548908.bd278a7072d8.25.0
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b11620ea0908fda6324512a0630b6fe80fd8c4226a9ac35d8d73b035bb3abed2
|
3 |
+
size 13536
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5304
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3d2922f57801518c2b1e92a3a7edcff96cb329bb4f3c66b1da4fad9e390a0565
|
3 |
size 5304
|