gimarchetti commited on
Commit
5505a21
1 Parent(s): ea07cf4

End of training

Browse files
Files changed (3) hide show
  1. README.md +13 -3
  2. adapter_model.safetensors +1 -1
  3. training_args.bin +2 -2
README.md CHANGED
@@ -14,6 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
14
  # gm-lora-bfloat16-idefics2-8b-finetuned-mimic-report
15
 
16
  This model is a fine-tuned version of [HuggingFaceM4/idefics2-8b](https://huggingface.co/HuggingFaceM4/idefics2-8b) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
@@ -40,11 +42,19 @@ The following hyperparameters were used during training:
40
  - total_train_batch_size: 80
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
 
 
 
 
 
 
 
 
44
 
45
  ### Framework versions
46
 
47
  - Transformers 4.41.0.dev0
48
- - Pytorch 1.13.1+cu117
49
- - Datasets 2.19.0
50
  - Tokenizers 0.19.1
 
14
  # gm-lora-bfloat16-idefics2-8b-finetuned-mimic-report
15
 
16
  This model is a fine-tuned version of [HuggingFaceM4/idefics2-8b](https://huggingface.co/HuggingFaceM4/idefics2-8b) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.0959
19
 
20
  ## Model description
21
 
 
42
  - total_train_batch_size: 80
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 2
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:------:|:----:|:---------------:|
51
+ | 0.2177 | 0.8945 | 100 | 0.0992 |
52
+ | 0.1001 | 1.7889 | 200 | 0.0959 |
53
+
54
 
55
  ### Framework versions
56
 
57
  - Transformers 4.41.0.dev0
58
+ - Pytorch 2.2.1+cu121
59
+ - Datasets 2.19.1
60
  - Tokenizers 0.19.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d34a1a53e28bbd6e34df59a1b6194c37c22b67615821b7a8b61c63151651959b
3
  size 49840864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f18d8f7df2ee144fac07b8ca8cfc97f2143135a6a49118e55588692d96c38223
3
  size 49840864
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7c09e22a4eb0268423de5c078739f8680190685b79e08923e6772816f85cc911
3
- size 4731
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db9b141594ad2df95ea94258d2c83aa29a8b6a4e2a13b2ebe1d4fff133596d35
3
+ size 5240