suneeln-duke commited on
Commit
bd7e901
1 Parent(s): de2efb3

End of training

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [tiiuae/falcon-7b-instruct](https://huggingface.co/tiiuae/falcon-7b-instruct) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.1042
20
 
21
  ## Model description
22
 
@@ -44,18 +44,15 @@ The following hyperparameters were used during training:
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.03
47
- - num_epochs: 5
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:----:|:---------------:|
54
- | 1.3765 | 0.99 | 77 | 1.2102 |
55
- | 1.2009 | 1.99 | 155 | 1.1354 |
56
- | 1.0374 | 2.99 | 233 | 1.1166 |
57
- | 0.9339 | 3.99 | 311 | 1.1075 |
58
- | 1.2649 | 4.94 | 385 | 1.1042 |
59
 
60
 
61
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [tiiuae/falcon-7b-instruct](https://huggingface.co/tiiuae/falcon-7b-instruct) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.1976
20
 
21
  ## Model description
22
 
 
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
  - lr_scheduler_warmup_ratio: 0.03
47
+ - num_epochs: 2
48
  - mixed_precision_training: Native AMP
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:----:|:---------------:|
54
+ | 1.3801 | 0.99 | 77 | 1.2212 |
55
+ | 1.2524 | 1.98 | 154 | 1.1976 |
 
 
 
56
 
57
 
58
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7416cb4b6fd6d2c2c3e1271a8630457d0ae83a15f9fd3719827c2ec6089286a8
3
  size 75507072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f76417b6f6a3e06c1781769c0134eddadc74ba488b471ecf4d0cf52f8529108
3
  size 75507072
runs/Apr22_00-35-12_2a742794b7ee/events.out.tfevents.1713746113.2a742794b7ee.34.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8898d321dfc2e20cc0aa6b1c591acb7615bcc1131d805c7af8e66ab8d27d1c35
3
+ size 8678
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d3467c0873ede1ae1c0109c3bab19f2140f2d9c724c2d31f0ce93d39416b92c
3
  size 4219
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81e696705aceb01c09ae0c74364bad909a38ee4026a34603adbe7421ddf5c559
3
  size 4219