Hugging Face's logo

tsavage68
/
UTI2_M2_200steps_1e7rate_SFT

Text Generation
Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
tsavage68 commited on
Commit
26a72bf
•
1 Parent(s): c8a62aa

End of training

Browse files
Files changed (9) hide show
  1. README.md +11 -11
  2. final_checkpoint/model-00001-of-00003.safetensors +1 -1
  3. final_checkpoint/model-00002-of-00003.safetensors +1 -1
  4. final_checkpoint/model-00003-of-00003.safetensors +1 -1
  5. model-00001-of-00003.safetensors +1 -1
  6. model-00002-of-00003.safetensors +1 -1
  7. model-00003-of-00003.safetensors +1 -1
  8. tokenizer.json +1 -1
  9. training_args.bin +1 -1
README.md CHANGED
@@ -6,18 +6,18 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  model-index:
9
- - name: UTI_M2_200steps_1e7rate_SFT
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
- # UTI_M2_200steps_1e7rate_SFT
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.2252
21
 
22
  ## Model description
23
 
@@ -51,14 +51,14 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
- | 2.4021 | 0.3333 | 25 | 2.3941 |
55
- | 2.3235 | 0.6667 | 50 | 2.2471 |
56
- | 2.0863 | 1.0 | 75 | 1.9386 |
57
- | 1.6662 | 1.3333 | 100 | 1.5791 |
58
- | 1.2981 | 1.6667 | 125 | 1.2598 |
59
- | 1.229 | 2.0 | 150 | 1.2305 |
60
- | 1.2334 | 2.3333 | 175 | 1.2258 |
61
- | 1.2406 | 2.6667 | 200 | 1.2252 |
62
 
63
 
64
  ### Framework versions
 
6
  - sft
7
  - generated_from_trainer
8
  model-index:
9
+ - name: UTI2_M2_200steps_1e7rate_SFT
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
+ # UTI2_M2_200steps_1e7rate_SFT
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.0381
21
 
22
  ## Model description
23
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 2.6274 | 0.3333 | 25 | 2.6112 |
55
+ | 2.4866 | 0.6667 | 50 | 2.4091 |
56
+ | 2.1962 | 1.0 | 75 | 1.9992 |
57
+ | 1.5437 | 1.3333 | 100 | 1.3079 |
58
+ | 1.0688 | 1.6667 | 125 | 1.0635 |
59
+ | 0.9875 | 2.0 | 150 | 1.0426 |
60
+ | 1.0431 | 2.3333 | 175 | 1.0379 |
61
+ | 1.0727 | 2.6667 | 200 | 1.0381 |
62
 
63
 
64
  ### Framework versions
final_checkpoint/model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f933605c4c1d9fa48c07bd87ab98ea7fd0b9f572c0f0799e4b786130b9fdcf48
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aeb4fa461f23e2fed7db67f52f24451177397b6f4d517568b0d44b3b55b4c0d
3
  size 4943162240
final_checkpoint/model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fe10a8e2acdaa82ee7a600d9f312c29fbcf3782b4d215ccfffe362aadadd16a
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5db60e945e2cf9d0ee7932ad73528e95cd833640154d69016d5a508ec309c0d3
3
  size 4999819232
final_checkpoint/model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3104e404638339bcd0bb7a818706c5837925d3b6a0f8151a71cd26535731abc3
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a97bfabab610e2509217718eb25f54a8bdd99fba7bbc5ba1174fe7dbaee22a70
3
  size 4540516256
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f933605c4c1d9fa48c07bd87ab98ea7fd0b9f572c0f0799e4b786130b9fdcf48
3
  size 4943162240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aeb4fa461f23e2fed7db67f52f24451177397b6f4d517568b0d44b3b55b4c0d
3
  size 4943162240
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fe10a8e2acdaa82ee7a600d9f312c29fbcf3782b4d215ccfffe362aadadd16a
3
  size 4999819232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5db60e945e2cf9d0ee7932ad73528e95cd833640154d69016d5a508ec309c0d3
3
  size 4999819232
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3104e404638339bcd0bb7a818706c5837925d3b6a0f8151a71cd26535731abc3
3
  size 4540516256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a97bfabab610e2509217718eb25f54a8bdd99fba7bbc5ba1174fe7dbaee22a70
3
  size 4540516256
tokenizer.json CHANGED
@@ -2,7 +2,7 @@
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
- "max_length": 1024,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
 
2
  "version": "1.0",
3
  "truncation": {
4
  "direction": "Right",
5
+ "max_length": 100,
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7453145b9160a266ff99aa755ac493f009d0e2fa16aeca52198a1671baa224f5
3
  size 4603
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fd09386d10c59a34be81c8c1034c521a8ff99a71220dce15d6504cdc10fd024
3
  size 4603