Hugging Face's logo

thrunlab
/
sparse_mistral_7b_refined_web_50p_2024-05-11

Text Generation
Transformers
Safetensors
sparse_llama
Generated from Trainer
custom_code
Model card Files Community
vxbrandon commited on
Commit
162ef7d
·
verified ·
1 Parent(s): 33da1c6

End of training

Browse files
Files changed (5) hide show
  1. README.md +6 -2
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
  5. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.2460
19
 
20
  ## Model description
21
 
@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
43
  - total_train_batch_size: 8
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - training_steps: 150
47
 
48
  ### Training results
49
 
@@ -55,6 +55,10 @@ The following hyperparameters were used during training:
55
  | 2.2099 | 0.01 | 100 | 2.2887 |
56
  | 2.5167 | 0.01 | 125 | 2.2791 |
57
  | 2.3594 | 0.01 | 150 | 2.2683 |
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.2277
19
 
20
  ## Model description
21
 
 
43
  - total_train_batch_size: 8
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - training_steps: 250
47
 
48
  ### Training results
49
 
 
55
  | 2.2099 | 0.01 | 100 | 2.2887 |
56
  | 2.5167 | 0.01 | 125 | 2.2791 |
57
  | 2.3594 | 0.01 | 150 | 2.2683 |
58
+ | 2.3152 | 0.01 | 175 | 2.2626 |
59
+ | 2.2773 | 0.02 | 200 | 2.2579 |
60
+ | 2.2179 | 0.02 | 225 | 2.2553 |
61
+ | 2.3061 | 0.02 | 250 | 2.2521 |
62
 
63
 
64
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:46786a4719e48ff2d266110c2cce0bff05e27cae57b1d7f38f3c211dd11624b4
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ad79d87a7cf9c29ad4dfa26dc8a6257dfda292b7f4d3234282ec722783d3c60
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82028725dbd329ccf1a901d94f5e815205d8d0cdcc8b4f36b165a98d917e5b2d
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce7e1871a175c5a856a9df500c4aa056d9bb96d0781e9eebf58a2df01508c38f
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7aa55026675c4faa1d192c5553f321fb5019d856fa87151fe5b2c54e904fcaf8
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba3be1a12896c623faf47742558e64bc13bd24c6b69045f2119517375f81a74f
3
  size 4540516344
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1021d360ff84d968cd82ca741dab6d9757e035c95e97cc84fac989f8aca903e5
3
  size 6456
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f3b14d45f6ea1ac56781e5c79002c7e10fe6ba7f2b72106d0f02a6f2ae3a38e
3
  size 6456