cwaud commited on
Commit
09f3c8c
1 Parent(s): d6ff45c

End of training

Browse files
Files changed (2) hide show
  1. README.md +12 -6
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -25,7 +25,13 @@ chat_template: llama3
25
  dataset_prepared_path: null
26
  datasets:
27
  - path: mhenrichsen/alpaca_2k_test
28
- type: alpaca
 
 
 
 
 
 
29
  debug: null
30
  deepspeed: null
31
  early_stopping_patience: null
@@ -90,7 +96,7 @@ xformers_attention: null
90
 
91
  This model is a fine-tuned version of [unsloth/Llama-3.2-3B-Instruct](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct) on the None dataset.
92
  It achieves the following results on the evaluation set:
93
- - Loss: 1.1166
94
 
95
  ## Model description
96
 
@@ -124,10 +130,10 @@ The following hyperparameters were used during training:
124
 
125
  | Training Loss | Epoch | Step | Validation Loss |
126
  |:-------------:|:------:|:----:|:---------------:|
127
- | 5.2097 | 0.0042 | 1 | 5.1479 |
128
- | 5.2103 | 0.0126 | 3 | 5.0747 |
129
- | 4.1538 | 0.0253 | 6 | 3.1044 |
130
- | 1.3549 | 0.0379 | 9 | 1.1166 |
131
 
132
 
133
  ### Framework versions
 
25
  dataset_prepared_path: null
26
  datasets:
27
  - path: mhenrichsen/alpaca_2k_test
28
+ type:
29
+ field_input: input
30
+ field_instruction: instruction
31
+ field_output: output
32
+ field_system: text
33
+ system_format: '{system}'
34
+ system_prompt: you are helpful
35
  debug: null
36
  deepspeed: null
37
  early_stopping_patience: null
 
96
 
97
  This model is a fine-tuned version of [unsloth/Llama-3.2-3B-Instruct](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct) on the None dataset.
98
  It achieves the following results on the evaluation set:
99
+ - Loss: 0.1861
100
 
101
  ## Model description
102
 
 
130
 
131
  | Training Loss | Epoch | Step | Validation Loss |
132
  |:-------------:|:------:|:----:|:---------------:|
133
+ | 5.4952 | 0.0042 | 1 | 5.3970 |
134
+ | 5.7261 | 0.0126 | 3 | 5.2652 |
135
+ | 4.0351 | 0.0253 | 6 | 2.8107 |
136
+ | 0.9007 | 0.0379 | 9 | 0.1861 |
137
 
138
 
139
  ### Framework versions
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8145ec4a4b61a66c658b1b9d738a3be4010db6dcccac967c6668e60dc7ef2cf3
3
  size 982663982
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d08d5c12f38b856ba21f482b9f13dcda26b3b7fe6789510ac67ba62169657a2a
3
  size 982663982