End of training
Browse files- README.md +12 -6
- adapter_model.bin +1 -1
README.md
CHANGED
@@ -25,7 +25,13 @@ chat_template: llama3
|
|
25 |
dataset_prepared_path: null
|
26 |
datasets:
|
27 |
- path: mhenrichsen/alpaca_2k_test
|
28 |
-
type:
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
debug: null
|
30 |
deepspeed: null
|
31 |
early_stopping_patience: null
|
@@ -90,7 +96,7 @@ xformers_attention: null
|
|
90 |
|
91 |
This model is a fine-tuned version of [unsloth/Llama-3.2-3B-Instruct](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct) on the None dataset.
|
92 |
It achieves the following results on the evaluation set:
|
93 |
-
- Loss:
|
94 |
|
95 |
## Model description
|
96 |
|
@@ -124,10 +130,10 @@ The following hyperparameters were used during training:
|
|
124 |
|
125 |
| Training Loss | Epoch | Step | Validation Loss |
|
126 |
|:-------------:|:------:|:----:|:---------------:|
|
127 |
-
| 5.
|
128 |
-
| 5.
|
129 |
-
| 4.
|
130 |
-
|
|
131 |
|
132 |
|
133 |
### Framework versions
|
|
|
25 |
dataset_prepared_path: null
|
26 |
datasets:
|
27 |
- path: mhenrichsen/alpaca_2k_test
|
28 |
+
type:
|
29 |
+
field_input: input
|
30 |
+
field_instruction: instruction
|
31 |
+
field_output: output
|
32 |
+
field_system: text
|
33 |
+
system_format: '{system}'
|
34 |
+
system_prompt: you are helpful
|
35 |
debug: null
|
36 |
deepspeed: null
|
37 |
early_stopping_patience: null
|
|
|
96 |
|
97 |
This model is a fine-tuned version of [unsloth/Llama-3.2-3B-Instruct](https://huggingface.co/unsloth/Llama-3.2-3B-Instruct) on the None dataset.
|
98 |
It achieves the following results on the evaluation set:
|
99 |
+
- Loss: 0.1861
|
100 |
|
101 |
## Model description
|
102 |
|
|
|
130 |
|
131 |
| Training Loss | Epoch | Step | Validation Loss |
|
132 |
|:-------------:|:------:|:----:|:---------------:|
|
133 |
+
| 5.4952 | 0.0042 | 1 | 5.3970 |
|
134 |
+
| 5.7261 | 0.0126 | 3 | 5.2652 |
|
135 |
+
| 4.0351 | 0.0253 | 6 | 2.8107 |
|
136 |
+
| 0.9007 | 0.0379 | 9 | 0.1861 |
|
137 |
|
138 |
|
139 |
### Framework versions
|
adapter_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 982663982
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d08d5c12f38b856ba21f482b9f13dcda26b3b7fe6789510ac67ba62169657a2a
|
3 |
size 982663982
|