Update README.md
Browse files
README.md
CHANGED
@@ -22,8 +22,7 @@ inference:
|
|
22 |
repetition_penalty: 1.15
|
23 |
do_sample: true
|
24 |
temperature: 0.5
|
25 |
-
|
26 |
-
top_p: 0.9
|
27 |
---
|
28 |
|
29 |
# ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain
|
@@ -32,13 +31,20 @@ inference:
|
|
32 |
- Dataset: [KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format](https://huggingface.co/datasets/KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format)
|
33 |
- Training: 13.5h under [these parameters](https://huggingface.co/Felladrin/llama2_xs_460M_experimental_evol_instruct/blob/cc151c5669ea37c3ef972e375c74f2d9bfd92b49/training_params.json)
|
34 |
|
35 |
-
## Prompt
|
36 |
-
|
37 |
-
It was trained in the following prompt format:
|
38 |
|
39 |
```
|
40 |
### Instruction:
|
41 |
<instruction>
|
42 |
|
43 |
### Response:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
```
|
|
|
22 |
repetition_penalty: 1.15
|
23 |
do_sample: true
|
24 |
temperature: 0.5
|
25 |
+
top_p: 0.5
|
|
|
26 |
---
|
27 |
|
28 |
# ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain
|
|
|
31 |
- Dataset: [KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format](https://huggingface.co/datasets/KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format)
|
32 |
- Training: 13.5h under [these parameters](https://huggingface.co/Felladrin/llama2_xs_460M_experimental_evol_instruct/blob/cc151c5669ea37c3ef972e375c74f2d9bfd92b49/training_params.json)
|
33 |
|
34 |
+
## Recommended Prompt Format
|
|
|
|
|
35 |
|
36 |
```
|
37 |
### Instruction:
|
38 |
<instruction>
|
39 |
|
40 |
### Response:
|
41 |
+
```
|
42 |
+
|
43 |
+
## Recommended Inference Parameters:
|
44 |
+
|
45 |
+
```yml
|
46 |
+
repetition_penalty: 1.15
|
47 |
+
do_sample: true
|
48 |
+
temperature: 0.5
|
49 |
+
top_p: 0.5
|
50 |
```
|