Locutusque
commited on
Commit
•
7742090
1
Parent(s):
137832d
Update README.md
Browse files
README.md
CHANGED
@@ -28,10 +28,9 @@ inference:
|
|
28 |
parameters:
|
29 |
temperature: 0.4
|
30 |
do_sample: True
|
31 |
-
top_p: 0.
|
32 |
-
top_k:
|
33 |
max_new_tokens: 250
|
34 |
-
repetition_penalty: 1.14
|
35 |
---
|
36 |
Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
|
37 |
It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.
|
|
|
28 |
parameters:
|
29 |
temperature: 0.4
|
30 |
do_sample: True
|
31 |
+
top_p: 0.34
|
32 |
+
top_k: 30
|
33 |
max_new_tokens: 250
|
|
|
34 |
---
|
35 |
Base model Locutusque/TinyMistral-248M fully fine-tuned on Locutusque/InstructMix. During validation, this model achieved an average perplexity of 3.23 on Locutusque/InstructMix dataset.
|
36 |
It has so far been trained on approximately 608,000 examples. More epochs are planned for this model.
|