Update README.md
Browse files
README.md
CHANGED
@@ -33,6 +33,23 @@ The hypothesis is that it degrades the probability of English replies and increa
|
|
33 |
|
34 |
Will keep you updated..
|
35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
36 |
### German benchmarks
|
37 |
|
38 |
| **German tasks:** | **MMLU-DE** | **Hellaswag-DE** | **ARC-DE** |**Average** |
|
|
|
33 |
|
34 |
Will keep you updated..
|
35 |
|
36 |
+
|
37 |
+
### Prompt format:
|
38 |
+
|
39 |
+
```python
|
40 |
+
streamer = TextStreamer(tokenizer, skip_prompt=True, skip_special_tokens=True)
|
41 |
+
# Convert prompt to tokens
|
42 |
+
prompt_template = """<|im_start|>system
|
43 |
+
Du bist ein hilfreicher Assistent.<|im_end|>
|
44 |
+
<|im_start|>user
|
45 |
+
{prompt}<|im_end|>
|
46 |
+
<|im_start|>assistant"""
|
47 |
+
|
48 |
+
prompt = "Schreibe eine Stellenanzeige für Data Scientist bei AXA!"
|
49 |
+
|
50 |
+
final_prompt = prompt_template.format(prompt=prompt)
|
51 |
+
```
|
52 |
+
|
53 |
### German benchmarks
|
54 |
|
55 |
| **German tasks:** | **MMLU-DE** | **Hellaswag-DE** | **ARC-DE** |**Average** |
|