Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,12 @@ tags:
|
|
18 |
license: llama3.1
|
19 |
license_link: LICENSE
|
20 |
quantized_by: jartine
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
---
|
22 |
|
23 |
# Meta Llama 3.1 8B Instruct - llamafile
|
@@ -67,6 +73,32 @@ Having **trouble?** See the ["Gotchas"
|
|
67 |
section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
|
68 |
of the README.
|
69 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
70 |
---
|
71 |
|
72 |
## Model Information
|
|
|
18 |
license: llama3.1
|
19 |
license_link: LICENSE
|
20 |
quantized_by: jartine
|
21 |
+
prompt_template: |
|
22 |
+
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
23 |
+
{{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
|
24 |
+
history_template: |
|
25 |
+
<|start_header_id|>{{name}}<|end_header_id|>
|
26 |
+
{{message}}<|eot_id|>
|
27 |
---
|
28 |
|
29 |
# Meta Llama 3.1 8B Instruct - llamafile
|
|
|
73 |
section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
|
74 |
of the README.
|
75 |
|
76 |
+
## Prompting
|
77 |
+
|
78 |
+
To have a good working chat experience when using the web GUI, you need
|
79 |
+
to fill out the text fields with the following values.
|
80 |
+
|
81 |
+
Prompt template:
|
82 |
+
|
83 |
+
```
|
84 |
+
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
85 |
+
{{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
|
86 |
+
```
|
87 |
+
|
88 |
+
History template:
|
89 |
+
|
90 |
+
```
|
91 |
+
<|start_header_id|>{{name}}<|end_header_id|>
|
92 |
+
{{message}}<|eot_id|>
|
93 |
+
```
|
94 |
+
|
95 |
+
## About llamafile
|
96 |
+
|
97 |
+
llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.
|
98 |
+
It uses Cosmopolitan Libc to turn LLM weights into runnable llama.cpp
|
99 |
+
binaries that run on the stock installs of six OSes for both ARM64 and
|
100 |
+
AMD64.
|
101 |
+
|
102 |
---
|
103 |
|
104 |
## Model Information
|