jartine commited on
Commit
ae54674
1 Parent(s): 653899a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md CHANGED
@@ -18,6 +18,12 @@ tags:
18
  license: llama3.1
19
  license_link: LICENSE
20
  quantized_by: jartine
 
 
 
 
 
 
21
  ---
22
 
23
  # Meta Llama 3.1 8B Instruct - llamafile
@@ -67,6 +73,32 @@ Having **trouble?** See the ["Gotchas"
67
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
68
  of the README.
69
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
70
  ---
71
 
72
  ## Model Information
 
18
  license: llama3.1
19
  license_link: LICENSE
20
  quantized_by: jartine
21
+ prompt_template: |
22
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
23
+ {{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
24
+ history_template: |
25
+ <|start_header_id|>{{name}}<|end_header_id|>
26
+ {{message}}<|eot_id|>
27
  ---
28
 
29
  # Meta Llama 3.1 8B Instruct - llamafile
 
73
  section](https://github.com/mozilla-ocho/llamafile/?tab=readme-ov-file#gotchas)
74
  of the README.
75
 
76
+ ## Prompting
77
+
78
+ To have a good working chat experience when using the web GUI, you need
79
+ to fill out the text fields with the following values.
80
+
81
+ Prompt template:
82
+
83
+ ```
84
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
85
+ {{prompt}}<|eot_id|>{{history}}<|start_header_id|>{{char}}<|end_header_id|>
86
+ ```
87
+
88
+ History template:
89
+
90
+ ```
91
+ <|start_header_id|>{{name}}<|end_header_id|>
92
+ {{message}}<|eot_id|>
93
+ ```
94
+
95
+ ## About llamafile
96
+
97
+ llamafile is a new format introduced by Mozilla Ocho on Nov 20th 2023.
98
+ It uses Cosmopolitan Libc to turn LLM weights into runnable llama.cpp
99
+ binaries that run on the stock installs of six OSes for both ARM64 and
100
+ AMD64.
101
+
102
  ---
103
 
104
  ## Model Information