Commit
•
8b281df
1
Parent(s):
c1a5c58
Update README.md
Browse files
README.md
CHANGED
@@ -30,7 +30,7 @@ tags:
|
|
30 |
|
31 |
## Run with LlamaEdge
|
32 |
|
33 |
-
- LlamaEdge version: [v0.
|
34 |
|
35 |
- Prompt template
|
36 |
|
@@ -68,7 +68,7 @@ tags:
|
|
68 |
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \
|
69 |
llama-chat.wasm \
|
70 |
--prompt-template phi-3-chat \
|
71 |
-
--ctx-size 4000
|
72 |
```
|
73 |
|
74 |
## Quantized GGUF Models
|
|
|
30 |
|
31 |
## Run with LlamaEdge
|
32 |
|
33 |
+
- LlamaEdge version: [v0.12.2](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.12.2) and above
|
34 |
|
35 |
- Prompt template
|
36 |
|
|
|
68 |
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q5_K_M.gguf \
|
69 |
llama-chat.wasm \
|
70 |
--prompt-template phi-3-chat \
|
71 |
+
--ctx-size 4000
|
72 |
```
|
73 |
|
74 |
## Quantized GGUF Models
|