Update README.md
Browse files
README.md
CHANGED
@@ -25,44 +25,22 @@ quantized_by: Second State Inc.
|
|
25 |
|
26 |
[01-ai/Yi-1.5-34B-Chat](https://huggingface.co/01-ai/Yi-1.5-34B-Chat)
|
27 |
|
28 |
-
## Run with
|
29 |
|
30 |
-
|
31 |
|
32 |
-
|
33 |
|
34 |
-
|
35 |
|
36 |
-
|
37 |
|
38 |
-
```text
|
39 |
-
<|im_start|>system
|
40 |
-
{system_message}<|im_end|>
|
41 |
-
<|im_start|>user
|
42 |
-
{prompt}<|im_end|>
|
43 |
-
<|im_start|>assistant
|
44 |
-
```
|
45 |
|
46 |
-
|
47 |
|
48 |
-
-
|
49 |
|
50 |
-
|
51 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-Q5_K_M.gguf \
|
52 |
-
llama-api-server.wasm \
|
53 |
-
--prompt-template chatml \
|
54 |
-
--ctx-size 7168 \
|
55 |
-
--model-name Yi-1.5-34B-Chat
|
56 |
-
```
|
57 |
-
|
58 |
-
- Run as LlamaEdge command app
|
59 |
-
|
60 |
-
```bash
|
61 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-Q5_K_M.gguf \
|
62 |
-
llama-chat.wasm \
|
63 |
-
--prompt-template chatml \
|
64 |
-
--ctx-size 7168
|
65 |
-
```
|
66 |
|
67 |
## Quantized GGUF Models
|
68 |
|
|
|
25 |
|
26 |
[01-ai/Yi-1.5-34B-Chat](https://huggingface.co/01-ai/Yi-1.5-34B-Chat)
|
27 |
|
28 |
+
## Run with Gaianet
|
29 |
|
30 |
+
**Prompt template:**
|
31 |
|
32 |
+
prompt template: `chatml`
|
33 |
|
34 |
+
**Context size:**
|
35 |
|
36 |
+
chat_ctx_size: `4096`
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
+
**Run with GaiaNet:**
|
40 |
|
41 |
+
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
|
42 |
|
43 |
+
- Customize your node: https://docs.gaianet.ai/node-guide/customize
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
|
45 |
## Quantized GGUF Models
|
46 |
|