alabulei commited on
Commit
0f99a26
1 Parent(s): 941f693

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -30
README.md CHANGED
@@ -25,44 +25,22 @@ quantized_by: Second State Inc.
25
 
26
  [01-ai/Yi-1.5-34B-Chat](https://huggingface.co/01-ai/Yi-1.5-34B-Chat)
27
 
28
- ## Run with LlamaEdge
29
 
30
- - LlamaEdge version: [v0.10.0](https://github.com/LlamaEdge/LlamaEdge/releases/tag/0.10.0) and above
31
 
32
- - Prompt template
33
 
34
- - Prompt type: `chatml`
35
 
36
- - Prompt string
37
 
38
- ```text
39
- <|im_start|>system
40
- {system_message}<|im_end|>
41
- <|im_start|>user
42
- {prompt}<|im_end|>
43
- <|im_start|>assistant
44
- ```
45
 
46
- - Context size: `7168`
47
 
48
- - Run as LlamaEdge service
49
 
50
- ```bash
51
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-Q5_K_M.gguf \
52
- llama-api-server.wasm \
53
- --prompt-template chatml \
54
- --ctx-size 7168 \
55
- --model-name Yi-1.5-34B-Chat
56
- ```
57
-
58
- - Run as LlamaEdge command app
59
-
60
- ```bash
61
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:Yi-1.5-34B-Chat-Q5_K_M.gguf \
62
- llama-chat.wasm \
63
- --prompt-template chatml \
64
- --ctx-size 7168
65
- ```
66
 
67
  ## Quantized GGUF Models
68
 
 
25
 
26
  [01-ai/Yi-1.5-34B-Chat](https://huggingface.co/01-ai/Yi-1.5-34B-Chat)
27
 
28
+ ## Run with Gaianet
29
 
30
+ **Prompt template:**
31
 
32
+ prompt template: `chatml`
33
 
34
+ **Context size:**
35
 
36
+ chat_ctx_size: `4096`
37
 
 
 
 
 
 
 
 
38
 
39
+ **Run with GaiaNet:**
40
 
41
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
42
 
43
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
  ## Quantized GGUF Models
46