Commit
•
8fa68e8
1
Parent(s):
9be5ab5
🔧 Document .env more
Browse files
.env
CHANGED
@@ -14,6 +14,6 @@ PUBLIC_USER_MESSAGE_TOKEN=<|prompter|>
|
|
14 |
PUBLIC_ASSISTANT_MESSAGE_TOKEN=<|assistant|>
|
15 |
PUBLIC_SEP_TOKEN=<|endoftext|>
|
16 |
|
17 |
-
#
|
18 |
# Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
|
19 |
MODEL_ENDPOINTS=`[]`
|
|
|
14 |
PUBLIC_ASSISTANT_MESSAGE_TOKEN=<|assistant|>
|
15 |
PUBLIC_SEP_TOKEN=<|endoftext|>
|
16 |
|
17 |
+
# [{"endpoint": "https://api-inference.huggingface.co/models/...", authorization: "Bearer hf_<token>", weight: 1}] to load balance
|
18 |
# Eg if one endpoint has weight 2 and the other has weight 1, the first endpoint will be called twice as often
|
19 |
MODEL_ENDPOINTS=`[]`
|