Spaces:
Runtime error
Runtime error
update readme.md
Browse files- README.md +25 -0
- app.py +1 -1
- img/Interface.png +0 -0
README.md
CHANGED
@@ -10,4 +10,29 @@ pinned: false
|
|
10 |
license: apache-2.0
|
11 |
---
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
|
|
|
10 |
license: apache-2.0
|
11 |
---
|
12 |
|
13 |
+
# Chat Template Generation: Make Chat Easier with Huggingface Tokenizer
|
14 |
+
![interface](./img/Interface.png)
|
15 |
+
|
16 |
+
This streamlit app is to serve as an easier way to check and push the chat template to your/exisiting huggingface repo
|
17 |
+
Current predefined templates:
|
18 |
+
- open-orca.jinja2
|
19 |
+
- mistral-7b-openorca.jinja2
|
20 |
+
- orca2.jinja2
|
21 |
+
- airoboros_v2.jinja2
|
22 |
+
- airoboros_v1.jinja2
|
23 |
+
- openhermes-2.5-mistral.jinja2
|
24 |
+
- zephyr.jinja2
|
25 |
+
- falcon-chat.jinja2
|
26 |
+
- chat-ml.jinja2
|
27 |
+
- llama-2.jinja2
|
28 |
+
- vicuna_v1.1.jinja2
|
29 |
+
|
30 |
+
More templates will be predefined for easier setup of chat template.
|
31 |
+
|
32 |
+
With this interface you can easily
|
33 |
+
- update your tokenizer_config.json with chat-template attributes with predefined prompt template or custom template so that you can use `tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)` to generate chat prompt.
|
34 |
+
- contribute to existing model repository to support chat-template attributes
|
35 |
+
- review if your prompt template matches with your expected prompt
|
36 |
+
|
37 |
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
|
38 |
+
|
app.py
CHANGED
@@ -53,7 +53,7 @@ Chat Template Generation: Make Chat Easier with Huggingface Tokenizer
|
|
53 |
"""
|
54 |
|
55 |
st.title(title_description)
|
56 |
-
st.markdown('This
|
57 |
|
58 |
list_of_templates = get_existing_templates()
|
59 |
with st.expander("Current predefined templates"):
|
|
|
53 |
"""
|
54 |
|
55 |
st.title(title_description)
|
56 |
+
st.markdown('This streamlit app is to serve as an easier way to check and push the chat template to your/exisiting huggingface repo')
|
57 |
|
58 |
list_of_templates = get_existing_templates()
|
59 |
with st.expander("Current predefined templates"):
|
img/Interface.png
ADDED