oluwatosin adewumi
commited on
Commit
•
e98e1e0
1
Parent(s):
066460b
modification to README
Browse files
README.md
CHANGED
@@ -1,4 +1,5 @@
|
|
1 |
---
|
|
|
2 |
language:
|
3 |
- en
|
4 |
license: cc-by-4.0
|
@@ -13,9 +14,44 @@ widget:
|
|
13 |
- text: "I would like to have breakfast."
|
14 |
---
|
15 |
|
16 |
-
DialoGPT_MWOZ
|
17 |
|
18 |
This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
|
19 |
The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
|
20 |
|
21 |
-
The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
thumbnail: https://huggingface.co/front/thumbnails/dialogpt.png
|
3 |
language:
|
4 |
- en
|
5 |
license: cc-by-4.0
|
|
|
14 |
- text: "I would like to have breakfast."
|
15 |
---
|
16 |
|
17 |
+
## DialoGPT_MWOZ
|
18 |
|
19 |
This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
|
20 |
The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
|
21 |
|
22 |
+
The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively. More information about the original pre-trained model can be found [here](https://huggingface.co/microsoft/DialoGPT-medium)
|
23 |
+
|
24 |
+
* Generation example from an interactive environment:
|
25 |
+
|
26 |
+
|Role | Response |
|
27 |
+
|---------|------------|
|
28 |
+
|User | I would like to have breakfast. |
|
29 |
+
|Bot | There are several options for Chinese in the city centre. Are you looking for a particular price range? |
|
30 |
+
|User | I'm looking for free food |
|
31 |
+
|Bot | There are 4 Chinese restaurants that are in the cheap price range. 3 in centre and one in north. |
|
32 |
+
|User | Not good enough |
|
33 |
+
|Bot | How about Charlie Chan? It is a Chinese restaurant in the centre of town. |
|
34 |
+
|
35 |
+
Please find the information about preprocessing, training and full details of the DialoGPT in the [original DialoGPT repository](https://github.com/microsoft/DialoGPT)
|
36 |
+
|
37 |
+
The paper for this work was accepted at the Northern Lights Deep Learning (NLDL) conference 2022. Arxiv paper: [https://arxiv.org/pdf/2110.06273.pdf](https://arxiv.org/pdf/2110.06273.pdf)
|
38 |
+
|
39 |
+
### How to use
|
40 |
+
|
41 |
+
Now we are ready to try out how the model works as a chatting partner!
|
42 |
+
|
43 |
+
```python
|
44 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
45 |
+
import torch
|
46 |
+
tokenizer = AutoTokenizer.from_pretrained("tosin/dialogpt_mwoz")
|
47 |
+
model = AutoModelForCausalLM.from_pretrained("tosin/dialogpt_mwoz")
|
48 |
+
# Let's chat for 5 lines
|
49 |
+
for step in range(5):
|
50 |
+
# encode the new user input, add the eos_token and return a tensor in Pytorch
|
51 |
+
new_user_input_ids = tokenizer.encode(input(">> User:") + tokenizer.eos_token, return_tensors='pt')
|
52 |
+
# append the new user input tokens to the chat history
|
53 |
+
bot_input_ids = torch.cat([chat_history_ids, new_user_input_ids], dim=-1) if step > 0 else new_user_input_ids
|
54 |
+
# generated a response while limiting the total chat history to 1000 tokens,
|
55 |
+
chat_history_ids = model.generate(bot_input_ids, max_length=1000, pad_token_id=tokenizer.eos_token_id)
|
56 |
+
# pretty print last ouput tokens from bot
|
57 |
+
print("DialoGPT_MWOZ_Bot: {}".format(tokenizer.decode(chat_history_ids[:, bot_input_ids.shape[-1]:][0], skip_special_tokens=True)))
|