File size: 1,923 Bytes
8461737
 
28c2541
 
 
0c93012
 
 
58b5df6
 
 
 
0c93012
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b137d82
 
c45f845
d7ed233
981ea9f
 
d7ed233
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
981ea9f
 
 
c45f845
285fb2a
b137d82
 
 
285fb2a
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
This is a llama-13B based model. (sorry, I forgot to put it in the model name)

Base Model: GPT4-x-Alpaca full fine tune by Chavinlo -> https://huggingface.co/chavinlo/gpt4-x-alpaca  
LORA fine tune using the Roleplay Instruct from GPT4 generated dataset -> https://github.com/teknium1/GPTeacher/tree/main/Roleplay  
LORA Adapter Only: https://huggingface.co/ZeusLabs/gpt4-x-alpaca-rp-lora/tree/main/gpt-rp-instruct-1  

Merged LORA to the model.

FYI Latest HF Transformers generates BROKEN generations. 
Try this instead if your generations are terrible (first uninstall transformers): pip install git+https://github.com/huggingface/transformers@9eae4aa57650c1dbe1becd4e0979f6ad1e572ac0


Instruct it same way as alpaca / gpt4xalpaca:
```
### Instruction:
<prompt>
### Response:

```

or 
```
### Instruction:
<prompt>
### Input:
<specific data to manipulate for the instruction
### Response:

```

For a better idea of prompting it for roleplay, check out the roleplay discord bot code I made here: https://github.com/teknium1/alpaca-roleplay-discordbot
Here is an example:
```
### Instruction:
Role play as character that is described in the following lines. You always stay in character.
{"Your name is " + name + "." if name else ""}
{"Your backstory and history are: " + background if background else ""}
{"Your personality is: " + personality if personality else ""}
{"Your current circumstances and situation are: " + circumstances if circumstances else ""}
{"Your common greetings are: " + common_greeting if common_greeting else ""}
Remember, you always stay on character. You are the character described above.
{past_dialogue_formatted}
{chat_history if chat_history else "Chatbot: Hello!"}

Always speak with new and unique messages that haven't been said in the chat history.

Respond to this message as your character would:
### Input:
{text}
### Response:
{name}:

```

---
tags:
- llama
- alpaca
- gpt4
---