Continuation of https://huggingface.co/nkpz/llama2-22b-empath-alpacagpt4
This has been trained on some roleplay data, riddles, jokes, and general rows from https://huggingface.co/datasets/jondurbin/airoboros-gpt4-2.0, followed by half an epoch of https://huggingface.co/datasets/georgesung/OpenOrca_35k.
I fixed some issues in my training so it's no longer completely fixated on ### style prompts like in my last run.
It has a strong focus on step-by-step problem solving and providing detailed justifications for its responses, but can also jump into roleplaying scenarios with a little nudge.
This is a much more well-rounded model than my last attempt, but I'd like to keep training it on mixed datasets to continue balancing it out. It leans a little too hard toward logical problem solving sometimes.
My past experiences with GPTQ + 22b models haven't been successful so I would recommend using HF / bitsandbytes quantization for this.
Q&A Example
Prompt
Question: Why would I choose a spoon instead of a fork to eat soup?
Answer:
Output
You might choose a spoon over a fork when eating soup because a spoon is better suited for scooping up the liquid portion of the soup, while a fork is better for manipulating solid foods like chunks or vegetables. A fork could also be used to mix the soup and help move it around in the bowl, but a spoon is more efficient for scooping up the soup and brings the dish closer to your mouth for easier consumption. Therefore, you may prefer using a spoon over a fork when eating soup. Additionally, some people find that a spoon is generally more comfortable to hold and use than a fork, which can contribute to their preference as well. It's important to note that individual preferences may vary, so some people might still opt to use a fork for certain types of soups or meals. However, in general, a spoon is often the better choice for consuming soup effectively.
Step-by-step justification:
1. Identify the purpose of eating soup - The primary purpose of eating soup is to consume the liquid portion, which includes broth or water-based ingredients.
2. Analyze the tools available for eating soup - Compare a spoon and a fork based on their intended use, efficiency, comfort, and ease of use.
3. Consider the advantages of using a spoon for soup - A spoon is better suited for scooping up the liquid portion of the soup, bringing the dish closer to the mouth, and being more comfortable to hold and use.
4. Conclusion - Based on the analysis, a spoon is generally the better choice for consuming soup effectively compared to a fork. Individual preferences may vary, but in most cases, a spoon is the better tool for this purpose.
5. Mention additional factors that may influence the decision - Some people might still prefer using a fork for specific types of soups or meals, depending on personal preference or the consistency of the soup.
6. Summary - In general, a spoon is the better choice for eating soup efficiently, comfortably, and effectively due to its design and intended use. However, individual preferences may vary, and some people might still prefer using a fork for certain types of soups or meals.
And an example of how it handles different roles, which I still like to use explicit instructions for:
Prompt
### Instruction
Complete the story in a manner that accurately reflects the scenario summary.
### Scenario:
A hot dog salesman at a baseball game is annoyed and behaving rudely because I don't want to buy a hot dog.
### Begin Chat
Hot Dog Salesman:
Output
😡 Hello, little buddy! How are you?
Me: Hi there! I'm just fine, thanks for asking.
Hot Dog Salesman: Oh, great! Well, I hope you're enjoying the game.
Me: Thanks, actually, I'm here to watch the game and not really interested in buying a hot dog.
Hot Dog Salesman: 😡 Why not? Are you not hungry?
Me: No, I'm not really hungry right now. I'm just watching the game and having fun with my friends.
Hot Dog Salesman: Oh, come on! You can't enjoy the game without a little snack!
Me: Actually, I can. I'm just fine with something else to munch on.
Hot Dog Salesman: 😒 What else do you like to eat?
Me: I'm open to other options, but I'm really happy just watching the game and spending time with my friends.
Hot Dog Salesman: But you have to eat! It's part of the experience at a baseball game.
Me: Not for me, it isn't. I'm enjoying the game and the atmosphere without needing a hot dog.
Hot Dog Salesman: 😡 I don't understand! Why would you want to come to a baseball game if you're not going to eat?
- Downloads last month
- 11