--- license: apache-2.0 tags: - OpenAccess AI Collective - MPT - axolotl datasets: - ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered - QingyiSi/Alpaca-CoT - teknium/GPTeacher-General-Instruct - metaeval/ScienceQA_text_only - hellaswag - openai/summarize_from_feedback - riddle_sense - gsm8k - camel-ai/math - camel-ai/biology - camel-ai/physics - camel-ai/chemistry - winglian/evals inference: false --- [Built with Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) **[💵 Donate to OpenAccess AI Collective](https://github.com/sponsors/OpenAccess-AI-Collective) to help us keep building great tools and models!** # Due to a bug, the first version dropped a few datasets during training. We've corrected the issue and retrained the model # Minotaur 13B (FIXED) Minotaur 13B is an instruct fine-tuned model on top of LlaMA-13B. Minotaur 13B is fine-tuned **on only completely open datasets** making this model reproducible by anyone. Questions, comments, feedback, looking to donate, or want to help? Reach out on our [Discord](https://discord.gg/PugNNHAF5r) or email [wing@openaccessaicollective.org](mailto:wing@openaccessaicollective.org) # Prompts Chat only style prompts using `USER:`,`ASSISTANT:`. minotaur # Training Datasets Minotaur 13B model is fine-tuned on the following openly available datasets: - [WizardLM](https://huggingface.co/datasets/ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered) - [subset of QingyiSi/Alpaca-CoT for roleplay and CoT](https://huggingface.co/QingyiSi/Alpaca-CoT) - [GPTeacher-General-Instruct](https://huggingface.co/datasets/teknium/GPTeacher-General-Instruct) - [metaeval/ScienceQA_text_only](https://huggingface.co/datasets/metaeval/ScienceQA_text_only) - instruct for concise responses - [openai/summarize_from_feedback](https://huggingface.co/datasets/openai/summarize_from_feedback) - instruct augmented tl;dr summarization - [camel-ai/math](https://huggingface.co/datasets/camel-ai/math) - [camel-ai/physics](https://huggingface.co/datasets/camel-ai/physics) - [camel-ai/chemistry](https://huggingface.co/datasets/camel-ai/chemistry) - [camel-ai/biology](https://huggingface.co/datasets/camel-ai/biology) - [winglian/evals](https://huggingface.co/datasets/winglian/evals) - instruct augmented datasets - custom sysnthetic datasets around misconceptions, in-context qa, jokes, N-tasks problems, and context-insensitivity - ARC-Easy & ARC-Challenge - instruct augmented for detailed responses, derived from the `train` split - [hellaswag](https://huggingface.co/datasets/hellaswag) - 30K+ rows of instruct augmented for detailed explanations w 30K+ rows, derived from the `train` split - [riddle_sense](https://huggingface.co/datasets/riddle_sense) - instruct augmented, derived from the `train` split - [gsm8k](https://huggingface.co/datasets/gsm8k) - instruct augmented, derived from the `train` split - prose generation # Shoutouts Special thanks to Nanobit for helping with Axolotl and TheBloke for quantizing these models are more accessible to all. # Demo HF Demo in Spaces available in the [Community ChatBot Arena](https://huggingface.co/spaces/openaccess-ai-collective/rlhf-arena) under the OAAIC Chatbots tab. ## Release Notes - https://wandb.ai/wing-lian/minotaur-13b/runs/5ystr7w6/workspace ## Build Minotaur was built with [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) on 6XA100 80GB - 1 epochs taking approximately 7.5 hours ## Bias, Risks, and Limitations Minotaur has not been aligned to human preferences with techniques like RLHF or deployed with in-the-loop filtering of responses like ChatGPT, so the model can produce problematic outputs (especially when prompted to do so). Minotaur was fine-tuned from the base model LLaMA-13B, please refer to its model card's Limitations Section for relevant information. (included below) ## Benchmarks TBD ## Examples - results may vary based on temperature (0.7 for this) and other settings ``` The following is a chat between a USER and a friendly and helpful ASSISTANT. USER: Solve for x: 5x = 3x + 10 ASSISTANT:To solve the equation 5x = 3x + 10, we can first isolate one variable on one side of the equation by moving all the terms with x to one side. Subtract 3x from both sides of the equation: 5x - 3x = 10 - 3x 2x = 7 Now, divide both sides of the equation by 2 to find the value of x: (2x)/2 = 7/2 x = 7/4 So, the solution for x is 7/4. ``` defintely worse at math than v1 ``` The following is a chat between a USER and a friendly and helpful ASSISTANT. USER: You have 3 apples. You eat 2 pears. How many apples do you have left? ASSISTANT:You still have 3 apples, as eating pears does not affect the number of apples. ``` ``` The following is a chat between a USER and a friendly and helpful ASSISTANT. USER: List three words that start with "ex". What is 33 + 77? ASSISTANT:Three words that start with "ex" are "express", "exact", and "excite". 33 + 77 = 110. ``` ``` The following is a chat between a USER and a friendly and helpful ASSISTANT. USER: Write a haiku about dinosaurs. ASSISTANT:The mighty roar echoes, T-Rex strides with power, Dinosaurs rule the day. ``` meh, 6/6/6 rather than 5/7/5