--- license: other --- # Join our Discord! https://discord.gg/Nbv9pQ88Xb --- [BeaverAI](https://huggingface.co/BeaverAI) & [Steelskull](https://huggingface.co/Steelskull) proudly present... # Theia 21B v1 🧘 #### An upscaled NeMo with half its layers trained on my special sauce 💦 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/qMWMRWJTuKvDgIwiPvr-5.png) *According to the giant impact hypothesis, Theia orbited the Sun, nearly along the orbit of the proto-Earth, by staying close to one or the other of the Sun-Earth system's two more stable Lagrangian points.* ![image/gif](https://cdn-uploads.huggingface.co/production/uploads/65f2fd1c25b848bd061b5c2e/a41bOgBNuF714OWlPcCeY.gif) *Theia was eventually perturbed away from that relationship by the gravitational influence of Jupiter, Venus, or both, resulting in a collision between Theia and Earth.* ## Description - This is a finetune of [Steelskull's NeMoria 21B](https://huggingface.co/TheSkullery/NeMoria-21b) model. - You can check out his official merges here: https://huggingface.co/Steelskull. - The finetuning process involved completion, RP, and instruct training. - Testers have reported enhanced RP capabilities, better storytelling, and richer prose. ## Links - Original: https://huggingface.co/TheDrummer/Theia-21B-v1 - GGUF: https://huggingface.co/TheDrummer/Theia-21B-v1-GGUF - EXL2 - 4bpw: https://huggingface.co/Statuo/Theia-21b-EXL2-4bpw - 6bpw: https://huggingface.co/Statuo/Theia-21b-EXL2-6bpw - 8bpw: https://huggingface.co/Statuo/Theia-21b-EXL2-8bpw ## Usage - Mistral format - Make sure that there is a space between `[/INST]` and `{{char}}:` like `[/INST] {{char}}:`. - `[/INST]{{char}}:` (no space between) has a huge negative impact on performance. - Use DRY