Add model card

README.md

@@ -0,0 +1,73 @@
+---
+language:
+- en
+---
+# Model Card for BabyLlama v0.6
+
+## Overview
+**Model Name:** BabyLlama v0.6  
+**Repository:** kevin009/babyllama-v0.6  
+**Architecture:** LlamaForCausalLM, based on TinyLlama 1.1b  
+**Model Type:** llama  
+**Version:** 0.5  
+
+## Model Description
+BabyLlama v0.6 is an innovative conversational AI model, specialized in generating creative and humorous interactions. While it's built on the Llama2 architecture and specifically draws from the TinyLlama 1.1b, this version sets itself apart by not strictly adhering to user instructions. Instead, it aims to replicate human-like conversation in a manner that's distinctly recognizable from actual human dialogue, focusing on creativity and humor.
+
+## Technical Specifications
+
+- **Attention Bias:** False
+- **BOS Token ID:** 1
+- **EOS Token ID:** 2
+- **Hidden Activation Function:** SiLU (silu)
+- **Hidden Size:** 2048
+- **Initializer Range:** 0.02
+- **Intermediate Size:** 5632
+- **Max Position Embeddings:** 2048
+- **Number of Attention Heads:** 32
+- **Number of Hidden Layers:** 22
+- **Number of Key/Value Heads:** 4
+- **Pretraining TP:** 1
+- **RMS Norm Epsilon:** 1e-05
+- **ROPE Scaling:** null
+- **ROPE Theta:** 10000.0
+- **Tie Word Embeddings:** False
+- **Torch DType:** float16
+- **Transformers Version:** 4.35.2
+- **Use Cache:** True
+- **Vocabulary Size:** 32000
+
+
+## Use Cases
+This model excels in applications where engaging, entertaining, and uniquely human-distinguishable AI responses are valued. It is particularly suited for chatbots, entertainment platforms, interactive games, and social experiments where the focus is on creativity, humor, and the unexpected.
+
+## How to Use
+BabyLlama v0.6 is particularly adept for applications within the realm of role-playing games (RPGs), interactive storytelling, and simulation-based training where dynamic, engaging, and character-driven dialogues are essential. It can serve as an AI companion or NPC (non-player character) that interacts with users in a variety of scenarios, ranging from fantasy and adventure to everyday social simulations. Its unique conversational style enhances the immersive experience by providing responses that are not only contextually relevant but also infused with creativity and humor, thereby elevating the narrative depth and engagement of the role-playing environment.
+
+
+# Example usage for playful interaction
+
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "kevin009/babyllama-v0.6"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(model_name)
+
+scenario_prompt = "User: Can you teach me how to plant a magical garden? \n\n Bot:"
+
+```
+
+## Limitations and Considerations
+Due to its design for generating creative and humorous content, BabyLlama v0.5 might not strictly follow provided instructions, reflecting its unique training approach. Users should be mindful of its propensity for unexpected outputs and incorporate suitable moderation or guidance mechanisms as necessary.
+Limitations and Considerations
+
+BabyLlama v0.6's focus on playful and fictional dialogues means it may not be suitable for applications requiring factual accuracy or serious outcomes. Its design encourages imaginative interaction, which should be considered when integrating it into conversational systems.
+BabyLlama v0.6 might not strictly follow provided instructions, reflecting its unique training approach, Users should be mindful of its propensity for unexpected outputs and incorporate suitable moderation or guidance mechanisms as necessary.
+
+## Acknowledgments
+The development of BabyLlama v0.5 reflects a significant effort to push the boundaries of conversational AI, drawing from the foundational TinyLlama 1.1b model and incorporating advanced fine-tuning techniques to achieve its distinctive capabilities.
+
+## Version History
+- **v0.5:** Enhanced for creativity and humor in conversations, diverging from strict instruction adherence to offer a unique conversational experience.