--- base_model: - unsloth/Qwen2.5-7B-bnb-4bit - unsloth/gemma-2-9b-it-bnb-4bit tags: - text-generation-inference - transformers - unsloth - qwen2 - gemma2 - trl license: apache-2.0 language: - en datasets: - Sweaterdog/MindCraft-LLM-tuning --- # Uploaded model - **Developed by:** Sweaterdog - **License:** apache-2.0 - **Finetuned from model :** unsloth/Qwen2.5-7B-bnb-4bit The MindCraft LLM tuning CSV file can be found here, this can be tweaked as needed. [MindCraft-LLM](https://huggingface.co/datasets/Sweaterdog/MindCraft-LLM-tuning/raw/main/Gemini-Minecraft%20-%20training_data_minecraft_updated.csv) # What is the Purpose? This model is built and designed to play Minecraft via the extension named "[MindCraft](https://github.com/kolbytn/mindcraft)" Which allows language models, like the ones provided in the files section, to play Minecraft. - Why a new model? # While, yes, models that aren't fine tuned to play Minecraft *Can* play Minecraft, most are slow, innaccurate, and not as smart, in the fine tuning, it expands reasoning, conversation examples, and command (tool) usage. - What kind of Dataset was used? # I'm deeming this model *"Hermes"*, it was trained for reasoning by using examples of in-game "Vision" as well as examples of spacial reasoning, for expanding thinking, I also added puzzle examples where the model broke down the process step by step to reach the goal. - Why choose Qwen2.5 for the base model? # During testing, to find the best local LLM for playing Minecraft, I came across two, Gemma 2, and Qwen2.5, these two were by far the best at playing Minecraft before fine-tuning, and I knew, once tuned, it would become better. # How to Use In order to use this model, A, download the GGUF file of the version you want, either a Qwen, or Gemma model, and then the Modelfile, after you download both, in the Modelfile, change the directory of the model, to your model. Here is a simple guide if needed for the rest: # 1.Download the .gguf Model u want. For this example it is in the standard Windows "Download" Folder 2.Download the Modelfile 3.Open the Modelfile with / in notepad, or you can rename it to Modelfile.txt, and change the GGUF path, for example, this is my PATH "C:\Users\SweaterDog\OneDrive\Documents\Raw GGUF Files\Hermes-1.0\Hermes-1.Q8_0.gguf" 4.Safe + Close Modelfile 5.Rename "Modelfile.txt" into "Modelfile" if you changed it before-hand 6.Open CMD and type in "ollama create Hermes1 -f Modelfile" (You can change the name to anything you'd like, for this example, I am just using the same name as the GGUF) 7.Wait until finished 8.In the CMD window, type "ollama run Hermes1" (replace the 1 in Hermes with whatever version you downloaded) # I'm aware it does say there are multiple Qwen2.5 files, even though there are two, and it also says there are Gemma2 models, even though there isn't, I am aware and have been trying to train the rest of these models. # This qwen2 and gemma2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library. [](https://github.com/unslothai/unsloth)