base_model: unsloth/Qwen2.5-7B-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
license: apache-2.0
language:
- en
Uploaded model
- Developed by: Sweaterdog
- License: apache-2.0
- Finetuned from model : unsloth/Qwen2.5-7B-bnb-4bit
The MindCraft LLM tuning CSV file can be found here, this can be tweaked as needed. MindCraft-LLM
What is the Purpose?
This model is built and designed to play Minecraft via the extension named "MindCraft" Which allows language models, like the ones provided in the files section, to play Minecraft.
- Why a new model?
While, yes, models that aren't fine tuned to play Minecraft Can play Minecraft, most are slow, innaccurate, and not as smart, in the fine tuning, it expands reasoning, conversation examples, and command (tool) usage. - What kind of Dataset was used?
I'm deeming this model "Hermes", it was trained for reasoning by using examples of in-game "Vision" as well as examples of spacial reasoning, for expanding thinking, I also added puzzle examples where the model broke down the process step by step to reach the goal. - Why choose Qwen2.5 for the base model?
During testing, to find the best local LLM for playing Minecraft, I came across two, Gemma 2, and Qwen2.5, these two were by far the best at playing Minecraft before fine-tuning, and I knew, once tuned, it would become better.
Here is the link to the Google Colab notebook for fine tuning your own model, in case you want to use a different one, such as Llama-3-8b, or if you want to change the hyperparameters Google Colab
How to Use
In order to use this model, A, download the GGUF file of the version you want, either a Qwen, or Gemma model, and then the Modelfile, after you download both, in the Modelfile, change the directory of the model, to your model. Here is a simple guide if needed for the rest: # 1.Download the .gguf Model u want. For this example it is in the standard Windows "Download" Folder
2.Create a Modelfile.txt File in C:/Users/YourWindowsName
3.Open the Modelfile.txt and insert "from C:\Users\YourWindowsName\Downloads\MODELNAME.gguf"
4.Safe+Close Modelfile.txt
5.Rename "Modelfile.txt" into "Modelfile"
6.Open CMD and type in "ollama create NAMEYOUWANT -f Modelfile"
7.Wait until finished
8.In the CMD window, type "ollama run Hermes1" (replace the 1 in Hermes with whatever version you downloaded) This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
