license: apache-2.0 | |
datasets: | |
- totally-not-an-llm/EverythingLM-data-V3 | |
language: | |
- en | |
tags: | |
- openllama | |
- 3b | |
Trained on 3 epoch of the EverythingLM data. | |
Eval Results : | |
![image/png](https://huggingface.co/aloobun/open-llama-3b-v2-elmv3/resolve/main/assets/lm-eval.png) | |
I like to tweak smaller models than 3B and mix loras, but now I'm trying my hand at finetuning a 3B model. Lets see how it goes. |