---
license: apache-2.0
datasets:
- wikitext
---

The main stuff is stored in branches: BakaLLM is intented to be my pet project with series of gradual improvements. 
Basically one improvement per branch, from 001_pristine(simplest version) to ⑨⑨⑨_humanity_is_conquered.

HF repo contains code and weights. Github code only. 

Code will not work AS IS, tinkering requirements. For one, I didn't place weight in weights dir(I wanted to zstd them first, but forgot)
For two, bench (benchmark script to test against other models) is very opinionaned where models are stored.