Context length
#4
by
CavemanDave
- opened
Awesome model so far but would you consider focusing on extending the context window in the next version? It seems to start falling apart and repeating itself a lot once you get beyond 8K tokens.