Context Length and Needle in a haystack
#4
by
ninjaman12
- opened
According to ollama info, the context length is 130k.
What was the proportional split of training data vs content length and have you tried any needle in a haystack tests?
Many Thanks
Sorry... Also a follow up question.
Do you have any examples of entity or predicate types you trained it on?
I'm wondering if it can extract things like actions/events/motivations etc.