Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints

What does the 4k stand for?

#1
by flashvenom - opened

Does this model have 4k context?

Open Access AI Collective org

Indeed it does. It needs xpos rotary patch though to use it. It might work too without it

can you provide more context re: xpos rotary patch? a github link or some doc?

Sign up or log in to comment