This model is probably my current favorite for that can fit 8k context on 12GB of VRAM. Have you considered making any other 2x7B models?
· Sign up or log in to comment