How much memory is needed if you make the 128k context length

#13

by ggbondcxk - opened Jun 8

Jun 8

How much memory is needed if you make the 128k context length

Jun 15

•

直接下载deepseek v2 chat就能跑128k吗？我看config.json有的，但是超过一定长度，输出就为空了。如果输出长度设置为100k，就会报错

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment