rope theta?
#1
by
bdambrosio
- opened
You said 1000000.0 on model card, but config says "rope_theta": 5000000.0,
Should I leave as is? (config max pos is 8192)
Yeah it should be just fine
bdambrosio
changed discussion status to
closed