Longcal?

#1
by SporkySporkness - opened

What does the longcal mean in practice? Thx

Quant Cartel org

The default calibration uses at most 2048 tokens per row. These "longcal" quants use at most 8192 tokens. This could mean increased coherence at longer contexts, though I haven't done any actual blind tests (yet).

Sign up or log in to comment