IQ2_XS variant
#2
by
perelmanych
- opened
Please add IQ2_XS variant to fit on a single 3090.
perelmanych
changed discussion title from
IQ2_XS variant
to Not working with oobabooga text-generation-webui
perelmanych
changed discussion title from
Not working with oobabooga text-generation-webui
to IQ2_XS variant
Cannot be done - static IQ2_XS is not a supported format. You have to use the imatrix one, which will be generated within the next few hours.
mradermacher
changed discussion status to
closed