i1 please
#1
by
eramax
- opened
i1 please
Give it some time, andfit will appear :)
mradermacher
changed discussion status to
closed
it looks you have uploaded Q2 , Q3 and Q4 , I thought this repo will be for iq1
It's for imatrix quants. IQ1_S is just one of them. They are generated in this order currently: Q2_K Q4_K_S Q3_K_M Q4_K_M Q6_K Q3_K_S Q3_K_L Q5_K_S Q5_K_M IQ2_M IQ3_XXS IQ3_XS IQ3_S IQ3_M IQ1_S IQ2_XXS IQ2_XS IQ2_S IQ4_XS
IQ1_S is hasn't been uploaded sorry
And, as I explained, it would not have been uploaded because it takes time and other quants are generated first. However, since then, it turned out that there will not be any I-quants because llama.cpp is a crashferst at the moment and is unable to generate any i-quants.