weighted/imatrix quants of https://huggingface.co/wenbopan/Faro-Yi-34B-200K
This uses my "quarter" training set of 40k tokens as the model overflowed after 25k tokens with the standard set.
weighted/imatrix quants of https://huggingface.co/wenbopan/Faro-Yi-34B-200K
This uses my "quarter" training set of 40k tokens as the model overflowed after 25k tokens with the standard set.