SpectraSuite/QuantLM_3.9B_6bit_Unpacked
Text Generation
•
Updated
•
11
QuantLMs, unpacked to FP16 format - compatible with FP16 GEMMs. After unpacking, QuantLMs have the same architecture as LLaMa.