A test model. Noticeably different outputs from the base model but no benchmarking has been done
4-bit
5-bit
8-bit
Base model