license: mit | |
4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [kappa-3-phi-abliterated](https://huggingface.co/failspy/kappa-3-phi-abliterated) with an unquantized embedding layer. | |
license: mit | |
4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [kappa-3-phi-abliterated](https://huggingface.co/failspy/kappa-3-phi-abliterated) with an unquantized embedding layer. | |