4-bit OmniQuant quantized version of kappa-3-phi-abliterated with an unquantized embedding layer.
Unable to determine this model's library. Check the
docs
.
4-bit OmniQuant quantized version of kappa-3-phi-abliterated with an unquantized embedding layer.