--- license: llama3 --- 4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Cat-Llama-3-70B-instruct](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct).