EXL2 quants of [Cat Llama-3 70B instruct](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct)

Other EXL2 quants: [Cat Llama-3 70B instruct exl2](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2)

[2.25 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/2.25b6h)     
[4.65 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/4.65b6h)     
[6.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/6b6h)     
[8.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/8b8h)   

[measurement.json](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2/blob/main/measurement.json)