Hugging Face's logo

rAIfle
/
Cat-Llama-3-70B-instruct-exl2

Model card Files Community
rAIfle commited on
Commit
3019d00
•
1 Parent(s): 9ef3cb8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -2,6 +2,7 @@ EXL2 quants of [Cat Llama-3 70B instruct](https://huggingface.co/turboderp/Cat-L
2
 
3
  Other EXL2 quants: [Cat Llama-3 70B instruct exl2](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2)
4
 
 
5
  [4.65 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/4.65b6h)
6
  [6.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/6b6h)
7
  [8.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/8b8h)
 
2
 
3
  Other EXL2 quants: [Cat Llama-3 70B instruct exl2](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct-exl2)
4
 
5
+ [2.25 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/2.25b6h)
6
  [4.65 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/4.65b6h)
7
  [6.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/6b6h)
8
  [8.00 bits per weight](https://huggingface.co/rAIfle/Cat-Llama-3-70B-instruct-exl2/tree/8b8h)