Update README.md
Browse files
README.md
CHANGED
|
@@ -43,6 +43,8 @@ I use max_seq_len 8K with alpha_value 2.65.
|
|
| 43 |
|
| 44 |
### Quants
|
| 45 |
|
|
|
|
|
|
|
| 46 |
- [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
|
| 47 |
- [3.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.5bpw-EXL2)
|
| 48 |
- [3bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3bpw-EXL2)
|
|
|
|
| 43 |
|
| 44 |
### Quants
|
| 45 |
|
| 46 |
+
- [4.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4.5bpw-EXL2)
|
| 47 |
+
- [4bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4bpw-EXL2)
|
| 48 |
- [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
|
| 49 |
- [3.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.5bpw-EXL2)
|
| 50 |
- [3bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3bpw-EXL2)
|