Update README.md
Browse files
README.md
CHANGED
|
@@ -123,7 +123,12 @@ In our testing, this model seems like a storyteller, as might be expected, but t
|
|
| 123 |
|
| 124 |
<br/>
|
| 125 |
|
| 126 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 127 |
|
| 128 |
<br/>
|
| 129 |
<br/>
|
|
|
|
| 123 |
|
| 124 |
<br/>
|
| 125 |
|
| 126 |
+
GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
|
| 127 |
+
|
| 128 |
+
Some exl2 quants were made by llmixer too:
|
| 129 |
+
- [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
|
| 130 |
+
- [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
|
| 131 |
+
- [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
|
| 132 |
|
| 133 |
<br/>
|
| 134 |
<br/>
|