lodrick-the-lafted
commited on
Commit
•
f976176
1
Parent(s):
01ca77a
Update README.md
Browse files
README.md
CHANGED
@@ -110,10 +110,10 @@ model-index:
|
|
110 |
<img src=https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001/resolve/main/anemoi.png>
|
111 |
|
112 |
# QuartetAnemoi-70B-t0.0001-b4.6-h8-exl2
|
113 |
-
Exl2 quant
|
114 |
-
|
115 |
-
Head
|
116 |
-
Fits in 48GB with 16K of context. <br/>
|
117 |
|
118 |
A sequential merge using a custom algorithm (NearSwap) of:
|
119 |
- [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
|
|
|
110 |
<img src=https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001/resolve/main/anemoi.png>
|
111 |
|
112 |
# QuartetAnemoi-70B-t0.0001-b4.6-h8-exl2
|
113 |
+
Exl2 quant parameters: <br/>
|
114 |
+
Bits per weight: 4.6 <br/>
|
115 |
+
Head bits: 8 <br/>
|
116 |
+
Fits in 48GB with 16K of context. Try 8 bit kvcache if you want 32K. <br/>
|
117 |
|
118 |
A sequential merge using a custom algorithm (NearSwap) of:
|
119 |
- [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
|