lodrick-the-lafted commited on
Commit
f976176
1 Parent(s): 01ca77a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -110,10 +110,10 @@ model-index:
110
  <img src=https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001/resolve/main/anemoi.png>
111
 
112
  # QuartetAnemoi-70B-t0.0001-b4.6-h8-exl2
113
- Exl2 quant paramters: <br/>
114
- BPW: 4.6 <br/>
115
- Head Bits: 8 <br/>
116
- Fits in 48GB with 16K of context. <br/>
117
 
118
  A sequential merge using a custom algorithm (NearSwap) of:
119
  - [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
 
110
  <img src=https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001/resolve/main/anemoi.png>
111
 
112
  # QuartetAnemoi-70B-t0.0001-b4.6-h8-exl2
113
+ Exl2 quant parameters: <br/>
114
+ Bits per weight: 4.6 <br/>
115
+ Head bits: 8 <br/>
116
+ Fits in 48GB with 16K of context. Try 8 bit kvcache if you want 32K. <br/>
117
 
118
  A sequential merge using a custom algorithm (NearSwap) of:
119
  - [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)