EXL2 quants of alipindale/goliath-120b.
2.40 bits per weight2.80 bits per weight3.00 bits per weight
measurement.json
-