andriadze
/

anthracite-magnum-v3-34b-awq-gemv

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

andriadze commited on 21 days ago

Commit

1d7f661

•

1 Parent(s): e06b914

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ tags:
 ## Model Details
-This is a AWQ GEMM quant of magnum-v3-34b: https://huggingface.co/anthracite-org/magnum-v3-34b
 ### Model Description
@@ -19,5 +19,5 @@ Model has been quantized on 6xRTX4090, here are quantization parameters:
 "zero_point": True,
 "q_group_size": 128,
 "w_bit": 4,
-"version": "GEMM"

 ## Model Details
+This is a AWQ GEMV quant of magnum-v3-34b: https://huggingface.co/anthracite-org/magnum-v3-34b
 ### Model Description
 "zero_point": True,
 "q_group_size": 128,
 "w_bit": 4,
+"version": "GEMV"