OPEA
/

glm-4v-9b-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on Dec 6, 2024

Commit

8686c87

·

verified ·

1 Parent(s): 29ab5ad

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ datasets:
 ## Model Details
-This model is an int4 model with group_size 128 and symmetric quantization of [THUDM/glm-4v-9b](https://huggingface.co/glm-4v-9b-int4-sym-inc). Load the model with revision="dbb7900" to use AutoGPTQ format.
 ## How To Use
 ### INT4 Inference
 ```python

 ## Model Details
+This model is an int4 model with group_size 128 and symmetric quantization of [THUDM/glm-4v-9b](https://huggingface.co/THUDM/glm-4v-9b). Load the model with revision="dbb7900" to use AutoGPTQ format.
 ## How To Use
 ### INT4 Inference
 ```python