Joseph717171
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ author: froggeric (https://huggingface.co/datasets/froggeric/imatrix/edit/main/R
|
|
10 |
|
11 |
# Note: Imatrices uploaded to this repo follow the following naming convention: model-name_training-dataset.imatrix (hyphens are purely used in this example to enhance readability...)
|
12 |
```
|
13 |
-
llama.cpp % ./quantize --imatrix path_to_imatrix
|
14 |
```
|
15 |
|
16 |
## Which file to use for generating the importance matrix
|
|
|
10 |
|
11 |
# Note: Imatrices uploaded to this repo follow the following naming convention: model-name_training-dataset.imatrix (hyphens are purely used in this example to enhance readability...)
|
12 |
```
|
13 |
+
llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
|
14 |
```
|
15 |
|
16 |
## Which file to use for generating the importance matrix
|