Commit
•
75ba5dd
1
Parent(s):
38c8416
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,7 @@ This is [Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-
|
|
| 14 |
Weight compression was performed using `nncf.compress_weights` with the following parameters:
|
| 15 |
|
| 16 |
* mode: **int4_asym**
|
|
|
|
| 17 |
* ratio: **0.8**
|
| 18 |
|
| 19 |
For more information on quantization, check the [OpenVINO model optimization guide](https://docs.openvino.ai/2024/openvino-workflow/model-optimization-guide/weight-compression.html).
|
|
|
|
| 14 |
Weight compression was performed using `nncf.compress_weights` with the following parameters:
|
| 15 |
|
| 16 |
* mode: **int4_asym**
|
| 17 |
+
* group_size: **128**
|
| 18 |
* ratio: **0.8**
|
| 19 |
|
| 20 |
For more information on quantization, check the [OpenVINO model optimization guide](https://docs.openvino.ai/2024/openvino-workflow/model-optimization-guide/weight-compression.html).
|