Commit
•
ad750e1
1
Parent(s):
31e870b
update group size
Browse files
README.md
CHANGED
|
@@ -3,7 +3,7 @@ This is [AIDC-ai-business/Marcoroni-70B-v1](https://huggingface.co/AIDC-ai-busin
|
|
| 3 |
python3 -m lmdeploy.lite.apis.auto_awq \
|
| 4 |
--model ./Marcoroni-70B-v1 \
|
| 5 |
--w_bits 4 \
|
| 6 |
-
--w_group_size
|
| 7 |
--work_dir ./quant
|
| 8 |
```
|
| 9 |
# Original Model Card:
|
|
|
|
| 3 |
python3 -m lmdeploy.lite.apis.auto_awq \
|
| 4 |
--model ./Marcoroni-70B-v1 \
|
| 5 |
--w_bits 4 \
|
| 6 |
+
--w_group_size 128 \
|
| 7 |
--work_dir ./quant
|
| 8 |
```
|
| 9 |
# Original Model Card:
|