Commit
•
e3e92ce
1
Parent(s):
b9cb93d
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
```python
|
| 2 |
-
python quantize.py
|
|
|
|
| 3 |
--output_dir /Meta-Llama-3-8B-Instruct-AWQ \
|
| 4 |
--dtype bfloat16 \
|
| 5 |
--qformat int4_awq \
|
|
|
|
| 1 |
+
# Meta-Llama-3.1-8B-Instruct-AWQ
|
| 2 |
+
|
| 3 |
+
The following command was used to produce this model.
|
| 4 |
+
|
| 5 |
```python
|
| 6 |
+
python quantize.py
|
| 7 |
+
--model_dir /Meta-Llama-3-8B-Instruct \
|
| 8 |
--output_dir /Meta-Llama-3-8B-Instruct-AWQ \
|
| 9 |
--dtype bfloat16 \
|
| 10 |
--qformat int4_awq \
|