Update README.md (#6)
Browse files- Update README.md (b8daeb8d3b65728608ab0a8102a67904d82f9e5a)
README.md
CHANGED
|
@@ -23,4 +23,18 @@ The template used to build a prompt for the Instruct model is defined as follows
|
|
| 23 |
```
|
| 24 |
Note that `<s>` and `</s>` are special tokens for beginning of string (BOS) and end of string (EOS) while [INST] and [/INST] are regular strings.
|
| 25 |
|
| 26 |
-
## Run the model
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
```
|
| 24 |
Note that `<s>` and `</s>` are special tokens for beginning of string (BOS) and end of string (EOS) while [INST] and [/INST] are regular strings.
|
| 25 |
|
| 26 |
+
## Run the model
|
| 27 |
+
|
| 28 |
+
```bash
|
| 29 |
+
# Install mlx, mlx-examples, huggingface-cli
|
| 30 |
+
pip install mlx
|
| 31 |
+
pip install huggingface_hub hf_transfer
|
| 32 |
+
git clone https://github.com/ml-explore/mlx-examples.git
|
| 33 |
+
|
| 34 |
+
# Download model
|
| 35 |
+
export HF_HUB_ENABLE_HF_TRANSFER=1
|
| 36 |
+
huggingface-cli download --local-dir Mixtral-8x7B-Instruct-v0.1 mlx-community/Mixtral-8x7B-Instruct-v0.1
|
| 37 |
+
|
| 38 |
+
# Run example
|
| 39 |
+
python mlx-examples/mixtral/mixtral.py --model_path Mixtral-8x7B-Instruct-v0.1
|
| 40 |
+
```
|