awni commited on
Commit
ee17529
·
1 Parent(s): 50f7379

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -9
README.md CHANGED
@@ -13,14 +13,30 @@ A community org for model weights compatible with [mlx-examples](https://github.
13
 
14
  These are pre-converted weights and ready to be used in the example scripts.
15
 
16
- ## Citation
 
 
 
 
 
 
 
 
 
17
 
18
  ```
19
- @software{mlx2023,
20
- author = {Awni Hannun and Jagrit Digani and Angelos Katharopoulos and Ronan Collobert},
21
- title = {{MLX}: Efficient and flexible machine learning on Apple silicon},
22
- url = {https://github.com/ml-explore},
23
- version = {0.0},
24
- year = {2023},
25
- }
26
- ```
 
 
 
 
 
 
 
 
13
 
14
  These are pre-converted weights and ready to be used in the example scripts.
15
 
16
+
17
+ # Quick start
18
+
19
+ Check out the MLX examples repo:
20
+
21
+ ```
22
+ git clone git@github.com:ml-explore/mlx-examples.git
23
+ ```
24
+
25
+ Install the requirements:
26
 
27
  ```
28
+ cd mlx-examples/hf_llm
29
+ pip install -r requirements.txt
30
+
31
+ Generate:
32
+
33
+ ```
34
+ python generate.py --hf-path mistralai/Mistral-7B-v0.1
35
+ ```
36
+
37
+ To upload a new model (for example a 4-bit quantized Mistral-7B), do:
38
+
39
+ ```
40
+ python convert.py --hf-path mistralai/Mistral-7B-v0.1 -q --upload-name mistral-v0.1-4bit
41
+ ```
42
+