Update README.md
Browse files
README.md
CHANGED
@@ -10,6 +10,12 @@ The original repo is here: https://huggingface.co/tencent/Tencent-Hunyuan-Large
|
|
10 |
|
11 |
This is the Hunyuan-A52B-Instruct model converted to huggingface safetensor
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
<p align="center">
|
14 |
<img src="https://dscache.tencent-cloud.cn/upload/uploader/hunyuan-64b418fd052c033b228e04bc77bbc4b54fd7f5bc.png" width="400"/> <br>
|
15 |
</p><p></p>
|
|
|
10 |
|
11 |
This is the Hunyuan-A52B-Instruct model converted to huggingface safetensor
|
12 |
|
13 |
+
Thanks to @awni for converting it to MLX!
|
14 |
+
|
15 |
+
It runs over 30 TPS on M2 ultra 192gb!
|
16 |
+
|
17 |
+
https://huggingface.co/mlx-community/Hunyuan-A52B-Instruct-3bit
|
18 |
+
|
19 |
<p align="center">
|
20 |
<img src="https://dscache.tencent-cloud.cn/upload/uploader/hunyuan-64b418fd052c033b228e04bc77bbc4b54fd7f5bc.png" width="400"/> <br>
|
21 |
</p><p></p>
|