Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,9 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
# mlc-chat-neural-chat-7b-v3-1-q3f16_1
|
| 6 |
+
|
| 7 |
+
An [MLC](https://mlc.ai/)-compiled version of [Neural Chat 7B v3](https://huggingface.co/Intel/neural-chat-7b-v3-1) quantized to q3f16 for running locally on mobile devices.
|
| 8 |
+
|
| 9 |
+
Requires a build of MLC Chat for iOS that supports Mistral. As of 12/12/23, that means you will need to build MLC Chat for iOS from source at [mlc-llm @ MLC.ai on Github](https://github.com/mlc-ai/mlc-llm/).
|