Update README.md
Browse files
README.md
CHANGED
@@ -10,9 +10,7 @@ tags:
|
|
10 |
|
11 |
# llama-2-chat-onnx
|
12 |
|
13 |
-
|
14 |
-
|
15 |
-
**llama-2-chat-onnx** is an ONNX int4 quantized version of Llama-2-Chat, providing a fast, small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.
|
16 |
|
17 |
[**llama-2-chat**](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) is the official chat finetune of the classic Llama 2 model, one of the most most iconic (and still one the best) 7B instruct trained models.
|
18 |
|
|
|
10 |
|
11 |
# llama-2-chat-onnx
|
12 |
|
13 |
+
**llama-2-chat-onnx** is an ONNX int4 quantized version of Llama-2-Chat, providing a fast, small inference implementation, optimized for AI PCs and Windows x86-64 architectures.
|
|
|
|
|
14 |
|
15 |
[**llama-2-chat**](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) is the official chat finetune of the classic Llama 2 model, one of the most most iconic (and still one the best) 7B instruct trained models.
|
16 |
|