Update README.md
Browse files
README.md
CHANGED
@@ -51,15 +51,15 @@ This is multilingual model, with a focus on Arabic.
|
|
51 |
|
52 |
## Quickstart
|
53 |
|
54 |
-
You can run the following
|
55 |
execute the model.
|
56 |
|
57 |
```
|
58 |
-
wget https://huggingface.co/jartine/aya-23-8B-llamafile/resolve/main/aya-23-8B.
|
59 |
-
chmod +x aya-23-8B.
|
60 |
-
./aya-23-8B.
|
61 |
-
./aya-23-8B.
|
62 |
-
./aya-23-8B.
|
63 |
```
|
64 |
|
65 |
Alternatively, you may download an official `llamafile` executable from
|
@@ -67,7 +67,7 @@ Mozilla Ocho on GitHub, in which case you can use the Mixtral llamafiles
|
|
67 |
as a simple weights data file.
|
68 |
|
69 |
```
|
70 |
-
llamafile -m ./aya-23-8B.
|
71 |
```
|
72 |
|
73 |
For further information, please see the [llamafile
|
@@ -82,7 +82,7 @@ of the README.
|
|
82 |
Command-line instruction example:
|
83 |
|
84 |
```
|
85 |
-
./aya-23-8B.
|
86 |
<|START_OF_TURN_TOKEN|>
|
87 |
<|USER_TOKEN|>Who is the president?<|END_OF_TURN_TOKEN|>
|
88 |
<|START_OF_TURN_TOKEN|>
|
|
|
51 |
|
52 |
## Quickstart
|
53 |
|
54 |
+
You can run the following commands which download, concatenate, and
|
55 |
execute the model.
|
56 |
|
57 |
```
|
58 |
+
wget https://huggingface.co/jartine/aya-23-8B-llamafile/resolve/main/aya-23-8B.Q6_K.llamafile
|
59 |
+
chmod +x aya-23-8B.Q6_K.llamafile
|
60 |
+
./aya-23-8B.Q6_K.llamafile --help # view manual
|
61 |
+
./aya-23-8B.Q6_K.llamafile # launch web gui + oai api
|
62 |
+
./aya-23-8B.Q6_K.llamafile -p ... # cli interface (scriptable)
|
63 |
```
|
64 |
|
65 |
Alternatively, you may download an official `llamafile` executable from
|
|
|
67 |
as a simple weights data file.
|
68 |
|
69 |
```
|
70 |
+
llamafile -m ./aya-23-8B.Q6_K.llamafile ...
|
71 |
```
|
72 |
|
73 |
For further information, please see the [llamafile
|
|
|
82 |
Command-line instruction example:
|
83 |
|
84 |
```
|
85 |
+
./aya-23-8B.Q6_K.llamafile --log-disable --silent-prompt -p '<BOS_TOKEN>
|
86 |
<|START_OF_TURN_TOKEN|>
|
87 |
<|USER_TOKEN|>Who is the president?<|END_OF_TURN_TOKEN|>
|
88 |
<|START_OF_TURN_TOKEN|>
|