Florents-Tselai
commited on
Commit
•
80203e6
1
Parent(s):
e718bc6
Update README.md
Browse files
README.md
CHANGED
@@ -32,8 +32,32 @@ chmod +x Meltemi-7B-Instruct-v1.5-Q8_0.llamafile
|
|
32 |
|
33 |
This will open a tab with a chatbot and completion interface in your browser.
|
34 |
For additional help on how it may be used, pass the `--help` flag.
|
|
|
|
|
|
|
35 |
The server also has an OpenAI API-compatible completions endpoint.
|
36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
37 |
An advanced CLI mode is provided that's useful for shell scripting.
|
38 |
You can use it by passing the `--cli` flag. For additional help on how it may be used, pass the --help flag.
|
39 |
|
|
|
32 |
|
33 |
This will open a tab with a chatbot and completion interface in your browser.
|
34 |
For additional help on how it may be used, pass the `--help` flag.
|
35 |
+
|
36 |
+
## API
|
37 |
+
|
38 |
The server also has an OpenAI API-compatible completions endpoint.
|
39 |
|
40 |
+
```shell
|
41 |
+
curl http://localhost:8080/v1/chat/completions \
|
42 |
+
-H "Content-Type: application/json" \
|
43 |
+
-H "Authorization: Bearer no-key" \
|
44 |
+
-d '{
|
45 |
+
"model": "LLaMA_CPP",
|
46 |
+
"messages": [
|
47 |
+
{
|
48 |
+
"role": "system",
|
49 |
+
"content": "Είσαι ένας φωτεινός παντογνώστης"
|
50 |
+
},
|
51 |
+
{
|
52 |
+
"role": "user",
|
53 |
+
"content": "Γράψε μου μια ιστορία για έναν βάτραχο που έγινε αρνάκι"
|
54 |
+
}
|
55 |
+
]
|
56 |
+
}'
|
57 |
+
```
|
58 |
+
|
59 |
+
## CLI
|
60 |
+
|
61 |
An advanced CLI mode is provided that's useful for shell scripting.
|
62 |
You can use it by passing the `--cli` flag. For additional help on how it may be used, pass the --help flag.
|
63 |
|