openchat
/

openchat-3.5-1210

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

imone commited on Dec 21, 2023

Commit

76c642b

•

1 Parent(s): 90cd69d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -93,7 +93,7 @@ If you want to deploy the server as an online service, you can use `--api-keys s
 | Model             | Size | Context | Weights                                                          | Serving                                                                                                          |
 |-------------------|------|---------|------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------|
-| OpenChat 3.5 1210 | 7B   | 8192    | [Huggingface](https://huggingface.co/openchat/openchat_3.5_1210) | `python -m ochat.serving.openai_api_server --model openchat/openchat_3.5_1210 --engine-use-ray --worker-use-ray` |
 <details>
   <summary>Example request (click to expand)</summary>

 | Model             | Size | Context | Weights                                                          | Serving                                                                                                          |
 |-------------------|------|---------|------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------|
+| OpenChat 3.5 1210 | 7B   | 8192    | [Huggingface](https://huggingface.co/openchat/openchat-3.5-1210) | `python -m ochat.serving.openai_api_server --model openchat/openchat-3.5-1210 --engine-use-ray --worker-use-ray` |
 <details>
   <summary>Example request (click to expand)</summary>