Add infinity as example deployment (#22)

- Add infinity as example deployment (b44b442663045dcafdbdc54389417cd5ba6ffe2d)


Co-authored-by: Michael <michaelfeil@users.noreply.huggingface.co>

README.md

@@ -2701,6 +2701,14 @@ for dv in doc_vecs:
 ```
 
 
+## 3. Infinity
+
+[Infinity](https://github.com/michaelfeil/infinity) is a MIT licensed server for OpenAI-compatible deployment.
+```
+docker run --gpus all -v $PWD/data:/app/.cache -p "7997":"7997" \
+michaelf34/infinity:0.0.68 \
+v2 --model-id WhereIsAI/UAE-Large-V1 --revision "369c368f70f16a613f19f5598d4f12d9f44235d4" --dtype float16 --batch-size 32 --device cuda --engine torch --port 7997
+```
 
 # Citation