use infinity latest tag
Browse files
README.md
CHANGED
@@ -2706,7 +2706,7 @@ for dv in doc_vecs:
|
|
2706 |
[Infinity](https://github.com/michaelfeil/infinity) is a MIT licensed server for OpenAI-compatible deployment.
|
2707 |
```
|
2708 |
docker run --gpus all -v $PWD/data:/app/.cache -p "7997":"7997" \
|
2709 |
-
michaelf34/infinity:
|
2710 |
v2 --model-id WhereIsAI/UAE-Large-V1 --revision "369c368f70f16a613f19f5598d4f12d9f44235d4" --dtype float16 --batch-size 32 --device cuda --engine torch --port 7997
|
2711 |
```
|
2712 |
|
|
|
2706 |
[Infinity](https://github.com/michaelfeil/infinity) is a MIT licensed server for OpenAI-compatible deployment.
|
2707 |
```
|
2708 |
docker run --gpus all -v $PWD/data:/app/.cache -p "7997":"7997" \
|
2709 |
+
michaelf34/infinity:latest \
|
2710 |
v2 --model-id WhereIsAI/UAE-Large-V1 --revision "369c368f70f16a613f19f5598d4f12d9f44235d4" --dtype float16 --batch-size 32 --device cuda --engine torch --port 7997
|
2711 |
```
|
2712 |
|