infgrad michaelfeil commited on
Commit
24e2e1f
1 Parent(s): 2aa5579

Update infinity example (#23)

Browse files

- Update infinity example (1ef9639c383c81e07149050df8ffdc65c0c3a800)
- Update README.md (8342a640dce9dc10cb571388ce47e1900d1483eb)


Co-authored-by: Michael <michaelfeil@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -5579,6 +5579,17 @@ print(similarities)
5579
  # [0.32818374 0.80954516]]
5580
  ```
5581
 
 
 
 
 
 
 
 
 
 
 
 
5582
  # FAQ
5583
 
5584
  Q: The details of training?
 
5579
  # [0.32818374 0.80954516]]
5580
  ```
5581
 
5582
+ ### infinity_emb
5583
+
5584
+ Usage via [infinity, MIT Licensed](https://github.com/michaelfeil/infinity).
5585
+
5586
+ ```bash
5587
+ docker run \
5588
+ --gpus all -p "7997":"7997" \
5589
+ michaelf34/infinity:0.0.69 \
5590
+ v2 --model-id dunzhang/stella_en_400M_v5 --revision "refs/pr/24" --dtype bfloat16 --batch-size 16 --device cuda --engine torch --port 7997 --no-bettertransformer
5591
+ ```
5592
+
5593
  # FAQ
5594
 
5595
  Q: The details of training?