Hugging Face's logo

BAAI
/
bge-reranker-base

Text Classification
sentence-transformers
PyTorch
ONNX
Safetensors
English
Chinese
xlm-roberta
mteb
text-embeddings-inference
Eval Results
Model card Files Community
23

HF TGI deployment

#8
by austinmw - opened
Discussion
austinmw

Can this model be deployed with the HF TGI server?

I'm particularly interested in what inference server / DLC image to use to deploy it on SageMaker?

swulling

You can use HF Text Embeddings Inference to deploy bge-reranker models.

https://huggingface.co/docs/text-embeddings-inference/index

https://huggingface.co/docs/text-embeddings-inference/quick_tour#re-rankers

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment