Add exported 'openvino_model.xml' compatible with Sentence Transformers

#6
by tomaarsen HF staff - opened

Hello!

This pull request has been automatically generated from the Sentence Transformers backend-export Space.

Pull Request overview

  • Add exported OpenVINO model openvino_model.xml.

Tip:

Consider testing this pull request before merging by loading the model from this PR with the revision argument:

from sentence_transformers import SentenceTransformer

# TODO: Fill in the PR number
pr_number = 2
model = SentenceTransformer(
    "tomaarsen/bge-small-en-v1.5-copy",
    revision=f"refs/pr/{pr_number}",
    backend="openvino",
)

# Verify that everything works as expected
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
print(embeddings.shape)

similarities = model.similarity(embeddings, embeddings)
print(similarities)
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment