Why was .safetensors variant removed?

#9
by HanukaTomata - opened

In commit history, I can see https://huggingface.co/sentence-transformers/LaBSE/commit/e34fab64a3011d2176c99545a93d5cbddc9a91b7.
Safetensors variant was added and then removed from the repo. Why so?

Sentence Transformers org

Hello!

My apologies for the delay, the reason is a tad complex.

  1. The Inference Endpoints solutions on Hugging Face would only copy model.safetensors files to a fresh cloud environment if any safetensors file existed in the repository, i.e. they would ignore pytorch_model.bin files.
  2. Sentence Transformers did not support model.safetensors files for Dense modules until version v3.0.1
  3. The Inference toolkit would install version v2.7.0.

Because of this combination of events, this model could not be loaded by the inference endpoints. I can re-add the Safetensors files once this is merged and released: https://github.com/huggingface/huggingface-inference-toolkit/pull/91

  • Tom Aarsen
Sentence Transformers org

I've re-added the safetensors files.

tomaarsen changed discussion status to closed

Sign up or log in to comment