Why was .safetensors variant removed?
#9
by
HanukaTomata
- opened
In commit history, I can see https://huggingface.co/sentence-transformers/LaBSE/commit/e34fab64a3011d2176c99545a93d5cbddc9a91b7.
Safetensors variant was added and then removed from the repo. Why so?
Hello!
My apologies for the delay, the reason is a tad complex.
- The Inference Endpoints solutions on Hugging Face would only copy
model.safetensors
files to a fresh cloud environment if any safetensors file existed in the repository, i.e. they would ignorepytorch_model.bin
files. - Sentence Transformers did not support
model.safetensors
files for Dense modules until version v3.0.1 - The Inference toolkit would install version v2.7.0.
Because of this combination of events, this model could not be loaded by the inference endpoints. I can re-add the Safetensors files once this is merged and released: https://github.com/huggingface/huggingface-inference-toolkit/pull/91
- Tom Aarsen
I've re-added the safetensors files.
tomaarsen
changed discussion status to
closed