Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Support sharded safetensors size
#63
by
tomaarsen
HF staff
- opened
Hello!
Pull Request overview
- Add tqdm for external models
- Add model.safetensors.index.json support
Details
I've added TQDM support for easier progresstracking when building. Additionally, the model.safetensors.index.json now works, allowing model sizes to be captured for e.g. mixedbread-ai/mxbai-mistral-7b-reprev-v1.
- Tom Aarsen
Amazing! I tried it here https://huggingface.co/spaces/Muennighoff/tmp but it doesn't show -- does it work for you?
It did; although the model that inspired this PR has been made private, so it's a bit hard to verify. I don't think there's another model that uses model.safetensors.index.json
at this time.
Okay great, let's merge then!
Muennighoff
changed pull request status to
open
Muennighoff
changed pull request status to
merged