Text Generation
Transformers
PyTorch
Safetensors
English
llama
Eval Results
text-generation-inference
Inference Endpoints

Adding `safetensors` variant of this model

#11

This is an automated PR created with https://huggingface.co/spaces/safetensors/convert

This new file is equivalent to pytorch_model.bin but safe in the sense that
no arbitrary code can be put into it.

These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb

The widgets on your model page will run using this model even if this is not merged
making sure the file actually works.

If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions

Feel free to ignore this PR.

Thanks @kiranshivaraju for this and your efforts. Really appreciated. Overall good direction but I think we are missing many parts of safetensor files from 00001 to 00011.safetensors. If you can add the rest, it would be LGTM and will merge this PR. Thanks Again.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment