Text Generation
Transformers
PyTorch
Safetensors
English
mixtral
conversational
Inference Endpoints
text-generation-inference

Adding `safetensors` variant of this model

#23

This is an automated PR created with https://huggingface.co/spaces/safetensors/convert

This new file is equivalent to pytorch_model.bin but safe in the sense that
no arbitrary code can be put into it.

These files also happen to load much faster than their pytorch counterpart:
https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb

The widgets on your model page will run using this model even if this is not merged
making sure the file actually works.

If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions

Feel free to ignore this PR.

Is there a way to clone this directly?

@ehartford what do you think about accepting this PR?

ehartford changed pull request status to merged
Cognitive Computations org

Merged it. But I really don't like putting 2 copies of the model in the main repo because then if someone downloads the repo they download it twice

Sign up or log in to comment