not opening in transformers

#1
by sujitvasanth - opened

Hi this wont open in transformers saying the safetensor files areant right does it only work with exlaama2?

Yes, use exllamav2 or exllamav2_hf as model loader. It will not work with normal Transformers.

Sign up or log in to comment