Loading issue with safetensor not being recognized.

#1
by ElectraPlays - opened

I tried the main 4.25 and the 4.65 both but they fail to recognize the output.safetensor. How do I even fix this. I even tried the kobold forked version too doesn't work and doesn't recognize it when I even rename the safetensor to 4bit.safetensor.

@ElectraPlays I've redownloaded this model and tested it with Text-Generation-WebUI and TabbyAPI, both loaded it perfectly fine.
I'm not sure about KoboldAI. I have henk717 version but it's almost 10 months since I last updated it, so I don't know if there are any major changes.
My old KoboldAI copy requires to explicitly choose Exllamav2 loader in the drop down menu to load it.
But once it's selected, it loads it without any issues.
All the mentioned apps managed to load it as is. I didn't rename or modify any files.
изображение.png

Sign up or log in to comment