My quants and "silly" experiment.
#1
by
ZeroWw
- opened
Quants (including q8q4 for small devices)
https://huggingface.co/ZeroWw/Phi-3.5-mini-instruct_Uncensored-GGUF
Silly version
https://huggingface.co/ZeroWw/Phi-3.5-mini-instruct_Uncensored-SILLY
Note, despite the name, the "SILLY" version is a fully working model with modified weights.
It's answers are slightly different from the ones you would get with the normal model (and the same seed).
Looks interesting, I saw the reddit thread as well, keep it up.
SicariusSicariiStuff
changed discussion status to
closed