Thanks Guys!
#1
by
Joseph717171
- opened
Way to go PrunaAI! GGUF Quants for the win! 😁
I'm curious what 'smashed' means? But hopeful...
I'm curious what 'smashed' means? But hopeful...
You can find some additional information on this question here
johnrachwanpruna
changed discussion status to
closed
@sharpenb
@johnrachwanpruna
smash_config.json is missing :P
I'm hypped to try your ggufs thank for the effort :)
@sharpenb @johnrachwanpruna smash_config.json is missing :P
I'm hypped to try your ggufs thank for the effort :)
Hey, sorry about that lol. For these models its GGUF with imatrix calculation. There is no additional changes made to the model.
Oh ok!
I guess that's nice to hear it was already pretty well optmitized then.