Can't load or quant model

#1
by bartowski - opened

Seems like something is off in your tokenizer.json, any chance you can look into it? Getting

Tokenizer.from_file(tokenizer_json)
Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 12564 column 3
NTQ SOLUTION org
edited Apr 28

I updated the tokenizer.json and you can try again or install transformer version 4.39

@bartowski can we wait the quantised version? :)

NTQ SOLUTION org

@bartowski can we wait the quantised version? :)

you can find a quantised version at https://huggingface.co/Monor/Nxcode-CQ-7B-orpo-gguf.

@rodion-m had some downtime but will be making this today :)

Sign up or log in to comment