Purpose of This Model & Binary Format
#1
by
danforbes
- opened
Hi - curious what this model has been created for; can you provide a description? Also, I've been contributing to a repo that has Rust bindings for GGML files, and there seem to be some oddities in the way you've formatted this file - the file type in the hyperparameters is f32, and the vocabulary scoring doesn't seem to line up with the GGML/GGMF/GGJT format. Is this intentional? Do you have any plans to replace this file with one that is formatted correctly?
Files were quantized with the latest build of ggerganov/ggml. Can confirm it works on my and a few other people's systems.
Not sure what the problem with rustformers is - it probably wants a file quantized with an older version of ggml?
Sound about right! Thanks for the quick response.
danforbes
changed discussion status to
closed