SOURCE GGUF question
How do you make your SOURCE ggufs? I don't see such an option in convert_hf_to_gguf.py.
Also, is it better to quant from SOURCE than f16 or bf16? Which do you do?
The SOURCE is simply whatever was used as source for the quantisations, and it is provided only when it was not obvious - or somehow very difficult - to obtain, and thus, every such file has a story of its own. For example, it, might have required a special converter, some code fix, could be copied from somebody else (such as a leaked source) and so on. It always means some manual intervention of sorts has happened.
Most of the time, the internal source is simply whatever convert_hf_to_gguf.py (or another converter) outputs, but since that is considered obvious, it is not usually provided in such cases.
If you have questions, feel free to ask them - I might or might not remember the provenance of specific SOURCE files.