conversion to hf format
Hi thank you for the work! its awesome. i really want to try out the intermediate checkpoints but im not sure how to convert them to hf checkpoints.
is there a script you have used to convert them?
Hi! Thank you for the kind words. I'm glad you find the work awesome.
You can use the conversion script provided in our repository to convert the intermediate checkpoints to HF checkpoints. You can find the script here: https://github.com/multimodal-art-projection/Megatron-LM-NEO/tree/5215161b12485e5f09eb93b3997d7f3233d9fda9/neo#convert-checkpoints.
thanks for the reply! really appreciate what you are doing :)
Hi! Have you already converted the ckpt to hf successfully? If so, may I know the exact script and converter_cfg.yml you used? It will help me a lot for I encounter some error during the convert.