conversion to hf format

#1
by amphora - opened

Hi thank you for the work! its awesome. i really want to try out the intermediate checkpoints but im not sure how to convert them to hf checkpoints.

is there a script you have used to convert them?

Multimodal Art Projection org

Hi! Thank you for the kind words. I'm glad you find the work awesome.

You can use the conversion script provided in our repository to convert the intermediate checkpoints to HF checkpoints. You can find the script here: https://github.com/multimodal-art-projection/Megatron-LM-NEO/tree/5215161b12485e5f09eb93b3997d7f3233d9fda9/neo#convert-checkpoints.

This comment has been hidden

thanks for the reply! really appreciate what you are doing :)

Hi! Have you already converted the ckpt to hf successfully? If so, may I know the exact script and converter_cfg.yml you used? It will help me a lot for I encounter some error during the convert.

Sign up or log in to comment