mgoin

/

Nemotron-4-340B-Instruct-hf-FP8

like 3

Hi @bay-llm I tried exporting the Reward model and it failed because there were missing tensors in the Nemo file. I used the checkpoint from here https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/nemotron-4-340b-reward

Thank you for your response. I am hopeful that this will resolve the issue about the reward model weights.