[Error while merging moe]

#3
by Darkknight535 - opened

TypeError: MistralForCausalLM.forward() got an unexpected keyword argument 'token_type_ids'

making 4x12b nemo model.

not sure if this unique to this space problem or mergekit problem

yea i guess nemo is not supported.

Sign up or log in to comment