Output generation is failing
#8
by
ravithejads
- opened
Hello,
Thank you for the model. However, I keep encountering the following error when trying to run it. It fails when I execute outputs = model.generate(**input_ids). I am experiencing this issue with both the 9B and 27B models. Is anyone else facing this problem? Can someone assist me with this?
Same issue here with both 9b and 9b-it.
Transformers library version 4.43.0.dev0
I think this is a fix: https://github.com/huggingface/transformers/issues/31664
Ok, I can confirm that this is fixed in transformers-4.42.1 :)
Yeah. Thank you.
ravithejads
changed discussion status to
closed
Ahhh, I struggled with this all day yesterday and it's fixed, time to go download the weights again.