model.generate for dolly printing tensor sizes.
#38
by
anujchopra
- opened
Hi,
When I use dolly 3b or 7b models, my generate function continuously prints tensor sizes. This does not happen when I use other models like "CobraMamba/mamba-gpt-3b-v2". This is how it looks for dolly.
Hi,
Anyone has any suggestions?
Anuj