执行demo，推理时间超过10分钟，请问正常吗

#23

by chxmind - opened Jun 6, 2023

Jun 6, 2023

执行demo，推理时间超过10分钟，请问正常吗

Jun 6, 2023

8 个 3090

chxmind changed discussion status to closed Jun 6, 2023

Fengshenbang-LM org Jun 8, 2023

8 个 3090

我们内部测试半精度下，3张3090用huggingface原生的model.generate方法就可以比较快的生成了

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment