推理报错 [TM][ERROR] CUDA runtime error: invalid argument

#5
by kkkknddnjfks - opened

WARNING: Can not find tokenizer.json. It may take long time to initialize the tokenizer.
[WARNING] gemm_config.in is not found; using default GEMM algo
terminate called after throwing an instance of 'std::runtime_error'
what(): [TM][ERROR] CUDA runtime error: invalid argument /lmdeploy/src/turbomind/utils/allocator.h:253
Aborted

硬件A10,CUDA Version: 11.8

InternLM org

Please provide more details so that we can reproduce the error.

Sign up or log in to comment