"triu_tril_cuda_template" not implemented for 'BFloat16'
#19
by
als-991011
- opened
how to fix it
File "/usr/local/miniconda3/lib/python3.9/site-packages/transformers/models/qwen2_vl/modeling_qwen2_vl.py", line 428, in _prepare_4d_causal_attention_mask_with_cache_position
causal_mask = torch.triu(causal_mask, diagonal=1)
"triu_tril_cuda_template" not implemented for 'BFloat16'
出现问题
als-991011
changed discussion status to
closed