ImportError: This modeling file requires the following packages that were not found in your environment: flash_attn. Run `pip install flash_attn`
#14
by
kang1
- opened
This is a common issue in transformers when model trust_remote_code=True, some discussion in https://github.com/huggingface/transformers/issues/28459
The problem is transformers' dynamic module implemetation, maybe deepseek2 can apply this fix:
https://huggingface.co/microsoft/phi-2/commit/eb8bbd1d37d258ea74fb082c53346d33056a83d4