Is flash-attention-2 suppported
#8
by
Jack7777777
- opened
See it been commented out now: https://huggingface.co/Alibaba-NLP/new-impl/blob/main/modeling.py#L592
See it been commented out now: https://huggingface.co/Alibaba-NLP/new-impl/blob/main/modeling.py#L592