ACE-Plus

Running on Zero

chaojiemao commited on 6 days ago

Commit

637b667

verified ·

1 Parent(s): e8a21ad

Update config/ace_plus_fft.yaml

Files changed (1) hide show

config/ace_plus_fft.yaml CHANGED Viewed

@@ -66,7 +66,7 @@ MODEL:
     DEPTH: 19
     # DEPTH_SINGLE_BLOCKS DESCRIPTION: number of transformer blocks in the single stream block. TYPE: int default: 38
     DEPTH_SINGLE_BLOCKS: 38
-    ATTN_BACKEND: pytorch
   #
   FIRST_STAGE_MODEL:

     DEPTH: 19
     # DEPTH_SINGLE_BLOCKS DESCRIPTION: number of transformer blocks in the single stream block. TYPE: int default: 38
     DEPTH_SINGLE_BLOCKS: 38
+    ATTN_BACKEND: flash_attn
   #
   FIRST_STAGE_MODEL: