Hugging Face's logo

Spaces:
sail
/
pipeline-parallelism-with-controllable-memory
Running

App Files Community
pipeline-parallelism-with-controllable-memory / description3.md
nvmdava's picture
nvmdava
Add scheduling blocks for alternative schedules.
0f2e51d verified
preview code
|
raw
history blame
610 Bytes

We showcase the building block of each alternative schedules below.

1F1B-V
Zero Bubble schedule with 2/3 1F1B memory
Variation of Interleaved 1F1B schedule