File size: 577 Bytes
0f2e51d a9bdfe4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
We showcase the building block of each alternative schedules below.
### 1F1B-V:
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TXf74JGHaqanCcMm_jPbw.jpeg" width="690px"/>
### Zero Bubble schedule with 2/3 1F1B memory:
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TCCgzQEwjLDO3_12OUzmN.jpeg" width="480px"/>
### Variation of Interleaved 1F1B schedule:
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/AwXeE4e0HO20u_YJV23AN.jpeg" width="719px"/>
|