Add scheduling blocks for alternative schedules.
Browse files- description3.md +8 -0
description3.md
CHANGED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
We showcase the building block of each alternative schedules below.
|
| 2 |
+
|
| 3 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TXf74JGHaqanCcMm_jPbw.jpeg" height="100px"/>
|
| 4 |
+
<center>1F1B-V</center>
|
| 5 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TCCgzQEwjLDO3_12OUzmN.jpeg" height="100px"/>
|
| 6 |
+
<center>Zero Bubble schedule with 2/3 1F1B memory</center>
|
| 7 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/AwXeE4e0HO20u_YJV23AN.jpeg" height="100px"/>
|
| 8 |
+
<center>Variation of Interleaved 1F1B schedule</center>
|