tweet_text: On the Role of Bidirectionality in Language Model Pre-Training
  abs: https://t.co/fG2SbUhB1W
  
  propose a new framewor… https://t.co/Gc40i0zyeV
paper_reference: On the Role of Bidirectionality in Language Model Pre-Training