This is a converted pytorch checkpoint for bert with 2L trained from scratch.
See Google BERT for details.