---
datasets:
- ddrg/math_formulas
- ddrg/math_formula_retrieval
- ddrg/math_text
- ddrg/named_math_formulas
---

# Mathematical Structure Aware BERT

<!-- Provide a quick summary of what the model is/does. -->

Pretrained model based on [bert-base-cased](https://huggingface.co/bert-base-cased) with further mathematical pre-training.

Compared to bert-base-cased, 300 additional mathematical [LaTeX tokens](added_tokens.json) have been added before the mathematical pre-training.