---
language:
- en
---
This repo contains code and links for the [Flash normalization paper](https://arxiv.org/abs/2407.09577):
* <a href="https://colab.research.google.com/github/OpenMachine-ai/transformer-tricks/blob/main/flash_normalization.ipynb"><img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Colab" height="20"></a>
* Paper: [arXiv](https://arxiv.org/abs/2407.09577), [HuggingFace paper page](https://huggingface.co/papers/2407.09577), and [latex](https://github.com/OpenMachine-ai/transformer-tricks/blob/main/latex/flash.tex)
* See [here](https://github.com/OpenMachine-ai/transformer-tricks/tree/main) for more transformer tricks