jacobfulano
commited on
Commit
•
fdbb682
1
Parent(s):
7b2f449
Update README.md
Browse files
README.md
CHANGED
@@ -94,7 +94,7 @@ reduces the number of read/write operations between the GPU HBM (high bandwidth
|
|
94 |
Details on our “unpadding” implementation can be found [in the mosaicml/examples repo here](https://github.com/mosaicml/examples/tree/main/examples/benchmarks/bert/src/bert_padding.py).
|
95 |
|
96 |
4. **Low Precision LayerNorm**: this small tweak forces LayerNorm modules to run in float16 or bfloat16 precision instead of float32, improving utilization.
|
97 |
-
Our implementation can be found [in the mosaicml/examples repo here](https://docs.mosaicml.com/en/
|
98 |
|
99 |
### Modifications to the Feedforward Layers
|
100 |
|
|
|
94 |
Details on our “unpadding” implementation can be found [in the mosaicml/examples repo here](https://github.com/mosaicml/examples/tree/main/examples/benchmarks/bert/src/bert_padding.py).
|
95 |
|
96 |
4. **Low Precision LayerNorm**: this small tweak forces LayerNorm modules to run in float16 or bfloat16 precision instead of float32, improving utilization.
|
97 |
+
Our implementation can be found [in the mosaicml/examples repo here](https://docs.mosaicml.com/projects/composer/en/stable/method_cards/low_precision_layernorm.html).
|
98 |
|
99 |
### Modifications to the Feedforward Layers
|
100 |
|