Update README.md

README.md

@@ -13,6 +13,7 @@ license_link: https://ai.google.dev/gemma/terms
 
 
 Note: If you wish to use GemMoE while it is in beta, you must flag (trust_remote_code=True) in your training/inference config.
+FlashAttention is currently required - so ensure you have the most up to date version if you're using anything other than an A100/H100
 
 
 # GemMoE: An 8x8 Mixture Of Experts based on Gemma.