simple, easily readable, and easily modifiable. It is not optimized, and omits many desirable features.

This is a Triton implementation of the Flash Attention v2 algorithm from Tri Dao (https://tridao.me/publications/flash2/flash2.pdf) ...