Constructing Transformers For Longer Sequences with Sparse Attention Methods Google Research Blog, 25 Mar 2021 Posted by Avinava Dubey, Research Scientist, Google Research Natural language processing (NLP) models based on Transformers…