Transformers

The Transformer architecture

Transformers for long Sequences

References:

• The big picture: Transformers for long Sequences