Rethinking Attention with Performers
Paper-reading notes: Performers
Attention
What Formal Languages Can Transformers Express? A Survey
Paper-reading notes: What Formal Languages Can Transformers Express? A Survey
ATLAS: Learning to Optimally Memorize the Context at Test Time
Paper-reading notes: ATLAS
Roformer: Enhanced Transformer With Rotary Position Embedding
Paper-reading notes: Roformer
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Paper-reading notes: ViT
A Bridging Model for Parallel Computation
Paper-reading notes: A Bridging Model for Parallel Computation
Attention is All You Need
Paper-reading notes: Attention is All You Need