It’s All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization
Paper-reading notes: MIRAS
Posts
FNet: Mixing Tokens with Fourier Transforms
Paper-reading notes: FNet
Linformer: Self-Attention with Linear Complexity
Paper-reading notes: Linformer
Rethinking Attention with Performers
Paper-reading notes: Performers
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
Paper-reading notes: On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
What Formal Languages Can Transformers Express? A Survey
Paper-reading notes: What Formal Languages Can Transformers Express? A Survey
ATLAS: Learning to Optimally Memorize the Context at Test Time
Paper-reading notes: ATLAS
Solving olympiad geometry without human demonstrations
Paper-reading notes: AlphaGeometry
Formal Mathematical Reasoning A New Frontier in AI
Paper-reading notes: Formal Mathematical Reasoning A New Frontier in AI
Titans: Learning to Memorize at Test Time
Paper-reading notes: Titans