What Formal Languages Can Transformers Express? A Survey
Paper-reading notes: What Formal Languages Can Transformers Express? A Survey
Posts
ATLAS: Learning to Optimally Memorize the Context at Test Time
Paper-reading notes: ATLAS
Solving olympiad geometry without human demonstrations
Paper-reading notes: AlphaGeometry
Formal Mathematical Reasoning A New Frontier in AI
Paper-reading notes: Formal Mathematical Reasoning A New Frontier in AI
Titans: Learning to Memorize at Test Time
Paper-reading notes: Titans
Roformer: Enhanced Transformer With Rotary Position Embedding
Paper-reading notes: Roformer
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Paper-reading notes: AlphaZero
Mastering the game of Go without human knowledge
Paper-reading notes: AlphaGo Zero
Disentangling Light Fields for Super-Resolution and Disparity Estimation
Paper-reading notes: Distangling mechanism, DistgSSR, DistgASR, DistgDisp
Hyena Hierarchy: Towards Larger Convolutional Language Models
Paper-reading notes: Hyena Hierarchy