Learning Transformer Programs
Paper-reading notes: Learning Transformer Programs
Reasoning
ALTA: Compiler-Based Analysis of Transformers
Paper-reading notes: ALTA
Tracr: Compiled Transformers as a Laboratory for Interpretability
Paper-reading notes: Tracr
Thinking Like Transformers
Paper-reading notes: RASP
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
Paper-reading notes: On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
What Formal Languages Can Transformers Express? A Survey
Paper-reading notes: What Formal Languages Can Transformers Express? A Survey
Solving olympiad geometry without human demonstrations
Paper-reading notes: AlphaGeometry
Formal Mathematical Reasoning A New Frontier in AI
Paper-reading notes: Formal Mathematical Reasoning A New Frontier in AI
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper-reading notes: DeepSeek-R1 - Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Mastering the game of Go with MCTS and Deep Neural Networks
Paper-reading notes: Mastering the game of Go with MCTS and Deep Neural Networks