SINDy Implementation Notes

Github repo: https://github.com/mrtanke/SINDy This blog is basically my hands-on notes while implementing SINDy (Sparse Identification of Nonlinear Dynamics) as a small, understandable pipeline: generate data → build a candidate library → solve a sparse regression problem → sanity-check the discovered equation → then push it into harder settings like autoencoder and video-like data. The whole notebook is organized into three parts: (1) SINDy on ground-truth coordinates, (2) SINDy-Autoencoder, and (3) a bonus on high-dimensional “video” inputs. ...

January 22, 2026 | 892 words | Author: Tan Ke

Hyena Hierarchy: Towards Larger Convolutional Language Models

Paper-reading notes: Hyena Hierarchy
November 18, 2025 | 516 words | Author: Tan Ke

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper-reading notes: Mamba
November 17, 2025 | 397 words | Author: Tan Ke

Efficiently Modeling Long Sequences with Structured State Spaces

Paper-reading notes: S4
November 11, 2025 | 930 words | Author: Tan Ke

Retentive Network: A Successor to Transformer for Large Language Models

Paper-reading notes: RetNet
November 11, 2025 | 472 words | Author: Tan Ke

Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation

Paper-reading notes: Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Computation
November 9, 2025 | 1312 words | Author: Tan Ke

xLSTM: Extended Long Short-Term Memory

Paper-reading notes: xLSTM Extended Long Short-Term Memory
October 28, 2025 | 1394 words | Author: Tan Ke

RWKV: Reinventing RNNs for the Transformer Era

Paper-reading notes: RWKV: Reinventing RNNs for the Transformer Era
October 27, 2025 | 1499 words | Author: Tan Ke