Apr 22, 2026·Formal Sciences·260423.0032
An explicit operator explains end-to-end computation in the modern neural networks used for sequence and language modeling
Anif N. Shikder, Ramit Dey, Sayantan Auddy, Luisa Liboni +5 more
This paper establishes a mathematical correspondence between state space models (like S4) and nonlinear oscillator networks, deriving an exact operator expression for S4D's forward pass. This provides analytical interpretability for modern sequence models by revealing how information propagates as waves in a ring network topology.