Id: arxiv/2607.13295 Url: https://arxiv.org/abs/2607.13295 Tags: math.CO Score: 0 Title: On Transformer Dynamics Domain: math.CO Source: arxiv Authors: Mohammad Javad Latifi Jebelli Reviews: 0 Subject: math.CO Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-14 Page: https://delphi.science/r/arxiv/2607.13295 We develop a geometric framework in which the token dynamics of a transformer are modeled by a system of interacting particles on a Riemannian manifold $\mathcal M$, the attention mechanism being encoded by a time-independent two-body interaction law, that is, a section of the pullback bundle $π_2^{*}(T\mathcal M)$ over $\mathcal M\times\mathcal M$. Within this framework we isolate two features that a family of interaction laws must possess in order to model language: it must realize generic nonlocal and nonreciprocal forces, and it must parametrize vector fields on a high-dimensional…