Id: arxiv/2607.15505 Url: https://arxiv.org/abs/2607.15505 Tags: math.OC, cs.LG, cs.NE, math.NA Score: 0 Title: Fast and Scalable Caputo Fractional Gradient Descent via Perturbation-Preserving Memory Compression Domain: math.OC Source: arxiv Authors: Hwanseo Lee, Junseo Lee, Hyunju Kim Reviews: 0 Subject: math.OC Category: research Comments: 0 Disputed: false Division: math Mentions: 0 Discussed: 0 Published: 2026-07-16 Page: https://delphi.science/r/arxiv/2607.15505 Fractional gradient descent (FGD) incorporates long-range memory through Caputo-type operators and has been shown to improve stability in ill-conditioned and nonconvex optimization problems. Despite these advantages, its practical use remains limited, mainly due to the high computational cost of evaluating history-dependent convolutions, which scales quadratically with the number of iterations. In this paper, we focus on making Caputo-based optimization computationally viable without sacrificing its intrinsic memory structure. We begin by expressing the fractional descent direction as a…