Late-Time Fractional-Order Identification in Caputo Diffusion Equation

arXiv:2607.01898 2026 Optimization 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper supplies a mathematically explicit way to infer a fractional memory order from late-time decay using two scalar observations, together with the Caputo convolution that defines the underlying memory dynamics. The transferable asset is not the diffusion inverse problem itself, but the combination of power-law relaxation, resolvent-determined leading order, and a log-ratio estimator for the fractional exponent. A practical neural-network adaptation is an optimizer whose memory exponent is selected online from the late-time decay of a smoothed loss or gradient norm, then used to control a fractional-memory update. The diffusion assumptions do not hold exactly for nonconvex neural training, so the method should be treated as an adaptive optimizer heuristic and tested against AdamW and fixed-order fractional optimizers.

Ideas from this paper

Unverified 2026

Late-Time Fractional-Order Optimizer

Use the observed power-law decay of a scalar training signal to estimate the effective fractional order of the optimization dynamics, instead of choosing the memory exponent by hand. Then run a fractional-memory optimizer with the estimated order, allowing the algorithm to use stronger long-range memory during slow plateaus and weaker memory when the loss relaxes rapidly.

Useful6/10
Difficulty6/10
Novelty6/10
Paper: Late-Time Fractional-Order Identification in Caputo Diffusion Equation arXiv:2607.01898