Late-Time Fractional-Order Identification in Caputo Diffusion Equation
arXiv:2607.01898
2026
Optimization
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper supplies a mathematically explicit way to infer a fractional memory order from late-time decay using two scalar observations, together with the Caputo convolution that defines the underlying memory dynamics. The transferable asset is not the diffusion inverse problem itself, but the combination of power-law relaxation, resolvent-determined leading order, and a log-ratio estimator for the fractional exponent. A practical neural-network adaptation is an optimizer whose memory exponent is selected online from the late-time decay of a smoothed loss or gradient norm, then used to control a fractional-memory update. The diffusion assumptions do not hold exactly for nonconvex neural training, so the method should be treated as an adaptive optimizer heuristic and tested against AdamW and fixed-order fractional optimizers.
Ideas from this paper
Unverified
2026
Use the observed power-law decay of a scalar training signal to estimate the effective fractional order of the optimization dynamics, instead of choosing the memory exponent by hand. Then run a fractional-memory optimizer with the estimated order, allowing the algorithm to use stronger long-range memory during slow plateaus and weaker memory when the loss relaxes rapidly.
Useful6/10
Difficulty6/10
Novelty6/10