{
 "artifacts": null,
 "category": "regularization",
 "description": "Use explicitly stochastic latent dynamics to detect hidden-state changes that are invisible in the observed output spectrum. Near the integral-memory regime, constrain or monitor cross diffusion with a forward-versus-reverse path statistic, preventing output-equivalent latent models from developing physically implausible irreversible dynamics.",
 "download_zip": "https://synthcore.org/download/1164",
 "formulas_latex": [
  "$$dX_t=-A X_t\\,dt+B\\,dW_t,\\qquad D=\\frac{1}{2}BB^{\\top},\\qquad X_t=(x_t,y_t)^{\\top}$$",
  "$$A_{yy}=0\\ \\Longrightarrow\\ S_x(\\omega)\\ \\text{is insensitive to }D_{xy}\\ \\text{for nontrivial coupling}$$",
  "$$\\sigma\\geq\\tau_x^{-1}\\left(\\frac{4}{\\rho}-1\\right),\\qquad \\rho\u003c4$$",
  "$$\\mathcal{L}_{\\mathrm{irr}}=\\left[\\tau_x^{-1}\\left(\\frac{4}{\\rho}-1\\right)-\\widehat{\\sigma}\\right]_+^2+\\lambda_D\\operatorname{Var}_{\\mathrm{augment}}(\\widehat{D}_{xy})$$"
 ],
 "id": 3004,
 "implementation": "Integrate this monitor into a stochastic RNN or latent world model with transition `z_next = z + f_theta(z,u)*dt + L_theta(z,u)*sqrt(dt)*epsilon`, where epsilon is standard Gaussian noise. Use a two-dimensional diagnostic latent subspace, or project a larger latent state onto its two slowest principal components. Estimate the local drift matrix A by regressing finite differences against the latent state. Estimate D from the covariance of residual increments, using D = residual_covariance/(2 dt). Estimate tau_x from exponential decay of the observed coordinate autocorrelation. Estimate irreversibility sigma using a forward-versus-time-reversed transition classifier or the difference between forward and reverse Gaussian transition log likelihoods. Pseudocode is: `A,D = fit_OU(latents); rho = pole_coordinate(A); sigma = reverse_forward_loglik_gap(latents); bound = (4/rho - 1)/tau_x; loss = prediction_loss + lam*relu(bound-sigma)**2`. The OU equations, the A_yy = 0 identifiability condition, and the irreversibility bound come from the paper; A, D, sigma, and estimation uncertainty are empirical. First test a synthetic two-state OU process with A_yy = 0, fixed observed spectrum, and several D_xy values, then use a noisy delayed-Copy task. The prediction is that output-spectrum error remains nearly constant as D_xy changes, while the forward/reverse likelihood gap changes. For rho \u003c 4, measured sigma should satisfy the stated lower bound up to estimation error; violations should correlate with worse reverse-time prediction and poor long-horizon calibration.",
 "math_summary": "For a two-dimensional Ornstein-Uhlenbeck latent process dX = -A X dt + B dW, with diffusion matrix D = B B^T / 2 and X = (x,y)^T, the paper identifies a blind spot: for nontrivial coupling, the scalar spectrum of x is insensitive to cross diffusion D_xy when the hidden state has no self-relaxation, A_yy = 0. This is the integral-memory limit associated with exact adaptation. The hidden diffusion can nevertheless change the Gaussian path-space irreversibility rate sigma. For a specified all-even reduced two-state drift with rho \u003c 4, the paper gives sigma \u003e= tau_x^(-1)(4/rho - 1), where tau_x is the observed-state relaxation time.",
 "math_tags": [
  "stochastic-processes",
  "dynamical-systems",
  "control-theory",
  "statistics"
 ],
 "ml_areas": [
  "rnn",
  "ssm",
  "world-model",
  "regularization"
 ],
 "paper": {
  "arxiv_id": "2609.01329",
  "arxiv_url": "https://arxiv.org/abs/2609.01329",
  "summary_what_math_gives_to_ml": "The paper shows that pole geometry and latent-state properties can change under model reduction: the same higher-order system of real relaxation modes produces rho_moment = 4.50 under low-frequency moment matching and rho_window = 3.31 under finite-window fitting, crossing the reduced second-order boundary at rho = 4. This mechanism transfers to recurrent and state-space neural networks, where compression or finite-context fitting can create spurious oscillatory modes and degrade long-horizon prediction. The paper also shows that an observed scalar spectrum can be insensitive to hidden cross diffusion when the hidden state has no self-relaxation, even though path-space irreversibility changes. These results motivate protocol-robust pole regularization and latent irreversibility diagnostics.",
  "title": "Pole-Zero Geometry, Model Reduction, and Identifiability in Sensory Adaptation",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 6,
  "novelty": 8,
  "usefulness": 7
 },
 "solves": [
  "stability",
  "accuracy",
  "generalization"
 ],
 "title": "Hidden-Diffusion Irreversibility Monitor",
 "url": "https://synthcore.org/idea/3004/hidden-diffusion-irreversibility-monitor",
 "verification": {
  "peer_reviewed": false,
  "status": "queued_mechanism",
  "status_label": "Queued — mechanism check",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)",
  "verification_axes": {
   "benchmark_mechanism": {
    "confirmed": null,
    "tested": false
   },
   "practical_benchmark": {
    "beats_baseline": null,
    "tested": false
   },
   "toy_mechanism_gate": {
    "confirmed": null,
    "tested": false
   }
  }
 }
}