{
 "artifacts": null,
 "category": "geometry",
 "description": "Add a consistency loss for a neural model processing irregularly sampled functions or sequences, comparing its latent covariance representation before and after a time-coordinate warp. The target discrepancy should be near zero for affine transformations but should grow with the normalized curvature, bandwidth, and local sparsity of a nonlinear warp.",
 "formulas_latex": [
  "$$\\mathcal{C}^{(\\psi)}=U_{\\psi}\\mathcal{C}U_{\\psi}^{*},\\qquad (U_\\psi f)(s)=f(\\psi^{-1}(s))\\sqrt{(\\psi^{-1})'(s)}.$$",
  "$$\\widehat{\\mathcal{C}}^{(\\psi)}=U_{\\psi}\\widehat{\\mathcal{C}}U_{\\psi}^{*}\\quad\\text{for every finite design and response array}\\quad\\Longleftrightarrow\\quad \\psi\\text{ is affine}.$$",
  "$$\\left\\|\\widehat{\\mathcal{C}}^{(\\psi)}-U_{\\psi}\\widehat{\\mathcal{C}}U_{\\psi}^{*}\\right\\|_{\\mathrm{HS}}=O_{P}\\!\\left[\\kappa_{\\psi}\\left\\{h^{2}+h n_{\\mathrm{loc}}^{-1/2}+h_{0}^{2}+h_{0}n_{\\mathrm{loc},1}^{-1/2}\\right\\}\\right],\\qquad \\kappa_{\\psi}=\\left\\|\\frac{\\psi''}{\\psi'}\\right\\|_{\\infty}.$$",
  "$$\\mathcal L_{\\mathrm{curv}}=\\left[\\max\\left\\{0,\\ \\left\\|\\widehat{\\mathcal C}_{\\theta}^{(\\psi)}-U_\\psi\\widehat{\\mathcal C}_{\\theta}U_\\psi^*\\right\\|_{\\mathrm{HS}}-\\left(\\delta_0+C\\kappa_\\psi S\\right)\\right\\}\\right]^2.$$"
 ],
 "id": 3120,
 "implementation": "Integrate the method into an irregular-time transformer, GRU, or continuous-time encoder with a latent covariance head. For observations \\((t_{ij},y_{ij})\\), compute latent vectors \\(z_{ij}=f_\\theta(t_{ij},y_{ij})\\), estimate their local mean with bandwidth \\(h_0\\), and form a grid-based local covariance \\(\\widehat{\\mathcal C}_\\theta\\) using kernel-weighted off-diagonal products. Create a warped copy with \\(s_{ij}=\\psi(t_{ij})\\), run the same network and covariance head, and call the result \\(\\widehat{\\mathcal C}^{(\\psi)}_\\theta\\). Numerically apply \\(U_\\psi\\) to the unwarped covariance by resampling at \\(\\psi^{-1}(s)\\) and multiplying by \\(\\sqrt{(\\psi^{-1})'(s)}\\). Estimate curvature on a discrete time grid using \\(\\kappa_\\psi\\approx\\max_k |\\Delta^2\\psi_k/\\Delta t^2|/(|\\Delta\\psi_k/\\Delta t|+\\epsilon)\\). Estimate \\(n_{\\mathrm{loc}}\\) and \\(n_{\\mathrm{loc},1}\\) from counts of observations receiving non-negligible kernel weight, then compute \\(S=h^2+h/\\sqrt{n_{\\mathrm{loc}}}+h_0^2+h_0/\\sqrt{n_{\\mathrm{loc},1}}\\). Add \\(\\lambda\\mathcal L_{\\mathrm{curv}}\\) to the task loss, with \\(C\\) and \\(\\delta_0\\) calibrated on held-out affine and nonlinear warp pairs. Pseudocode: sample \\(\\psi\\); compute \\(C=\\mathrm{CovHead}(f_\\theta(t,y))\\) and \\(C_\\psi=\\mathrm{CovHead}(f_\\theta(\\psi(t),y))\\); compute \\(C_{\\mathrm{target}}=U_\\psi C U_\\psi^*\\); compute \\(\\kappa_\\psi,S,\\delta_\\psi\\); backpropagate task loss plus \\(\\lambda[\\max(0,\\|C_\\psi-C_{\\mathrm{target}}\\|_{\\mathrm{HS}}-\\delta_\\psi)]^2\\). The theorem supplies the dependence on curvature and smoothing; the constant is estimated empirically. First test on a small 2-layer irregular-time transformer using synthetic Gaussian processes and PhysioNet, comparing no consistency loss, ordinary zero-target consistency, and this calibrated loss under affine, quadratic, and sinusoidal warps. Success means lower warped-test error and covariance/eigenspace discrepancy at equal clean-data accuracy, without the degradation caused by demanding exact invariance for high-curvature warps.",
 "math_summary": "The paper defines an increasing \\(C^{2,1}\\) diffeomorphism \\(\\psi:[0,1]\\to[0,1]\\), normalized curvature \\(\\kappa_\\psi=\\|\\psi''/\\psi'\\|_\\infty\\), and a unitary push-forward \\(U_\\psi\\) on \\(L^2\\), \\((U_\\psi f)(s)=f(\\psi^{-1}(s))\\sqrt{(\\psi^{-1})'(s)}\\). For a population covariance operator \\(\\mathcal C\\), coordinate change is exactly \\(\\mathcal C^{(\\psi)}=U_\\psi\\mathcal C U_\\psi^*\\). For a local-linear covariance estimator with covariance bandwidth \\(h\\), mean bandwidth \\(h_0\\), and effective local sample sizes \\(n_{\\mathrm{loc}}\\) and \\(n_{\\mathrm{loc},1}\\), the Hilbert-Schmidt equivariance defect is \\(O_P(\\kappa_\\psi S)\\), where \\(S=h^2+h n_{\\mathrm{loc}}^{-1/2}+h_0^2+h_0 n_{\\mathrm{loc},1}^{-1/2}\\). Exact commutation for every finite design holds if and only if \\(\\psi\\) is affine, so \\(\\kappa_\\psi=0\\) is the exact-equivariance boundary. In the neural loss, use \\(\\delta_\\psi=\\delta_0+C\\kappa_\\psi S\\), where \\(C\\) is calibrated empirically and \\(\\delta_0\\) accounts for discretization and numerical error.",
 "math_tags": [
  "geometry",
  "differential-geometry",
  "functional-analysis",
  "statistics"
 ],
 "ml_areas": [
  "transformer",
  "attention",
  "regularization",
  "training"
 ],
 "paper": {
  "arxiv_id": "2609.03042",
  "arxiv_url": "https://arxiv.org/abs/2609.03042",
  "summary_what_math_gives_to_ml": "The paper separates exact population-level coordinate invariance from the non-invariance introduced by finite-bandwidth statistical smoothing. Its transferable asset is a quantitative defect bound: affine reparameterizations commute exactly, while nonlinear warps produce an error proportional to normalized curvature and explicit bandwidth and sparsity terms. This supports curvature-aware consistency training for neural models processing irregular time series or continuous signals. Rather than imposing impossible exact invariance under every warp, the model can enforce a tolerance calibrated to the warp geometry and effective local sample size.",
  "title": "Equivariance, Curvature and Symmetry in Functional Covariance Estimation",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 5,
  "novelty": 6,
  "usefulness": 6
 },
 "solves": [
  "stability",
  "generalization",
  "accuracy"
 ],
 "title": "Curvature-Calibrated Reparameterization Consistency",
 "url": "https://synthcore.org/idea/3120/curvature-calibrated-reparameterization-consistency",
 "verification": {
  "peer_reviewed": false,
  "status": "unverified",
  "status_label": "Unverified",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)",
  "verification_axes": {
   "benchmark_mechanism": {
    "confirmed": null,
    "tested": false
   },
   "practical_benchmark": {
    "beats_baseline": null,
    "tested": false
   },
   "toy_mechanism_gate": {
    "confirmed": null,
    "tested": false
   }
  }
 }
}