{
 "artifacts": [
  {
   "name": "bench_report.json",
   "url": "https://synthcore.org/code/1138/bench_report.json"
  },
  {
   "name": "bench_stage2.py",
   "url": "https://synthcore.org/code/1138/bench_stage2.py"
  },
  {
   "name": "report.md",
   "url": "https://synthcore.org/code/1138/report.md"
  },
  {
   "name": "report_bench_2026-09-02T122613.md",
   "url": "https://synthcore.org/code/1138/report_bench_2026-09-02T122613.md"
  },
  {
   "name": "results.json",
   "url": "https://synthcore.org/code/1138/results.json"
  },
  {
   "name": "run_experiment.py",
   "url": "https://synthcore.org/code/1138/run_experiment.py"
  }
 ],
 "category": "dynamics",
 "description": "Replace an unconstrained recurrent transition by a ring-coupled cubic vector field whose radial component drives hidden states toward a prescribed sphere. The angular component remains trainable and can encode information, while the radial Lyapunov dynamics suppress exploding and vanishing state norms during long rollouts.",
 "download_zip": "https://synthcore.org/download/1138",
 "formulas_latex": [
  "$$Q_i(h)=q(h_i,h_{i+1}),\\qquad q(y,z)=ay^3+by^2z+cyz^2+dz^3,\\qquad \\dot h=\\lambda h+Q(h).$$",
  "$$\\dot V(h)=\\left\\langle h,\\lambda h+Q(h)\\right\\rangle=\\lambda r^2+r^4\\left\\langle u,Q(u)\\right\\rangle,\\qquad h=ru,\\quad \\lVert u\\rVert=1.$$",
  "$$\\left\\langle u,Q(u)\\right\\rangle=-\\kappa\\ \\Longrightarrow\\ \\dot r=\\lambda r-\\kappa r^3,\\qquad r_*=\\sqrt{\\lambda/\\kappa},\\qquad \\left.\\frac{d\\dot r}{dr}\\right|_{r_*}=-2\\lambda.$$",
  "$$P(u)=Q(u)-\\langle Q(u),u\\rangle u,\\qquad \\mu_{\\mathrm{pole}}=c+1;\\quad c=-1\\ \\text{is the predicted local tangential stability transition at }u=\\pm e_1.$$"
 ],
 "id": 2936,
 "implementation": "1. Integration point: use this as the hidden transition of an RNN or state-space layer. Partition a hidden vector into a cyclic ring, compute $Q_i=ah_i^3+bh_i^2h_{i+1}+ch_i h_{i+1}^2+dh_{i+1}^3$, and add input injection separately. Set $\\lambda\u003e0$ and initialize coefficients so the sampled radial form is negative. Use a sufficiently small solver step, or compare against an explicit projection to radius $r_*=\\sqrt{\\lambda/\\kappa}$. 2. Pseudocode: `u=h/(norm(h)+eps); Q=ring_cubic(h); hdot=lambda*h+Q+W_in*x_t; h=h+dt*hdot; loss=task_loss`. Add `radial_penalty=(mean(inner)+kappa)^2+variance(inner)`, where `inner=dot(u,Q(u))` over random unit-vector probes. Optionally parameterize $c$ around the predicted boundary $c=-1$. 3. Compute directly from the mechanism the cubic field, Lyapunov derivative, predicted radius, and pole eigenvalue. Estimate empirically the radial coefficient $\\kappa=-\\operatorname{mean}_{u\\sim S^{n-1}}\\langle u,Q(u)\\rangle$, its variance, the recurrent Jacobian spectral radius, and norm relaxation rate. 4. First experiment: compare equal-width vanilla tanh RNN, orthogonal RNN, and this invariant-sphere RNN on copy-memory and adding tasks at sequence lengths 100, 500, and 1000, using equal parameter counts and optimizer budgets. Include ablations removing the radial penalty and replacing cubic ring coupling by a dense transition. 5. Pre-register the signature: with zero input, the hidden norm should converge to $r_*$ and satisfy $|r_t-r_*|\\approx C\\exp(-2\\lambda t)$ in continuous-time units. Sweeping $c$ should change the pole-direction multiplier at $c=-1$. For Euler integration, the radial linearization predicts a step-size boundary near $dt_c\\approx 1/\\lambda$. Reject the transfer if the radial form is positive on more than 1 percent of sampled sphere directions, if the measured relaxation rate differs from $2\\lambda$ by more than 30 percent, or if norm variance is not reduced by at least 50 percent without improving long-horizon accuracy.",
 "math_summary": "Let $h\\in\\mathbb{R}^{n}$ be the recurrent state, $r=\\lVert h\\rVert$, and define the ring-coupled homogeneous cubic field $Q(h)$ by $Q_i(h)=q(h_i,h_{i+1})$, with cyclic indexing $h_{n+1}=h_1$ and $q(y,z)=ay^3+by^2z+cyz^2+dz^3$. The continuous recurrent dynamics are $\\dot h=\\lambda h+Q(h)$, where $\\lambda\u003e0$. If the cubic radial form satisfies $\\langle u,Q(u)\\rangle=-\\kappa$ for every unit vector $u$ or approximately satisfies this with bounded variation, then $V(h)=\\frac12\\lVert h\\rVert^2$ obeys $\\dot V=\\lambda r^2-\\kappa r^4$, giving the attracting radius $r_*=\\sqrt{\\lambda/\\kappa}$. More generally, if $\\langle u,Q(u)\\rangle\\leq-\\kappa_{\\min}\u003c0$ on the unit sphere, then sufficiently large states contract radially. At the pole $u=e_1$, the paper identifies a tangential eigenvalue proportional to $c+1$, so $c=-1$ is a local stability boundary that can be monitored as a trainable bifurcation parameter.",
 "math_tags": [
  "dynamical-systems",
  "bifurcations",
  "control-theory",
  "linear-algebra"
 ],
 "ml_areas": [
  "rnn",
  "ssm",
  "training-dynamics",
  "regularization"
 ],
 "paper": {
  "arxiv_id": "2608.28223",
  "arxiv_url": "https://arxiv.org/abs/2608.28223",
  "summary_what_math_gives_to_ml": "The paper provides a constructive mechanism for creating a globally attracting invariant sphere in ring-coupled cubic ODEs, followed by a symmetry-induced transition from heteroclinic networks to periodic orbits. The transferable asset is the radial/tangential decomposition: a cubic homogeneous interaction can make the state norm converge to a prescribed radius while leaving nontrivial angular dynamics for memory and computation. This suggests a norm-stabilized recurrent or state-space layer whose recurrent interaction is constrained to be radially dissipative and whose coefficient-dependent local eigenvalues provide a measurable bifurcation boundary. The transfer should first be tested on long-horizon sequence tasks, where norm drift and recurrent Jacobian growth can be measured directly.",
  "title": "Invariant Sphere Theorem and Ring-Coupled Systems",
  "year": "2026"
 },
 "ratings": {
  "difficulty": 5,
  "novelty": 7,
  "usefulness": 7
 },
 "solves": [
  "stability",
  "accuracy",
  "generalization"
 ],
 "title": "Invariant-Sphere Recurrent State",
 "url": "https://synthcore.org/idea/2936/invariant-sphere-recurrent-state",
 "verification": {
  "benchmark": {
   "track": "dynamics",
   "model": "rnn_small",
   "n_seeds": 8,
   "metric_direction": "lower is better",
   "comparison": {
    "baseline_mean": 0,
    "idea_mean": 0.000014861759154882748,
    "delta_mean": 0.000008376740851190334,
    "per_seed_diffs": [],
    "idea_wins": 0,
    "n_pairs": 8,
    "p_value": 0.0081,
    "mde": 0,
    "mde_rel_pct": null,
    "verdict": "idea worse (significant)",
    "system_worked": false
   },
   "baseline": {
    "best_cfg": {
     "epochs": 20,
     "lr": 0.01,
     "weight_decay": 0
    },
    "sweep": [
     {
      "cfg": null,
      "mean": 0.00010979082981066313
     },
     {
      "cfg": null,
      "mean": 0.0000123220872865204
     },
     {
      "cfg": null,
      "mean": 0.000005326571056230023
     }
    ],
    "full": {
     "mean": 0,
     "std": 0,
     "per_seed": null,
     "n": 0
    }
   },
   "idea": {
    "mean": 0.000014861759154882748,
    "std": 0.0000074365681821899514,
    "per_seed": [
     0.0000065364615693397354,
     0.000017686747014522552,
     0.00001725437687127851,
     0.000029500635719159618,
     0.000010894022125285119,
     0.000010834011845872737,
     0.000005783244432677748,
     0.000020404573660925962
    ],
    "n": 0
   },
   "mechanism_signature": {
    "confirmed": true,
    "predicted_radius_scalar": 1,
    "predicted_relaxation_rate": 2,
    "radial_coeff_mean": -0.0551277962513268,
    "radial_coeff_std": 0.006850266479887068,
    "trained_final_norm_mean": 0.7238094657659531,
    "trained_final_norm_std": 0.4153854250907898
   },
   "custom_track": null
  },
  "mechanism_confirmed": true,
  "peer_reviewed": false,
  "practical_verdict": "harms",
  "stage1_mechanism_check": {
   "worked": true,
   "confidence": 7,
   "verdict": "Built a ring-coupled cubic recurrent state and verified its stability numerically. The field had zero positive radial directions across 20,000 probes, drove initial norms spanning 0.66–17.92 to approximately 2.80–2.83, and the exact scalar case converged to radius 1 with measured relaxation slope -2.31 versus the predicted -2.0. In a small delayed-bit task, the sphere RNN achieved test MSE 0.00013 versus 0.152 for the tanh baseline, a promising but preliminary signal rather than a definitive general result.",
   "metrics": {
    "baseline": "tanh RNN: test MSE 0.151553; final hidden norm mean/std 1.16569/0.00737",
    "idea": "Invariant-sphere cubic RNN: test MSE 0.000130; final hidden norm mean/std 0.59144/0.00040; radial positive fraction 0/20000; multidimensional final-radius range 2.7975–2.8275; scalar relaxation slope -2.310"
   },
   "how_to_run": "python3 run_experiment.py",
   "files": [
    "run_experiment.py",
    "results.json"
   ],
   "limitations": "Only one seed and one short delayed-bit task were tested; no copy/addition benchmark at lengths 500–1000, equal-FLOP or equal-optimization studies, orthogonal-RNN baseline, radial-penalty ablation, dense-coupling ablation, Jacobian spectral measurements, or systematic c and step-size sweeps were performed. The multidimensional field has a direction-dependent radial coefficient rather than the ideal constant-kappa form."
  },
  "status": "mech_ok_no_baseline",
  "status_label": "Mechanism confirmed, baseline not beaten",
  "updated_at": "2026-09-02T12:30:10",
  "verdict_source": "deterministic test code (paired-seed permutation statistics)",
  "verification_axes": {
   "benchmark_mechanism": {
    "confirmed": true,
    "tested": true
   },
   "practical_benchmark": {
    "beats_baseline": false,
    "tested": true,
    "verdict": "harms"
   },
   "toy_mechanism_gate": {
    "confirmed": true,
    "tested": true
   }
  }
 }
}