Phase-windowed synchronization layer
Implementation & benchmark of arXiv:2607.21214 — A Kuramoto phase model to explore the synchronisation of a network of circadian clocks
Source paper: A Kuramoto phase model to explore the synchronisation of a network of circadian clocks arXiv:2607.21214 ⓘ · analyzed Aug 30, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Augment each recurrent channel, feature group, or state-space stream with a latent phase oscillator and allow cross-stream coupling only when the receiving oscillator lies inside a learned or fixed phase window. The window suppresses destructive mixing outside the relevant dynamical regime while retaining Kuramoto-style attraction during the active interval, potentially improving long-horizon coherence without forcing all hidden states to synchronize continuously.
Formulas
Mathematical statement
For oscillator phases \(\theta_i(t)\), intrinsic frequency \(\Omega_i\), population size \(N\), coupling strength \(K>0\), and phase gate \(\varphi(\theta)\in[0,1]\), use \(\dot{\theta}_i=\Omega_i+(K/N)\varphi(\theta_i)\sum_{j=1}^N\sin(\theta_j-\theta_i)\). The paper normalizes \(\Omega_i=1\) and uses \(K\in(0,1)\); because the averaged sine interaction is bounded in magnitude by one, this gives a positive phase velocity under the stated assumptions. The phase gate can be a hard interval \([a,b]\) modulo \(2\pi\), a smoothed sigmoid window, or a periodic bump. Define the Kuramoto order parameter \(r(t)=N^{-1}|\sum_i e^{\mathrm{i}\theta_i(t)}|\) and phase diameter \(D(t)=\max_i\theta_i(t)-\min_i\theta_i(t)\) after circular unwrapping. The synchronization result predicts \(D(t)\to0\) modulo \(2\pi\), equivalently \(r(t)\to1\), when the initial phases and coupling-window length satisfy the paper's basin conditions.
Implementation notes
1. Integration point: use this as a recurrent mixer inside a small GRU, vanilla RNN, or diagonal state-space model. Split the hidden state into \(N\) streams \(h_i\in\mathbb{R}^d\), and maintain one scalar phase \(\theta_i\) per stream. At each sequence step, update phases and use the resulting gated coupling to mix stream states or candidate updates. Keep the base hidden update unchanged initially so the experiment isolates the synchronization mechanism. 2. Pseudocode: compute \(s_c=N^{-1}\sum_j\cos\theta_j\) and \(s_s=N^{-1}\sum_j\sin\theta_j\). For each stream compute \(c_i=K\varphi(\theta_i)(s_s\cos\theta_i-s_c\sin\theta_i)\), the mean-field form of the pairwise sine interaction; update \(\theta_i\leftarrow\theta_i+\Delta t(\Omega_i+c_i)\); set \(g_i=\varphi(\theta_i)\); then use \(h_i'=h_i^{\mathrm{base}}+\alpha g_i(\bar h-h_i^{\mathrm{base}})\), where \(\bar h=N^{-1}\sum_jh_j^{\mathrm{base}}\). Parameterize \(K=\sigma(\kappa)\) to enforce \(0<K<1\), and use a smooth periodic gate to preserve gradients. 3. Computed from the paper: the phase dynamics, bounded-gate monotonicity condition, and order-parameter diagnostic. Estimated empirically: the window endpoints \(a,b\), smoothing width \(\tau\), hidden-state mixing coefficient \(\alpha\), and heterogeneous frequencies \(\Omega_i\). 4. First cheap experiment: train 8-stream vanilla RNNs on adding, copy-memory, and sequential-MNIST tasks, comparing ordinary mixing, always-on Kuramoto mixing, and phase-windowed mixing. Sweep \(K\in[0.1,1.3]\) and active-window fraction \(w=(b-a)/(2\pi)\in[0.1,1]\), recording \(r(t)\), circular phase diameter, gradient norm, and validation loss over long rollouts. The predicted signature is monotonic phase advance for every run with \(K<1\), a transition toward \(r\approx1\) only after the initial phase diameter lies inside the synchronization basin and \(w\) exceeds a critical value, and degradation or phase reversal near \(K=1\). Require the measured monotonicity boundary to occur within 20% of the theoretical \(K=1\) bound and test whether synchronized models have lower long-horizon error than baselines.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.