Signed de Bruijn parity memory
Implementation & benchmark of arXiv:2609.01399 — The Quadratic Easy Coefficients Conjecture via Finite-Type Shifts and Zeta Functions
Source paper: The Quadratic Easy Coefficients Conjecture via Finite-Type Shifts and Zeta Functions arXiv:2609.01399 ⓘ · analyzed Sep 2, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Augment an RNN or state-space model with a finite-state binary-context module whose transitions are those of a de Bruijn graph, while a signed transition channel records a quadratic parity function of the recent context. The exact finite-memory branch preserves cancellation-sensitive parity features that a continuous hidden state may forget, and a learned readout can combine it with the ordinary neural state.
Formulas
Mathematical statement
Let the memory order be M>=1, let the discrete context state be s=(s_1,...,s_M) in {0,1}^M, and let the next input bit be a in {0,1}. The de Bruijn transition is s'=(s_2,...,s_M,a). For a set of quadratic offsets T contained in {2,...,M+1}, define q_T(s,a)=[sum over t in T of u_{M+2-t}u_{M+1}]_2 modulo 2, where u=(s_1,...,s_M,a). The signed transfer matrix is B_{s,s'}=1{s'=shift(s,a)}(-1)^{q_T(s,a)}, while the unsigned matrix is D_{s,s'}=1{s'=shift(s,a)}. The paper's Fourier decomposition shows that an auxiliary parity coordinate produces the blocks D and B. For any finite matrix R, the zeta identity is zeta_R(z)=1/det(I-zR), and log zeta_R(z)=sum_{n>=1} tr(R^n)z^n/n, so eigenvalues and signed closed-walk counts govern long-run responses.
Implementation notes
Integration point: add a small exact automaton branch to an RNN or SSM before its nonlinear recurrent update. For binary or discretized inputs, maintain a one-hot context vector p_k in R^(2^M). For real inputs, begin with a straight-through threshold a_k=1{v^T x_k>0}; later replace it with a soft bit probability. At each step, compute the legal successor s'=(s_2,...,s_M,a), update p_{k+1}=P(a_k)p_k, compute the sign r_k(s)=(-1)^{q_T(s,a_k)}, and update the signed feature b_{k+1}=P(a_k)diag(r_k)b_k. Concatenate p_k or a learned low-dimensional projection of it with the ordinary hidden state h_k, then apply the standard neural update and train end-to-end. The exact transition and sign construction come from the paper; input binarization, projection, and neural readout are adaptations. Use sparse successor operations rather than dense matrices. First experiment: compare a vanilla GRU with a GRU-plus-parity-memory on synthetic length-256 sequences labeled by XORs of input pairs at offsets T, then test Copy Memory and permuted sequential-MNIST. Sweep M in {3,5,7}. The predicted signature is that parity-task accuracy remains nearly constant with sequence length up to the exact memory order, while the GRU baseline decays. The signed feature must equal the exact product of transition signs, with numerical error below 1e-6. Its empirical periodic response should also peak near phases associated with eigenvalues of B.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.