Unverified
2026
For a neural model whose outputs lie on a d-dimensional analytic family in a very high-dimensional space, replace the full output vector by 2d+1 or a modestly oversampled number of fixed Gaussian scalar measurements. The paper's theorem predicts almost-sure injectivity in the noiseless setting, so an inverse network or decoder can recover the same latent instance without processing the full observation. Because the theorem does not provide a noise-stability constant, use M=4d+8 or M=8d in the…
Useful5/10
Difficulty4/10
Novelty5/10
Unverified
2026
Replace an unconstrained geometric multiscale codebook by features generated from a finite digit set and a Pisot scale factor. The contracting algebraic-conjugate directions should suppress near-collisions between representations at different scales, producing a discretely separated hierarchy that can be used for embeddings, recurrent memory, or quantized transformer states.
Useful5/10
Difficulty6/10
Novelty9/10
Unverified
2026
Replace a dense channel-mixing matrix in a sequence layer with alternating diagonal propagation and sparse unipotent Stokes jumps. The diagonal part carries independently controlled exponential phases, while the unipotent factors implement cheap residual-like mode conversion without changing determinant or requiring a dense matrix multiply. Constrain the phase magnitudes and jump coefficients during training to obtain a reversible, norm-monitorable mixer.
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use the paper's lower bound on nearest-correlation repair cost to detect when a neural network's pairwise similarity predictions contain too much globally incompatible off-diagonal energy. Instead of projecting every predicted matrix onto the correlation cone, train the network to reduce the repair-risk statistic or trigger expensive repair only when a cheap diagnostic predicts substantial distortion.
Useful5/10
Difficulty4/10
Novelty6/10
Unverified
2026
Replace an unconstrained recurrent or state-space transition with a complex-orthogonal flow generated by a skew-transpose matrix. The transition preserves a bilinear quadratic quantity exactly, preventing repeated application across long sequences from causing norm explosion or decay in the linear dynamics.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Replace a large flat positional-embedding table with a recursively decoded nine-way address whose child transformations contract coordinates by exactly 1/3. Encode an input position using features attached to the address prefix at several depths, guaranteeing that increasing depth produces a geometrically localized representation and that an infinite valid address cannot ambiguously represent two distinct points. This is especially suitable for 2D vision tokens, maps, point clouds, or…
Useful5/10
Difficulty4/10
Novelty4/10
Unverified
2026
Replace or augment LayerNorm on a hidden representation by a learned volume-preserving linear map that minimizes the representation cloud's spherical mean width relative to a volume proxy. The determinant constraint prevents trivial shrinking, so the module targets anisotropy and elongated activation clouds; the expected benefit is a tighter geometry that is easier to quantize or cover with a small codebook.
Useful5/10
Difficulty6/10
Novelty7/10
Unverified
2026
Replace coordinatewise rounding of activation or embedding vectors with nearest-point quantization in a learned full-rank lattice. Learn an affine transform that makes the empirical activation region more isotropic, while regularizing the lattice covering density so it does not become inefficient as dimension grows.
Useful5/10
Difficulty5/10
Novelty5/10
Unverified
2026
Train a linear adapter between two representation spaces so that it preserves not only feature values but also the relative sparsity of sampled directions in the source representation subspace. Penalize the logarithmic spread between the largest and smallest support-size expansion ratios, preventing the adapter from making some directions dense while collapsing others. This is useful for transferring sparse features between checkpoints, aligning sparse autoencoders, or inserting a…
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Represent sequence positions as vertices on a circle and use a maximal family of mutually non-crossing d-arcs to define the allowed attention interactions. Rotate the family by d positions, or use several phase-shifted families across successive layers, so each layer has only O(N) edges but repeated layers propagate information over long distances. The geometric compatibility rule replaces arbitrary local-window or hand-designed sparse masks with a structured family whose maximality gives broad…
Useful5/10
Difficulty4/10
Novelty7/10
Unverified
2026
Use the calibrated compact-support maximum-entropy law as a latent prior or representation regularizer in a VAE or autoencoder. Unlike a Gaussian prior, it prevents latent codes from drifting arbitrarily far while retaining explicitly controlled mean and covariance.
Useful5/10
Difficulty5/10
Novelty7/10
Unverified
2026
Add a bounded phase variable and a bank of local affine transport maps to an RNN or state-space model. The phase follows an irrational rotation, while the hidden state is transported through cells whose widths determine local gains, giving a controllable memory mechanism with analytically known distortion rather than an unconstrained recurrent Jacobian.
Useful5/10
Difficulty6/10
Novelty8/10
Unverified
2026
Represent a population of N circular latent states using a three-parameter Möbius transformation applied to fixed uniform reference phases, rather than learning N unrelated angles. The resulting states remain on the circle by construction and can model concentrated or nearly uniform phase populations through a single concentration parameter.
Useful5/10
Difficulty4/10
Novelty7/10