Architecture ideas

Attention variants, state-space and recurrent cells, normalization and token-mixing schemes — each tested against the standard block it replaces.

Unverified 2026

Repair-cost detector for incompatible similarity predictions

Use the paper's lower bound on nearest-correlation repair cost to detect when a neural network's pairwise similarity predictions contain too much globally incompatible off-diagonal energy. Instead of projecting every predicted matrix onto the correlation cone, train the network to reduce the repair-risk statistic or trigger expensive repair only when a cheap diagnostic predicts substantial distortion.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Correlation Matrices in High Dimensions: The Elliptope as a Sample-Correlation Ensemble arXiv:2608.04162
Unverified 2026

Topology-Guided Capacity Allocation

Use the layer at which persistent connected components and holes disappear to allocate capacity nonuniformly across a network. If representations simplify much earlier than desired, widen the responsible layers or insert an additional block; if simplification is excessively delayed, avoid spending parameters there. This turns persistent-homology COM into an actionable architecture-search signal rather than a post-hoc visualization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Topological Simplification in Predictive Coding Networks arXiv:2608.02816
Unverified 2026

Injective Boundary-Aware Disk Pooling

Replace fixed-radius image blur or pooling with disk averages whose radius is proportional to the distance from each pixel to the image boundary. Compute the transform at every spatial location and train a lightweight decoder to reconstruct the pre-transform feature map, using reconstruction error as an anti-collapse regularizer. This creates a scale-adaptive smoothing layer with an injectivity motivation in the continuum while providing larger context in the image interior.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Variable-Radius Disk Transforms and an Area-Integral Problem of Zalcman arXiv:2608.02546
Unverified 2026

Holonomy-preserving quad-mesh augmentation

Use the paper's explicit square insertion surgery to generate new quad-mesh examples with altered local valence patterns but unchanged genus, unchanged non-target vertices, and unchanged rotational-holonomy subgroup. Train a mesh GNN with consistency loss or label-preserving augmentation across the original and surgically modified meshes, forcing predictions to depend on global structure rather than accidental local tessellation.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Which Holonomy Signatures Are Realizable? A Complete Answer for Closed Surfaces arXiv:2608.01444
Unverified 2026

Contractive 9-Way Hierarchical Positional Encoding

Replace a large flat positional-embedding table with a recursively decoded nine-way address whose child transformations contract coordinates by exactly 1/3. Encode an input position using features attached to the address prefix at several depths, guaranteeing that increasing depth produces a geometrically localized representation and that an infinite valid address cannot ambiguously represent two distinct points. This is especially suitable for 2D vision tokens, maps, point clouds, or…

Useful5/10
Difficulty4/10
Novelty4/10
Paper: Hex9: A Quasi-Authalic, Quasi-Continuous Hexagonal DGGS on the Reference Ellipsoid arXiv:2608.00022
Unverified 2026

Gradient-Commutator Neural Dynamics

Build a continuous-time neural dynamics module from scalar potential networks and their iterated Lie brackets instead of directly predicting an unrestricted vector field. Gradient primitives provide structured vector fields, while commutators add non-conservative and rotational directions; the paper proves that finite spans of such objects generate every smooth vector field on the stated compact manifold.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: The Lie algebra generated by gradient vector fields arXiv:2607.26890
Unverified 2026

Central-Moment Feature Mixer

Replace raw polynomial interactions between neighboring feature vectors with central polynomial interactions computed after subtracting the local feature mean. Keep separate second-, third-, and fourth-order channels and apply independent residual gates to them, so a uniform shift of every feature in a neighborhood cannot create artificial cross-order responses. This is a drop-in higher-order mixer for a small transformer or graph neural network.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: Central-Hermite Sensing and Collision for Frame-Robust Order-Resolved Relaxation on D3Q125 arXiv:2607.23629
Unverified 2026

Orthogonal symmetric pair embedding

For every unordered pair of scalar features, construct invariant coordinates from the elementary symmetric quantities s=x+y and q=xy, then feed a truncated orthogonalized polynomial basis in (s,q) to the neural network. Estimate the basis by weighted Gram-Schmidt or Cholesky whitening under the paper's triangle weight, so polynomial channels have low redundancy and controlled scale instead of requiring an unconstrained MLP to learn both symmetry and decorrelation.

Useful5/10
Difficulty3/10
Novelty7/10
Paper: Symmetric Jacobi Polynomials on a Triangle and Their Spectral Algebra arXiv:2607.22751
Unverified 2026

Reach-Calibrated Topology Tokens

Add a finite-resolution geometric code to a 3D neural encoder: quantized lattice occupancy, local barycenters, and tangent directions are converted into structural tokens alongside ordinary point or mesh features. Choose lattice spacing from estimated local reach so that small perturbations do not change the code, and train the continuous encoder to agree with this discrete structural representation.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: A Geometric Finiteness Theory for Essential Surfaces in Knot Exteriors arXiv:2607.20844
Unverified 2026

Web-Constrained Product Flow

Add an invertible two-dimensional flow block whose Jacobian and coordinate outputs are explicitly regularized to preserve independence of several prescribed product distributions. Instead of estimating independence only from samples, enforce the change-of-variables functional equation for multiple density probes, encouraging the learned map to belong to a low-dimensional family of independence-preserving transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: The Independence-Preserving Property and Planar Web Geometry arXiv:2607.20646
Unverified 2026

Non-crossing d-arc sparse attention

Represent sequence positions as vertices on a circle and use a maximal family of mutually non-crossing d-arcs to define the allowed attention interactions. Rotate the family by d positions, or use several phase-shifted families across successive layers, so each layer has only O(N) edges but repeated layers propagate information over long distances. The geometric compatibility rule replaces arbitrary local-window or hand-designed sparse masks with a structured family whose maximality gives broad…

Useful5/10
Difficulty4/10
Novelty7/10
Paper: Higher cluster tilting objects in locally finite triangulated categories arXiv:2607.19916
Unverified 2026

Positive Grassmannian subset head

Replace independent logits for all d-subsets with a neural head that outputs a d-by-n matrix A and assigns subset weight x_I=det(A_{:,I}). After normalization, these minors define a probability distribution over subsets. The head imposes a strong algebraic coupling between subset probabilities, reducing parameters and potentially improving extrapolation to rarely observed subsets.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Maximum Likelihood Estimation on the Grassmannian of Lines arXiv:2607.19593
Unverified 2026

Projective Compact Prior for Latent Models

Use the calibrated compact-support maximum-entropy law as a latent prior or representation regularizer in a VAE or autoencoder. Unlike a Gaussian prior, it prevents latent codes from drifting arbitrarily far while retaining explicitly controlled mean and covariance.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Projective Maximum Entropy: Universality and Acceptance-Region Calibration arXiv:2607.16547
Unverified 2026

Polar-Gauge SPD Feature Layer

Replace a locally oriented three-channel feature frame by its positive-definite polar factor, removing arbitrary SO(3) basis rotations before the feature enters an MLP, attention block, or graph message-passing layer. Process the resulting SPD matrix in log coordinates so the downstream network receives a globally unconstrained symmetric representation rather than a gauge-dependent frame.

Useful5/10
Difficulty4/10
Novelty5/10
Paper: A Self-Dual Frame Formalism of the SO(3) Yang-Mills Theory arXiv:2607.14204
Unverified 2026

Jordan-Isometric Matrix Layer

Replace an unconstrained linear map on matrix-valued features by an exact operator-norm isometry assembled from parallel copies of X and its transpose. Contractive compression matrices and unitary basis changes allow a wider family than ordinary orthogonal layers, while a contractive remainder can increase output width without increasing the layer's spectral norm.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: Isometries between C$^*$-algebras with finite corank arXiv:2607.13367
Unverified 2026

Geometric observability gating

Build a graph diffusion or neural-operator encoder whose sparse-observation loss is weighted according to graph distance from the observed nodes. For early diffusion times, suppress supervision or cross-attention demands that are geometrically impossible because signals at distance \(d\) are attenuated like \(e^{-d^2/(2t)}\); gradually release those constraints as diffusion time grows.

Useful5/10
Difficulty4/10
Novelty6/10
Paper: Optimal geometric barriers for weighted observability of heat semigroups on metric measure spaces arXiv:2607.13279
Unverified 2026

Potential-Steered Observable Wave Layer

Replace homogeneous feature propagation with a discretized wave equation containing a positive, spatially varying learnable potential. The potential changes Hamiltonian trajectories so that feature energy reaches the layer's readout or sensor region instead of remaining in dynamically hidden modes. Train the potential jointly with the task objective and an empirical observability penalty.

Useful5/10
Difficulty6/10
Novelty8/10
Paper: Uniform controllability for the wave equation with large potential arXiv:2607.11702
Unverified 2026

Ground-State Fractional Attention

Replace or augment relative-position attention with a positive fractional-integration mixing kernel whose radial behavior has separate inner and outer power laws. Tokens close to one another interact through the usual fractional singularity, while tokens near different radial scales receive a ground-state correction that can improve multiscale information transport without introducing a dense learned positional table.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: Sharp Broken-Power Lorentz Estimates for Fractional Powers of Radial Schrödinger Operators with Inverse-Square Asymptotics arXiv:2607.11280
Unverified 2026

Bilinear-Form Structured Transition

Construct the latent transition from a nondegenerate bilinear form phi and a form-compatible operator instead of from an unconstrained dense matrix. The resulting SSM has an exact orthogonal or symplectic algebraic structure, reducing transition parameter redundancy and testing whether preservation of a latent pairing improves extrapolation on reversible, parity-sensitive, or Hamiltonian-like sequence tasks.

Useful5/10
Difficulty5/10
Novelty5/10
Paper: Based maps to Lagrangian Grassmannians, Quivers, and Bott Periodicity arXiv:2607.10956
Unverified 2026

Homoclinic Symbolic Reservoir

Construct a periodically driven hybrid recurrent state-space model whose vector field is piecewise smooth across learned switching surfaces. Engineer a transverse homoclinic intersection around a hyperbolic recurrent state; the resulting shift-like invariant set provides a controllable symbolic reservoir for sequence prediction and long-horizon generation.

Useful5/10
Difficulty7/10
Novelty7/10
Paper: Homoclinic Theorems for piecewise smooth vector fields arXiv:2607.09618
Unverified 2026

Subduction-Based Tangent Augmentation

Train a predictor on quotient-consistent tangent jets rather than only on transformed samples. Generate several local representatives of the same orbit, compute first-order feature perturbations, and aggregate them through a shared tangent module before prediction. This gives a structured alternative to treating augmented views as independent examples and can improve robustness to composed transformations.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Diffeological Riemannian orbifolds arXiv:2607.08939
Unverified 2026

Lattice-Laplace Polytope Attention

Replace or augment conventional dot-product attention with features generated by a convex polytope's lattice Laplace partition function. For a query-dependent point inside a learnable polytope, the log-partition gradient is the expected lattice direction under a Gibbs distribution, while its Hessian is a covariance matrix that supplies curvature-aware features.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Dual Lattice Functions of Polytopes arXiv:2607.08101
Unverified 2026

Rigidity-Calibrated Set Attention

Augment pairwise attention on a set of n tokens with a rigidity operator derived from normalized pairwise directions. The operator couples infinitesimal node displacements through changes in pairwise distances, while the complete-graph theorem provides a geometry-independent eigenvalue target n/2 after spherical centering and normalization.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: The Second Largest Eigenvalue of Stiffness Matrices of Normalized Complete Frameworks arXiv:2607.05472
Unverified 2026

Microscopic Boundary Pooling

Replace uniform set or point-cloud pooling with a microscopic weighting computed from pairwise feature-space distances. The resulting signed pooling vector should retain boundary and geometrically isolated points that ordinary mean pooling suppresses, potentially improving recognition when class information is concentrated on shape extremities or rare local configurations.

Useful5/10
Difficulty5/10
Novelty7/10
Paper: The microscopic weighting on a metric space arXiv:2607.05349