Training ideas

Curricula, sampling schedules, pseudo-labeling and multi-task mixing, with the standard training recipe as the control.

Unverified 2026

Hebbian SDR Adapter for Streaming Context Learning

Attach a local BCM-trained binary adapter to a pretrained or frozen encoder, allowing new graph nodes or streaming examples to acquire representations without backpropagating through the main network. The adapter learns only from positive co-occurrence statistics and maintains sparse codes, providing a low-memory continual-learning path.

Useful6/10
Difficulty4/10
Novelty7/10
Paper: Columnar-Embedder: A Biologically Inspired Cortical Architecture for Binary Sparse Distributed Graph Representations arXiv:2608.20408
Unverified 2026

GW Geodesic Mixup

Generate relational training examples by first coupling two graphs or kernels and then interpolating every matched pair of node or edge attributes along a geodesic in Z. Unlike ordinary mixup, this preserves the intrinsic Gromov-Wasserstein correspondence and produces constant-speed paths in the relational metric when Z is geodesic.

Useful6/10
Difficulty5/10
Novelty6/10
Paper: Metric Geometry of Lebesgue, Wasserstein, and Gromov-Wasserstein Spaces: Submetries, Curvature, and Geodesics arXiv:2608.11680
Unverified 2026

Stiffness-energy supervision without FEM labels

Train a finite-element surrogate by minimizing the assembled discrete potential energy rather than a loss against solved displacement labels. The objective uses only the sparse stiffness matrix and load vector, while its exact energy-gap identity makes it equivalent to supervised regression in the stiffness norm.

Useful6/10
Difficulty3/10
Novelty5/10
Paper: Discrete energy as an exact label-free training objective for finite-element surrogates arXiv:2608.05437
Unverified 2026

Chromatic Collision-Free Pairwise Batches

Represent every pairwise training interaction as a directed edge and edge-color the interaction graph. Use one color class, or a small set of colors, as a microbatch: because a color class is a matching, no data example participates in two pairwise terms within that microbatch. This removes within-batch gradient collisions and provides a graph-dependent estimate of how many dependent strata are being combined.

Useful6/10
Difficulty5/10
Novelty7/10
Paper: Concentration Inequalities for Incomplete U-statistics over Arbitrary Sampling Graphs arXiv:2607.17048
Unverified 2026

Multivariate Structural Curriculum

Use a multivariate generating function to construct training examples or network variants with an exactly controlled amount of a structural attribute, such as graph branching, routing depth, skip connections, or the number of experts activated. Train by gradually changing the target coefficient slice instead of relying on an uncontrolled random curriculum.

Useful5/10
Difficulty5/10
Novelty8/10
Paper: Enumerating Chemical Structures, Stereoisomers, and Stereogenic Units with Analytic Combinatorics arXiv:2609.02932
Unverified 2026

Caveman-calibrated resolution schedule

Use the paper's analytic merging threshold to choose the Scaled-NAP exponent from an intended community size rather than treating alpha as an arbitrary hyperparameter. A warm-started schedule can begin with persistence-like fine structure and increase alpha only when the model has learned reliable local groups.

Useful5/10
Difficulty3/10
Novelty8/10
Paper: Scaled Null-Adjusted Persistence: A Multiscale Bridge between Modularity and Persistence arXiv:2608.30934
Unverified 2026

Path-and-cut separation layer

Turn the paper's valid inequalities into an online cutting-plane procedure that focuses computation on currently inconsistent graph relations. Instead of penalizing every possible path or separator, repeatedly find violated inequalities under the network's soft predictions and feed only the top violations back into training.

Useful5/10
Difficulty6/10
Novelty7/10
Paper: The canonical facets of multi-separator polytopes arXiv:2608.16861