Last two pieces of the puzzle for unsolvability of a system of two quadratic (in)equalities

arXiv:2608.30571 2026 Regularization 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper turns exclusion of simultaneous zeros of two quadratic forms into a constructive positive-definite pencil certificate: for n >= 3, two homogeneous equations have no common nonzero solution exactly when some nontrivial linear combination of their matrices is positive definite. This gives neural networks a way to design pairs of quadratic feature constraints that cannot become jointly degenerate, rather than merely penalizing observed violations. The most direct transfer is a regularized quadratic feature block whose matrices are trained together with an explicitly optimized separating pencil and a spectral-margin loss. The guarantee is structural and applies to every hidden representation, while the engineering tradeoff is the cost of maintaining or estimating the smallest eigenvalue of the pencil.

Ideas from this paper

Unverified 2026

Positive-Definite Quadratic Feature Pair

Replace two unconstrained scalar quadratic feature heads with a pair whose quadratic forms admit a positive-definite linear combination. This prevents the two heads from simultaneously vanishing on any nonzero hidden vector, which can reduce representation collapse and improve the conditioning of downstream gates or auxiliary objectives. The constraint can be implemented softly with a spectral-margin penalty, or exactly by parameterizing one learned pencil as positive definite.

Useful5/10
Difficulty4/10
Novelty8/10
Paper: Last two pieces of the puzzle for unsolvability of a system of two quadratic (in)equalities arXiv:2608.30571