On systematicity of linear function-correcting codes

arXiv:2608.29389 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper turns task-aware robustness into a distance-design problem: messages that differ in the prescribed function value must be mapped to codewords that are far apart, while messages with the same function value need not be separated. The transferable object is the relative Hamming distance of a linear encoder with respect to the kernel of a task map, which gives a principled way to spend redundancy only on task-relevant directions rather than protecting every latent bit equally. A practical neural adaptation is a quantized latent or output head with systematic task-dependent parity/repetition coordinates, trained under bit noise and evaluated by task accuracy at a fixed redundancy budget.

Ideas from this paper

Unverified 2026

Function-Separating Latent Code

Add a task-aware error-protection code to a binary or low-cardinality latent representation. The encoder remains systematic, preserving the original latent coordinates, but appends repeated or parity coordinates computed from a linear task map so that latent states with different task values are separated by at least a chosen Hamming distance. Redundancy is allocated according to the rank of the task map rather than the full latent dimension.

Useful5/10
Difficulty5/10
Novelty6/10
Paper: On systematicity of linear function-correcting codes arXiv:2608.29389