Discrete Hardy Barrier for 3D Feature Fields
Implementation & benchmark of arXiv:2608.25262 — The sharp discrete Hardy inequality on $\Z^3$
Source paper: The sharp discrete Hardy inequality on $\Z^3$ arXiv:2608.25262 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Apply the sharp lattice Hardy inequality to intermediate feature maps defined on a 3D voxel grid. Penalize feature configurations whose inverse-square-weighted energy around a designated anchor is too large relative to their nearest-neighbor gradient energy, discouraging isolated activation spikes near the anchor while retaining smooth spatial structure.
Formulas
Mathematical statement
The paper proves that for every finitely supported function u from Z^3 to C, with e_j the j-th standard basis vector, the discrete Dirichlet energy E(u) = sum over x and j of |u(x+e_j)-u(x)|^2 satisfies E(u) >= (1/4) W(u), where W(u) = sum over nonzero x of |u(x)|^2 divided by |x|^2, and |x|^2 = x_1^2+x_2^2+x_3^2. The coefficient 1/4 is sharp, and equality is not attained by a nonzero finitely supported function. For a finite voxel tensor, translate coordinates so that the selected anchor is a, use r_x^2 = ||x-a||_2^2 + epsilon^2, and define E and W over valid nearest-neighbor voxel edges. The theorem motivates the nonnegative violation penalty max(0, W-4E). On an exact cubic lattice with compatible zero boundary conditions this hinge may be inactive, so a practical anti-concentration version can instead penalize a clipped ratio W/(E+delta).
Implementation notes
(1) Integration point: choose an intermediate 3D CNN feature tensor F with shape B by C by D by H by W, preferably after two or three convolutional blocks and before global pooling. Select an anchor voxel a from the object center, sensor position, lesion center, or geometric crop center. Compute the penalty independently for each batch item and average over channels and examples.
(2) Pseudocode:
input F, anchor a, eps, delta
E = 0; W = 0
for every voxel x:
W += sum_c F[:,c,x]^2 / (||x-a||_2^2 + eps^2)
for every positive-direction edge (x, x+e_j):
E += sum_c (F[:,c,x+e_j] - F[:,c,x])^2
E = mean_over_batch(E)
W = mean_over_batch(W)
R = relu(W - 4*E) / (W + 4*E + delta)
loss = task_loss + lambda_h * R
Use only positive-direction neighbors so each undirected edge is counted once, matching the paper. Computed from the mathematics are the inverse-square weights and the sharp comparison coefficient 4, the reciprocal of the Hardy constant 1/4. Estimated empirically are the anchor, epsilon, lambda_h, and an appropriate target ratio. Log W/E, maximum activation within radius two of the anchor, and feature-gradient norms. For the first cheap experiment, train a small 3D U-Net or 3D ResNet on synthetic voxel spheres and cubes with injected single-voxel impulse noise near the anchor. Compare ordinary weight decay against lambda_h in {1e-4, 1e-3, 1e-2}, using matched training steps and FLOPs. Measure clean accuracy, corrupted accuracy, peak activation, W/E, and exploding-gradient frequency. A positive result is reduced peak activation and improved impulse-noise robustness with less than one percent clean-accuracy loss. If the exact hinge is almost always zero, replace it with max(0, W/(E+delta)-tau) and tune tau from clean-training statistics.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.