Dimension-aware power-mean fusion
Implementation & benchmark of arXiv:2608.23963 — Borell--Brascamp--Lieb inequality with finitely many output functions
Source paper: Borell--Brascamp--Lieb inequality with finitely many output functions arXiv:2608.23963 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Use the paper's dimension-dependent exponent transformation to fuse nonnegative outputs from several branches. Instead of selecting an arbitrary generalized-mean exponent, choose the output exponent q=Q_d(p) induced by an input exponent p, making the fusion rule explicitly sensitive to the dimension of the barycentric variables.
Formulas
Mathematical statement
For positive weights lambda_i summing to one and nonnegative branch values a_i, define the weighted power mean M_q^lambda(a)=(sum_i lambda_i a_i^q)^(1/q), with the geometric mean at q=0 and the minimum at q=-infinity. The paper maps an input exponent p to Q_d(p)=p/(1-dp), where d is the dimension of the variables combined by the barycenter and p<=1/d. Define the neural fusion operator F_{p,d}(a)=M_{Q_d(p)}^lambda(a). At p=0, Q_d(0)=0 and fusion is geometric. As p approaches 1/d from below, Q_d(p) approaches positive infinity and fusion approaches a weighted maximum. Negative p emphasizes weak branches and approaches a minimum as p approaches negative infinity. The rigorous BBL guarantee applies when a_i arise from ratios of integrable functions evaluated at barycentric inputs; using the operator directly on features is a testable architectural heuristic rather than an automatic theorem.
Implementation notes
Modify a multi-branch fusion point such as multi-sensor feature fusion, confidence aggregation, or an MoE gate when every branch emits a nonnegative scalar or channel-wise activation. Set a_i=softplus(h_i)+epsilon, use fixed convex weights lambda_i or obtain them from a softmax router, and compute y=F_{p,d}(a_1,...,a_m). For a chosen dimension d and exponent p<1/d, calculate q=p/(1-dp), then compute y=(sum_i lambda_i a_i^q)^(1/q). Use y=exp(sum_i lambda_i log(a_i)) when absolute q is below 1e-4. For large positive q, evaluate in the log domain using log-sum-exp; for negative q, clamp a_i to epsilon. A learnable version can parameterize p=(1/d-epsilon)tanh(s), where s is a scalar or per-layer parameter, and add a weak penalty encouraging s near zero. The paper supplies the exponent map and endpoint behavior; the experiment must determine whether the effective dimension should be one, the spatial dimension, or the feature dimension. First compare arithmetic mean, geometric mean, fixed quadratic mean, minimum, and F_{p,d} in a two-sensor CIFAR-10 classifier and a small segmentation network with one randomly corrupted sensor. Sweep p in {-1,-0.25,0,0.1,0.25} for d=1 and d=2. Record clean accuracy, corrupted-sensor accuracy, gradient variance across branches, and sensitivity to branch dropout. Success is higher robustness or lower gradient imbalance at matched parameter count and FLOPs.
Verification
This idea has not been verified yet.
Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.
Artifacts
Artifacts unavailable.