Multi-output BBL mass constraint
Implementation & benchmark of arXiv:2608.23963 — Borell--Brascamp--Lieb inequality with finitely many output functions
Source paper: Borell--Brascamp--Lieb inequality with finitely many output functions arXiv:2608.23963 ⓘ · analyzed Aug 29, 2026
AI-generated research hypothesis, automatically tested. Not peer-reviewed.
Idea description
Represent each of m neural branches by a positive input field f_i and a positive output field g_i, then penalize violations of the paper's multi-output Borell-Brascamp-Lieb bound at weighted barycenters. The constraint couples branches through both local normalized ratios and global mass ratios, encouraging calibrated multi-view predictions without requiring all output functions to be identical.
Formulas
Mathematical statement
Let lambda_i>0 with sum_i lambda_i=1, and define the barycenter z_lambda(x)=sum_i lambda_i x_i. For p not equal to zero, the weighted power mean is M_p^lambda(a_1,...,a_m)=(sum_i lambda_i a_i^p)^(1/p); for p=0 it is M_0^lambda(a)=product_i a_i^(lambda_i), and for p=-infinity it is min_i a_i. The main inequality states that for nonnegative integrable functions f_i,g_i on R^d with 0<||f_i||_1<infinity and p<=1/d, ess inf_x M_p^lambda(g_1(z_lambda(x))/f_1(x_1),...,g_m(z_lambda(x))/f_m(x_m)) is at most M_{Q_d(p)}^lambda(||g_1||_1/||f_1||_1,...,||g_m||_1/||f_m||_1), where Q_d(p)=p/(1-dp). Define r_i^(n)=g_i(z^(n))/f_i(x_i^(n)) and A_i=||g_i||_1/||f_i||_1. Replace the essential infimum by the soft minimum smin_tau(u_1,...,u_N)=-tau log sum_n exp(-u_n/tau). The practical penalty is max(0, smin_tau(M_p^lambda(r^(n)))-M_{Q_d(p)}^lambda(A))^2. Positivity and nonzero mass must be enforced separately because otherwise g_i=0 is a trivial solution.
Implementation notes
Integrate the constraint after the final positive prediction heads of a multi-view or multi-sensor model. For branch i, produce f_i(u)=softplus(F_i(u))+epsilon from its input representation and g_i(v)=softplus(G_i(v))+epsilon from its output representation, where epsilon is 1e-6. Sample N tuples (x_1^(n),...,x_m^(n)) from the branch coordinate grids, set z^(n)=sum_i lambda_i x_i^(n), and evaluate r_i^(n)=g_i(z^(n))/f_i(x_i^(n)). Estimate masses with Monte Carlo: ||f_i||_1 approximately equals B^(-1) sum_b f_i(x_i^b), and ||g_i||_1 approximately equals B^(-1) sum_b g_i(v_i^b). Compute q=Q_d(p)=p/(1-dp), then evaluate the right-hand power mean. Use logarithmic formulas for p=0 and clamp values before negative powers. Since the theorem uses an essential infimum, use smin_tau(u)=-tau log sum_n exp(-u_n/tau), with tau initially 0.2 times the median u and annealed toward 0.02 times the median. Add eta times L_BBL to the task loss. Prevent collapse by normalizing each predicted field to a fixed mass, or by adding a mass-matching penalty against a target estimated from labels. Use a detached sample pool or periodically refreshed hard-min samples to prevent the network from exploiting favorable samples. The theorem determines the inequality, valid p range, and exponent q; lambda, p, eta, tau, and sampling are empirical choices. First test a two-view MNIST or CIFAR-10 classifier with two positive confidence heads, comparing ordinary training against the penalty at equal FLOPs. Measure clean accuracy, accuracy under one-view corruption, calibration error, cross-view disagreement, and the lower quantile of normalized ratios. Success is improved corruption calibration or lower disagreement at unchanged clean accuracy without predicted-mass collapse.
Verification
Stage 1 · Toy mechanism gate: Failed ✗
Stage 2 · Mechanism transferred to benchmark: Not tested
Stage 2 · Practical benchmark result: Not run
Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works
Stage 1 — Mechanism check agent confidence 9/10
Built bbl_experiment.py with stable weighted power means, Q_d(p), soft-min BBL penalty, positive heads, Monte Carlo mass ratios, Gaussian equality verification, and a fixed-seed two-view classifier comparison. The Gaussian sanity check reproduced the claimed equality (minimum ratio 1.0 and RHS 1.0), but the practical penalty had a negative gap on every training step, zero penalty, and zero gradient. Baseline and idea were bit-identical: 99.50% clean accuracy, 88.06% corrupted accuracy, ECE 0.00518, and disagreement 0.0991; therefore no observed regularization or robustness win.
- Agent confidence
- 9/10
- Baseline
- clean_acc=0.9950, corrupt_acc=0.880625, ECE=0.005185, disagreement=0.099064, active_steps=0, max_penalty=0
- Idea
- clean_acc=0.9950, corrupt_acc=0.880625, ECE=0.005185, disagreement=0.099064, active_steps=0, max_penalty=0; Gaussian check min=1.0, RHS=1.0
Limitations: Only a small synthetic two-view binary classifier was tested, with one p=0 setting, fixed equal weights, approximate shared-sample mass estimates, and a single seed. No MNIST/CIFAR benchmark, hyperparameter sweep, multi-branch study, or comparison of alternative mass-normalization schemes was run.
How to run: python3 bbl_experiment.py
Verdict computed by deterministic test code from paired-seed statistics — not by the language model.
Artifacts
- bbl_experiment.py 4.8 KB View Raw
- report.md 1.4 KB View
- results.json 0.9 KB View Raw