✗ Mechanism failed 2026

Gaussian Barycentric Constraint Layer

Implementation & benchmark of arXiv:2607.08670 — Sharp bounds for stochastic proximal and projection estimators via radial dominance

Usefulness6/10
Difficulty4/10
Novelty5/10

Source paper: Sharp bounds for stochastic proximal and projection estimators via radial dominance arXiv:2607.08670 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Construct a differentiable approximate projection layer for a convex feasible set by averaging Gaussian perturbations conditioned on feasibility. Unlike hard projection or penalty methods, the output is smooth in the input and inherits firm nonexpansiveness in the convex case.

Formulas

$$p_{\delta}(x)=\mathbb{E}[Y\mid Y\in C],\qquad Y\sim\mathcal{N}(x,\delta I).$$
$$Dm_{\delta}(x;f)=\frac{1}{\delta\lambda}\operatorname{Cov}_{\sigma_{\delta}}(Y).$$
$$\left\|m_{\delta}(x_{1};f)-m_{\delta}(x_{2};f)\right\|^{2}\leq\left\langle m_{\delta}(x_{1};f)-m_{\delta}(x_{2};f),x_{1}-x_{2}\right\rangle\quad\text{for convex }f.$$
$$\widehat p_{\delta}(x)=\frac{\sum_{k=1}^{K}r_k y_k\mathbf 1\{y_k\in C\}}{\sum_{k=1}^{K}r_k\mathbf 1\{y_k\in C\}+\varepsilon},\qquad y_k=x+\sqrt{\delta}\epsilon_k,\quad r_k=1.$$

Mathematical statement

Let C be a closed convex subset of R^n and let Y~N(x,delta I). The stochastic projection estimator is p_delta(x)=E[Y | Y in C]. This is the indicator-energy case f=iota_C, where iota_C(y)=0 inside C and +infinity outside, so exponential reweighting becomes conditioning. With covariance delta lambda I, the Jacobian identity is Dm_delta(x;f)=Cov_sigma(Y)/(delta lambda). For convex f, the barycentric map is firmly nonexpansive: ||m_delta(x1;f)-m_delta(x2;f)||^2 <= <m_delta(x1;f)-m_delta(x2;f),x1-x2>. A finite-sample version draws y_k=x+sqrt(delta) epsilon_k and averages feasible samples; soft violation weights can be used when rejection is too sparse.

Implementation notes

Insert the layer after a neural network head whose output must satisfy a convex constraint, such as portfolio weights in a simplex, resource allocations in a box or polytope, bounded graph signals, or safe-control actions. For each input vector x, draw K reparameterized samples y_k=x+sqrt(delta) epsilon_k. Evaluate the exact feasibility predicate q_k=1{y_k in C} and return p_hat=sum_k q_k y_k/(sum_k q_k+epsilon). For boxes and simplices, implement predicates and reductions in vectorized GPU code. If feasible samples are rare, define a convex violation score v_C(y)>=0 and use soft weights w_k=exp(-v_C(y_k)/tau), returning sum_k w_k y_k/sum_k w_k; this is the paper's exponential barycenter with f=v_C and temperature tau. Use common random numbers for neighboring inputs in Jacobian diagnostics. Track constraint violations, feasible-sample rate, output variance, gradient norms, and the empirical Jacobian spectral norm. The paper supplies the conditional-mean construction, covariance Jacobian identity, and firm-nonexpansiveness target; acceptance probability and temperature are empirical choices. First test simplex-constrained regression on synthetic and tabular data with an MLP. Compare post-hoc clipping and renormalization, exact Euclidean simplex projection, and this stochastic layer using K in {8,16,32}. Match wall-clock budgets and evaluate prediction error, constraint satisfaction, robustness to noisy inputs, and training stability. Success means near-zero violations with smoother optimization than clipping and competitive error relative to exact projection.

Verification

Mechanism failed

Stage 1 · Toy mechanism gate: Failed ✗

Stage 2 · Mechanism transferred to benchmark: Not tested

Stage 2 · Practical benchmark result: Not run

Methodology: Toy-system gate first; the benchmark stage runs only after a pass. How verification works

Stage 1 — Mechanism check agent confidence 9/10

Built a vectorized Gaussian barycentric layer with hard rejection and soft violation weighting, plus a seeded simplex-regression comparison. The interval sanity check supported the claimed Jacobian identity (finite difference 0.4077 vs Cov/delta 0.4089) and firm nonexpansiveness (largest lhs-minus-rhs -0.0466). However, soft weighting improved MSE (0.00135 vs 0.00235 clipping) while substantially violating the simplex, and hard rejection had only 6.25% feasible samples, zero useful gradient, and poor MSE (0.245); the complete promised constrained-training effect was therefore not demonstrated.

Agent confidence
9/10
Baseline
Clip-renormalize: MSE 0.00235, max constraint violation 1.2e-7, training time 1.69s; exact simplex projection: MSE 0.00243, violation 1.2e-7, 1.90s.
Idea
Soft Gaussian barycenter: MSE 0.00135, max violation 0.171, training time 2.70s; hard Gaussian conditioning: MSE 0.245, feasible sample rate 6.25%, gradient norm 0.

Limitations: Only a tiny synthetic 3-simplex regression task was tested, with one seed and K=32 for the training comparison; K in {8,16,32}, multiple seeds, noisy-input robustness, Jacobian spectral norms, and larger polytopes were not evaluated. The hard simplex predicate used a sum tolerance and is not an exact simplex projection; finite-sample hard rejection is not differentiable through rejection and can have sparse or zero gradients.

How to run: python3 experiment.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Artifacts

Implementation overview ⬇ Download all as ZIP 3 files · code, reports and structured results