Mechanism confirmed, baseline not beaten 2026

Entropy-calibrated hyperbolic curvature

Implementation & benchmark of arXiv:2609.02362 — Farthest-cell triplet entropy: high-dimensional shell limits and hyperbolic curvature amplification

Usefulness7/10
Difficulty6/10
Novelty7/10

Source paper: Farthest-cell triplet entropy: high-dimensional shell limits and hyperbolic curvature amplification arXiv:2609.02362 · analyzed Sep 3, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Use farthest-triplet entropy as a low-bandwidth observable of whether a hyperbolic embedding is angular- or radial-dominated, then adapt the hyperbolic curvature rather than fixing it arbitrarily. In the isotropic shell regime, invert the entropy-to-signal curve to estimate the effective radial/angular parameter and select curvature that reaches a chosen geometric operating point.

Formulas

$$\lambda_d=\sqrt d\,\frac{\operatorname{sd}(R_d)}{\mathbb{E}R_d}=\sqrt d\,\tau_d,$$
$$S_i(\lambda)=\lambda\xi_i-Z_i,\qquad H_\infty(\lambda;F)=\mathbb{E}\left[-\sum_{i=1}^{3}p_i(\lambda)\log p_i(\lambda)\right],$$
$$\lambda_{d,\mathbb H}=\sqrt d\,\tau_d A(s_d),\qquad s_d=\kappa_d\mathbb{E}R_d,\qquad A(s)=s\coth s,$$
$$\hat H\xrightarrow{H_\infty^{-1}}\hat\lambda,\qquad \hat\lambda=\sqrt d\,\hat\tau\,\hat s\coth(\hat s),\qquad \hat\kappa=\frac{\hat s}{\hat\mu_R}.$$

Mathematical statement

Let X_d=R_d U_d be an isotropic d-dimensional shell, with tau_d=sd(R_d)/E[R_d]. In the Euclidean high-dimensional approximation, farthest ordering is represented by scores S_i(lambda)=lambda xi_i-Z_i, where xi_i are approximately standard Gaussian angular fluctuations, Z_i are independent radial/noise variables, and lambda_d=sqrt(d) tau_d. Define H_infinity(lambda;F) as the expected entropy of the winning index among three independent scores, with F denoting the calibrated law of Z_i. In hyperbolic space of curvature -kappa_d^2, let s_d=kappa_d E[R_d] and A(s)=s coth(s). The paper gives the effective parameter lambda_d,H=sqrt(d) tau_d A(s_d). Therefore, after estimating observed entropy H_hat, invert the monotone master curve to obtain lambda_hat=H_infinity^{-1}(H_hat;F), then solve lambda_hat=sqrt(d) tau_hat s coth(s) for s and set kappa_hat=s/E_hat[R]. This is model-calibrated and should not be trusted under strong angular anisotropy.

Implementation notes

Integrate this as an outer-loop controller for a hyperbolic embedding model, such as a Poincare-ball encoder, hyperbolic prototypical classifier, or hyperbolic graph neural network. Every K optimizer steps, draw query embeddings z_b and three prototype embeddings, compute hard farthest labels using the hyperbolic distance, and estimate H_hat from empirical cell frequencies with Laplace smoothing. Estimate dimension d from the embedding width and estimate mu_hat_R and tau_hat=std(R)/mean(R) from current prototype or query radii; use exponential moving averages to suppress noise. Before training, numerically tabulate H_infinity(lambda;F) by Monte Carlo: sample three independent standard-normal angular variables xi_i and three independent radial variables Z_i from the chosen calibrated law F, select argmax_i(lambda xi_i-Z_i), and interpolate entropy over a grid of lambda. Invert the table only on a validated monotone interval. Solve g(s)=sqrt(d) tau_hat s coth(s)-lambda_hat=0 by bisection for s>=0, then update curvature toward kappa_hat=s/mu_hat_R using a slow EMA or optimize log(kappa). The mathematical quantities are the entropy statistic, master curve, and curvature amplification s coth(s); empirical estimates are H_hat, mu_hat_R, tau_hat, and anisotropy diagnostics. First test on synthetic isotropic tree-like data and MNIST or CIFAR-10 hyperbolic classification with fixed-curvature baselines, sweeping initial curvatures. Measure validation accuracy, calibration, hard farthest entropy, estimated-versus-true curvature, and training stability. Success is lower validation loss or better accuracy at equal dimension, convergence to the known synthetic curvature regime, and reduced sensitivity to initialization. Run a separate anisotropic-data test; degradation there is an expected falsifiable failure mode.

Verification

Mechanism confirmed, baseline not beaten

Stage 1 · Toy mechanism gate: Passed ✓

Stage 2 · Mechanism transferred to benchmark: Confirmed ✓

Stage 2 · Practical benchmark result: No measurable effect

Methodology: 8 paired seeds, permutation test (p<0.05) against a learning-rate-tuned baseline. How verification works

Stage 1 — Mechanism check agent confidence 7/10

Built a NumPy/SciPy MVP for the conditional farthest-triplet entropy master curve, monotone inversion, curvature amplification A(s)=s coth(s), and a slow EMA curvature controller. The core claim was numerically observed: entropy decreased strictly over the tested lambda grid (H(0)=1.0986, H(5)=0.2104), and the controller reduced mean absolute curvature error from 1.3667 for fixed initializations to 0.0204. Anisotropy produced inference errors up to 0.219, supporting the stated robustness limitation; the apparent controller win is synthetic and model-consistent rather than evidence from a trained neural embedding.

Agent confidence
7/10
Baseline
Fixed curvature at initial kappas [0.15, 1.0, 4.0]: mean absolute error to target kappa=1.3667.
Idea
Entropy-inverted curvature EMA: final kappas [0.7539, 0.7569, 0.8004] for target 0.75; mean absolute error=0.0204. Entropy curve decreasing fraction=1.0, with H(lambda=0)=1.0986 and H(lambda=5)=0.2104. Under anisotropic angular scales [1.0,2.0,0.5], inferred-lambda absolute errors were 0.092, 0.019, and 0.219 at true lambda [0.5,1.5,3.0].

Limitations: No trained Poincare-ball encoder, MNIST/CIFAR classification, validation accuracy, calibration, wall-clock comparison, or real hyperbolic-distance experiment was tested. The master curve assumes a standard-normal calibrated radial law and isotropic angular behavior; the controller target entropy is generated from the same assumed model, so the recovery result does not establish an end-to-end ML improvement.

How to run: python3 entropy_curvature.py

Stage 2 — Benchmark vs. tuned baseline (arXiv:2609.02362)

Ahead of the baseline (-0.0005 metric points) but not statistically significant (p=0.0551, wins 7 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
-0.0005 (n/a; negative = idea better)
Wins
7 / 8 paired seeds
p-value
0.0551 (permutation test, 20 000 shuffles)
Smallest detectable effect
±24.6%
Mechanism
Confirmed ✓
Practical effect
No effect
Baseline tuning
swept over 0 configs
Limitations:

Only the registered dynamics track was tested. The implementation uses a Poincare-like distance proxy and curvature-dependent radial regularization rather than a full Poincare-ball encoder and exact hyperbolic prototype classifier. The observed improvement narrowly missed the required p<0.05 significance threshold.

How to run: python3 bench_entropy_curvature.py

Verdict computed by deterministic test code from paired-seed statistics — not by the language model.

Stage 2 — Benchmark latest Failed ✗

Agent confidence: 9/10

The entropy-calibrated curvature intervention was tested on the registered dynamics track with the shared rnn_small architecture, 8 paired seeds, and a parity-preserving learning-rate sweep. It improved mean test MSE from 0.00182823 to 0.00141185 and won 7/8 pairs, but the permutation p-value was 0.05505, just above 0.05; therefore this is not a significant win.

Baseline
Best tuned fixed baseline lr=0.006, 12 epochs; mean test MSE=0.0018282315868418664.
Idea
Best entropy-curvature setting lr=0.006, 12 epochs; mean test MSE=0.0014118490216787905; paired delta=-0.0005000870587537065; 7/8 wins; p=0.05505.

Benchmark result

Ahead of the baseline (-0.0005 metric points) but not statistically significant (p=0.0551, wins 7 / 8 paired seeds).

Benchmark
Dynamics forecasting
Model
rnn_small
Paired seeds
8
Baseline mean
0
Idea mean
0
Effect (Δ)
-0.0005 (n/a; negative = idea better)
Wins
7 / 8 paired seeds
p-value
0.0551 (permutation test, 20 000 shuffles)
Smallest detectable effect
±24.6%
Mechanism
Confirmed ✓
Practical effect
No effect
Baseline tuning
swept over 0 configs
Limitations:

Only the registered dynamics track was tested. The implementation uses a Poincare-like distance proxy and curvature-dependent radial regularization rather than a full Poincare-ball encoder and exact hyperbolic prototype classifier. The observed improvement narrowly missed the required p<0.05 significance threshold.

How to run: python3 bench_entropy_curvature.py

Artifacts

Implementation overview ⬇ Download all as ZIP 6 files · code, reports and structured results