Unverified 2026

Information-budgeted replication and dictionary refinement

Implementation & benchmark of arXiv:2607.16813 — Honest Physical-Support Inference after Latent Dictionary Learning: Collision Singularities and Minimax Resolution

Usefulness6/10
Difficulty4/10
Novelty8/10

Source paper: Honest Physical-Support Inference after Latent Dictionary Learning: Collision Singularities and Minimax Resolution arXiv:2607.16813 ⓘ · analyzed Aug 30, 2026

AI-generated research hypothesis, automatically tested. Not peer-reviewed.

Idea description

Use the paper’s sharply different scaling laws to decide whether additional data should be spent on more test-time views or on retraining and refining the dictionary. Extra test replication is useful for separating active coordinates, but cannot overcome unresolved dictionary orientation when Ns⁶ remains small.

Formulas

$$I_S=\frac{T\beta_-^{2}s^{2}}{\sigma_+^{2}},\qquad I_D=Ns^{6}$$
$$T_{\mathrm{needed}}\ge\frac{\tau_S\sigma_+^2}{\beta_-^2s^2},\qquad N_{\mathrm{needed}}\ge\frac{\tau_D}{s^6}$$
$$r_{\mathrm{minimax}}\asymp s\wedge\frac{1}{\sqrt{N}\,s^{2}}$$
$$\text{action}=\begin{cases}\text{increase }T,&I_S<\tau_S,\\\text{increase }N\text{ or diversify dictionary training},&I_S\ge\tau_S\text{ and }I_D<\tau_D,\\\text{attempt child-level prediction},&I_S\ge\tau_S\text{ and }I_D\ge\tau_D.\end{cases}$$

Mathematical statement

The two relevant information budgets are I_S=Tβ_-²s²/σ_+² for test-time support separation and I_D=Ns⁶ for learning residual orientation of a coherent dictionary block. Here T is the number of independent test views, N is the dictionary-training sample count, s is within-block ray separation, β_- lower-bounds active coefficient magnitude, and σ_+ upper-bounds noise. The regime distinction implies an allocation rule: if I_S<τ_S, acquire more test views; if I_S≥τ_S but I_D<τ_D, additional test views have diminishing value for physical child identification and the dictionary must be refined with more diverse training samples. The corresponding minimax resolved-support scale is s∧(√N s²)^−1, so orientation error improves only as N^−1/2s^−2 once the collision shell is fixed.

Implementation notes

Attach an adaptive data-acquisition controller to a multi-view encoder, sparse autoencoder, or retrieval/router system. At each inference step, maintain a dictionary trained on N examples and collect views or augmentations sequentially. Estimate s_g for each coherent block, β_- from the current active coefficient magnitude, and σ_+ from residual variance or a robust median absolute deviation. Compute I_{S,g}(T)=Tβ_-²s_g²/σ_+² and I_{D,g}=Ns_g⁶. Pseudocode: initialize T=1; encode the current views and estimate block confidence; while required confidence is unmet, if I_{S,g}<τ_S request another independent view or augmentation and increment T, else if I_{D,g}<τ_D mark the block child-ambiguous and queue samples for dictionary retraining, else expose child predictions and stop. For offline training, prioritize new dictionary examples from blocks with the smallest N_gs_g⁶, and use multiple coefficient patterns and noise conditions so orientation is not learned from a degenerate latent distribution. The mathematical quantities are the two information scalings and minimax resolution expression; thresholds, view independence, and estimates of β_- and σ_+ must be validated empirically. First experiment on a synthetic two-atom collision with controlled s, Gaussian noise, and a fixed compute budget. Compare fixed-T and fixed-N baselines against the controller, measuring child-support accuracy, parent recall, number of views, and dictionary retraining cost. The predicted signal is that increasing T helps until I_S≈τ_S, after which only increasing N materially improves physical-ray accuracy, especially for small s where the s⁶ bottleneck is severe.

Verification

This idea has not been verified yet.

Verification happens in two stages: Stage 1 — a mechanism check on a toy system confirms the claimed mathematical phenomenon reproduces; Stage 2 — a benchmark implements the idea on a real (small) neural network task and compares it against a tuned baseline over 8 paired seeds with a permutation test.

Artifacts

Artifacts unavailable.