Information-Theoretic Adaptive Cooling for Deterministic MPPI via Entropy Feedback

arXiv:2607.14245 2026 Dynamics 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper offers a constructive feedback mechanism for controlling temperature in deterministic MPPI: use the Shannon entropy of normalized importance weights to detect whether sampling remains exploratory or has prematurely collapsed. Its transferable asset is an online entropy controller with a critical threshold that changes the cooling rate before effective sample size becomes too small. A direct neural-network transfer is a derivative-free population optimizer for model parameters, prompts, or architecture variables, where candidate losses generate importance weights and entropy controls the candidate distribution. The key falsifiable signature is a kink in the temperature-decay rate and a corresponding transition in effective sample size when normalized entropy crosses the chosen threshold.

Ideas from this paper

Mechanism confirmed, baseline not beaten 2026

Entropy-Feedback Zeroth-Order Cooling

Replace a fixed temperature schedule in a population-based, derivative-free neural-network optimizer with a feedback controller driven by the entropy of candidate importance weights. When candidate losses are diffuse, the optimizer cools rapidly to exploit progress; when one or a few candidates dominate, cooling slows to prevent irreversible population collapse and loss of exploration.

Useful7/10
Difficulty5/10
Novelty6/10
Paper: Information-Theoretic Adaptive Cooling for Deterministic MPPI via Entropy Feedback arXiv:2607.14245