Deep Gaussian Processes on Directed Acyclic Graphs

arXiv:2607.09645 2026 Architecture 1 ideas extracted · analyzed Aug 30, 2026

What the math gives to ML

The paper turns compositional Gaussian processes from chains into branching computation graphs, with each node consuming the joint latent state of all of its parents. The transferable asset is not the GP prior alone, but the explicit factorization over a DAG and the resulting ability to preserve dependence between branches during approximate inference. A practical neural analogue is a Bayesian or probabilistic DAG network whose node-wise variational distributions condition on shared parent latents, rather than using independent uncertainty estimates for each branch. This is especially relevant to multi-fidelity models, graph neural networks, and world models containing colliders, where observing one child should update beliefs about multiple upstream causes.

Ideas from this paper

Unverified 2026

Collider-Aware DAG Variational Network

Replace independent uncertainty heads in a branching neural network with a structured variational posterior whose non-root node distributions condition on jointly sampled latent states of all parents. This allows collider evidence to explain away upstream uncertainty: evidence at a child can alter the posterior over several parent branches instead of leaving their uncertainties artificially independent. The approach can be implemented as a stochastic DAG network and trained with an evidence…

Useful6/10
Difficulty5/10
Novelty5/10
Paper: Deep Gaussian Processes on Directed Acyclic Graphs arXiv:2607.09645