Deep Gaussian Processes on Directed Acyclic Graphs
arXiv:2607.09645
2026
Architecture
1 ideas extracted · analyzed Aug 30, 2026
What the math gives to ML
The paper turns compositional Gaussian processes from chains into branching computation graphs, with each node consuming the joint latent state of all of its parents. The transferable asset is not the GP prior alone, but the explicit factorization over a DAG and the resulting ability to preserve dependence between branches during approximate inference. A practical neural analogue is a Bayesian or probabilistic DAG network whose node-wise variational distributions condition on shared parent latents, rather than using independent uncertainty estimates for each branch. This is especially relevant to multi-fidelity models, graph neural networks, and world models containing colliders, where observing one child should update beliefs about multiple upstream causes.
Ideas from this paper
Unverified
2026
Replace independent uncertainty heads in a branching neural network with a structured variational posterior whose non-root node distributions condition on jointly sampled latent states of all parents. This allows collider evidence to explain away upstream uncertainty: evidence at a child can alter the posterior over several parent branches instead of leaving their uncertainties artificially independent. The approach can be implemented as a stochastic DAG network and trained with an evidence…
Useful6/10
Difficulty5/10
Novelty5/10