Graphical Models for Multivariate Count Data

arXiv:2608.11366 2026 Architecture 1 ideas extracted · analyzed Sep 1, 2026

What the math gives to ML

The paper provides graph-supported count distributions whose support and dependence structure are controlled by a decomposable graph, with explicit sampling and Bayesian posterior and predictive updates. The transferable asset is the ability to make a neural output distribution obey hard incompatibility constraints while retaining a normalized likelihood and graph-local factorization. A practical adaptation is a graph-constrained categorical or routing head in which neural logits define weights over independent sets and inference uses exact junction-tree variable elimination for low-treewidth graphs. This is useful when outputs must satisfy exclusion constraints, such as selecting mutually incompatible experts, graph actions, entities, or simultaneously active labels.

Ideas from this paper

Unverified 2026

Independent-Set Neural Output Head

Replace an unconstrained categorical or multilabel output head with a graph-supported distribution over feasible independent sets. Given neural logits, assign probability proportional to the exponential of the total logit of each selected vertex, so incompatible vertices can never be jointly active. Use exact junction-tree inference for decomposable graphs with small treewidth, and compare against post-hoc masking or penalty-based constraint enforcement.

Useful5/10
Difficulty6/10
Novelty6/10
Paper: Graphical Models for Multivariate Count Data arXiv:2608.11366