ML: Distributed

Machine-learning ideas tagged Distributed in the ML taxonomy of the Math2NN corpus.

2 ideas found

Solves: Scalability ML: Distributed Clear all

✗ Mechanism failed 2026

Two-level local/coarse GNN training

Partition a large graph into induced subgraphs and perform most parameter updates using only local subgraphs, interleaving them with inexpensive global updates on a randomly subsampled coarse graph. The coarse correction preserves information about cross-partition dependencies while reducing full-graph message passing and communication cost.

Useful8/10

Difficulty5/10

Novelty6/10

Training Speedup Scalability Memory

Paper: Two-level domain-decomposition AdaGrad method for scalable training of graph neural networks arXiv:2608.22575

Unverified 2026

Noise-Aware Soft ECOC Decoding

Treat the binary outputs of the hyperplane head as a noisy channel and decode with reliability-weighted likelihood rather than unweighted Hamming distance. Estimate each bit's flip probability on validation data and give unreliable hyperplanes less influence, while retaining the logarithmic code-length scaling.

Useful6/10

Difficulty3/10

Novelty6/10

Architecture Accuracy Stability Scalability

Paper: Fundamental limits of distributed multiclass classification from simple binary decisions arXiv:2607.19334