Math Applications

Artificial intelligence is, at its core, applied mathematics. These math applications stands at the intersection of pure math and computer science, diving into the theoretical foundations of modern AI 📐. Explore complex research on gradient descent optimization, high-dimensional linear algebra, probabilistic reasoning, and the calculus of neural networks. From understanding the topology of deep learning models to the statistical theories explaining how massive language models generalize data, discover the mathematical proofs and equations that make artificial intelligence possible.

Statistical Inference via Sketched StoSQP: Online Second-Order Methods for Constrained Optimization.

Statistical Inference via Sketched StoSQP: Online Second-Order Methods for Constrained Optimization

Sen Na at Georgia Tech and Michael Mahoney at UC Berkeley prove that a sketched, adaptive Stochastic SQP method achieves asymptotic normality for constrained nonlinear stochastic optimization — the first online estimator that handles equality constraints without ever computing a…

Statistical Inference via Sketched StoSQP: Online Second-Order Methods for Constrained Optimization Read More »

The Blessing of Heterogeneity in Federated Q-Learning: Linear Speedup and Beyond.

The Blessing of Heterogeneity in Federated Q-Learning: Linear Speedup and Beyond

A team from Carnegie Mellon University flipped conventional wisdom on its head — proving that agents with different behavior policies don’t just tolerate each other’s differences, they actively benefit from them. And a novel importance-averaging scheme eliminates the last remaining…

The Blessing of Heterogeneity in Federated Q-Learning: Linear Speedup and Beyond Read More »

Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trick

Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trick

A team from Peking University and Georgia Tech has built a formal theory explaining why the most widely used GNN approach to multi-node tasks breaks down — and proved that a simple but principled labeling strategy solves the problem completely.

Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trick Read More »