chevron-down--small
Simons Foundation chevron-down--small
Center for Computational Mathematics
CCM

Seminar and Problem Sessions on Mathematics of Deep Learning

This seminar and working session is held every Tuesday from 11 a.m.-12 p.m. ET. It is associated with the project on Mathematics for Deep Learning. The goal of each session is to present a topic and open research questions in this area. It will serve as a backbone for the formation of spontaneous working groups around some of these questions.

Each session is either a presentation of 40 minutes followed by a discussion of 20 minutes or two presentations of 20 minutes followed by discussions of 10 minutes each. The slides and a bibliography of few papers is provided.

Spring 2021 Schedule

DateSpeakerTitleSlides
January 19, 2021Francis BachTowards a quantitative analysis of gradient descent for infinitely wide two-layer neural networks
January 26, 2021Gerard Ben ArousSome naive open problems about optimization in high dimensions: how much data is needed to tame topological complexity and entropy with simple algorithms?
February 2, 2021Florent KrzakalaTeacher-student models: exactly solvable models for statistical learning
February 9, 2021Lenka ZdeborovaGradient-based algorithms in high-dimensions under limited sample complexity
February 16, 2021Stephane MallatHarmonic Analysis View of Deep Network ConcentrationTalk Slides
February 23, 2021Jianfeng LuTowards numerical analysis for solving high dimensional PDEs based on neural networks
March 2, 2021Risi KondorThe representation theory of equivariant neural networks and graph neural nets
March 9, 2021Eric DarvePhysics-informed machine learning: open mathematical questions
March 16, 2021Guillermo SapiroIs Deep Learning getting better?
March 23, 2021Spring Summit
March 30, 2021Grant RotskoffSampling with neural networks: prospects and perils
April 6, 2021Sebastian BubeckA law of robustness for two-layers neural networks
April 20, 2021Rong GeA Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network
April 27, 2021Rachel WardGeneralization bounds for sparse random feature expansions
May 4, 2021Julien MairalTrainable Algorithms for Inverse Imaging ProblemsTalk Slides
May 11, 2021Ohad ShamirElephant in the Room: Non-Smooth Non-Convex Optimization
May 18, 2021Bin YuDisentangled interpretations for deep learning with ACD
May 25, 2021Tom GoldsteinBreaking Machine Learning Systems at the Industrial Scale
June 1, 2021Leon BottouLearning Representations Using Causal Invariance
June 8, 2021Sanjeev AroraTrajectory, Trajectory, Trajectory Talk Slides
June 15, 2021Yi MaDeep (Convolution) Networks from First PrinciplesTalk Slides

Fall 2020 Schedule

DateSpeakerTitleSlides
November 10, 2020David Donoho (Stanford), Chair Stephane Mallat (CCM)Prevalence of Neural Collapse during the terminal phase of deep learning training
November 17, 2020Joan Bruna (Flatiron CCM, NYU), Chair TBAOn depth separation for neural networks
November 24, 2020Stefanie Jegelka (MIT), Chair Joan BrunaLearning in Graph Neural Networks
December 1, 2020Eric Vanden-Eijnden (NYU)
December 8, 2020Eero Simoncelli (Flatiron CCN, NYU), Chair Stephane MallatSolving Linear Inverse Problems Using the Prior Implicit in a DenoiserTalk Slides
December 15, 2020Lexing Ying (Stanford), Chair TBASolving Inverse Problems with Deep Learning
Advancing Research in Basic Science and MathematicsSubscribe to Flatiron Institute announcements and other foundation updates