User Tools

Site Tools


Optimization Reading Group

Caretaker: Surbhi Goel

Resources: Doc for Papers/Open Problems, Spreadsheet for Scheduling

Venue: Room 116

Time: 1:00pm - 2:15pm

For questions/comments/suggestions send an email to surbhi 'at' cs 'dot' texas 'dot' edu with subject “Simons:Optimization”.



Presenter: Surbhi Goel

Topic: Generalized Linear Models Overview and Applications to Neural Networks

Links: Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression (GLMtron), Learning One Convolutional Filter with Overlapping Patches, Lecture Notes by Varun Kanade

06/12/19 ICML Week

Presenter: Frederic Koehler

Topic: Burer-Monteiro

Links: A Nonlinear Programming Algorithm for Solving Semidefinite Programs via Low-rank Factorization, Notes by Fred


Presenter: Quanquan Gu

Topic: Optimization for overparameterized DNNs

Links: A Convergence Theory for Deep Learning via Over-Parameterization, Gradient Descent Finds Global Minima of Deep Neural Networks, Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks, An Improved Analysis of Training Over-parameterized Deep Neural Networks

06/24/19 STOC/COLT Week

Presenter: Colin Wei

Topic: Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel

Links: Paper


Presenter: Mahdi Soltanolkotabi

Topic: Gradient Dynamics of Shallow Univariate ReLU Networks

Links: Paper


Presenter: Qi Lei

Topic: Minmax Optimization

Links: TRAINING GANS WITH OPTIMISM, The Limit Points of (Optimistic) Gradient Descent in Min-Max Optimization, Last-Iterate Convergence: Zero-Sum Games and Constrained Min-Max Optimization, On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems

07/15/19 Workshop Week


Presenter: Vatsal Shah

Topic: Gradient Descent Maximizes the Margin of Homogeneous Neural Networks

Links: Paper


Presenter: Suriya Gunasekar

Topic: On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport

Links: Paper

08/05/19 Workshop Week

optimization.txt · Last modified: 2019/07/28 21:28 by surbhi