HomeEventsSeminarsOthers 》 Content

Geometry and Local Recovery of Global Minima of Two-layer Neural Networks at Overparameterization

2024-07-09 13:13:28
报告人 时间 14:30-16:00
地点 E4-233 2024
月日 07-11

Time:2024年7月11日(星期四)14:30-16:00,Thursday July 11, 2024

Venue:E4-233, Yungu Campus


Host:Chuanhao Wei, ITS

Speaker:Tao Luo, Shanghai Jiao Tong University

Title:Geometry and Local Recovery of Global Minima of Two-layer Neural Networks at Overparameterization

Abstract: In this talk, we investigate the geometry of the loss landscape for two-layer neural networks in the vicinity of global minima. Utilizing novel techniques, we demonstrate: (i) how global minima with zero generalization error become geometrically separated from other global minima as the sample size grows; and (ii) the local convergence properties and rate of gradient flow dynamics. Our results indicate that two-layer neural networks can be locally recovered in the regime of overparameterization.