research
∙
09/09/2023
A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning
The rapid progress in machine learning in recent years has been based on...
share
research
∙
08/17/2020
Whitening and second order optimization both destroy information about the dataset, and can make generalization impossible
Machine learning is predicated on the concept of generalization: a model...
research
∙
03/23/2020
Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses
Despite the fact that the loss functions of deep neural networks are hig...
research
∙
01/29/2019
