High-Dimensional Non-Convex Landscapes and Gradient Descent Dynamics
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:XRS63NNCrecord.jsonopen to challenge →
classification
cond-mat.dis-nn
cond-mat.stat-mech
keywords
dynamicshigh-dimensionalphysicsdescentdevelopedgradientlandscapesnon-convex
read the original abstract
In these lecture notes we present different methods and concepts developed in statistical physics to analyze gradient descent dynamics in high-dimensional non-convex landscapes. Our aim is to show how approaches developed in physics, mainly statistical physics of disordered systems, can be used to tackle open questions on high-dimensional dynamics in Machine Learning.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.