Gradient Descent can be considered as one of the most important algorithms in machine learning and deep learning. It is widely used in training simple machine learning models to complex deep learning ...

GD_rates_live_script.mlx: Symbolic Matlab live script (~notebook) to check the algebraic manipulations for the upper bounds proofs gradient_descent_PEP.m: Solves the PEP on Gradient Descent for Smooth ...