gradient_descent

gradient_descent, looks at minimization using the gradient descent method.

The notes:

• gradient_descent.pdf
• gradient_descent.tex

Scripts:

• ford_gradient2.py, use gradient descent to fit the Ford data.
• ford_scatter.py, make a scatter plot of the Ford data.
• gradient_descent1.py, use gradient descent for a function f(x) of a single variable.
• gradient_descent2.py, use gradient descent for a function f(x) of several variables.
• hex2_gradient2.py, use gradient descent to minimize a function hex2(x,y).
• quartic.py
• quartic_gradient1.py, use gradient descent to minimize a function quartic(x).
• sag.py
• sag_gradient1.py, use gradient descent to minimize a function sag(x).

Text files:

• ford_data.txt
• ford_gradent2.txt
• gradient_descent1_pseudocode.txt, for gradient descent for a function with one parameter.
• gradient_descent2_pseudocode.txt, for gradient descent for a function with several parameters.
• hex2_gradent2.txt
• moneyball_data.txt
• quartic_gradient1.txt
• sag_gradient1.txt

Images:

• ford_formula.png
• ford_scatter.png
• marble_drop.png
• quartic_minimizer.png
• quartic.png
• sag.png
• sag_minimizer.png