Quasi-newton optimizationCovers gradient line search methods and optimization techniques with an emphasis on Wolfe conditions and positive definiteness.
Optimization MethodsCovers optimization methods without constraints, including gradient and line search in the quadratic case.
Matrix CalculusCovers matrix calculus, including determinants, matrix inversion, and solutions to systems of linear equations.
Nonlinear OptimizationCovers line search, Newton's method, BFGS, and conjugate gradient in nonlinear optimization.
