Applications of Optimization in Machine Learning
A detailed guide to applications of optimization in machine learning. Covers key methods, mathematical significance, and real-world applications.
Mathematics Category
Optimization
21 articles
≈ 210 min total reading
Conjugate Gradient Methods
A detailed guide to conjugate gradient methods. Covers key methods, mathematical significance, and real-world applications.
Constrained Optimization: Active Set and Penalty Methods
A detailed guide to constrained optimization: active set and penalty methods. Covers key methods, mathematical significance, and real-world applications.
Convex Optimization: Theory and Applications
A detailed guide to convex optimization: theory and applications. Covers key methods, mathematical significance, and real-world applications.
Convex Sets and Convex Functions
A detailed guide to convex sets and convex functions. Covers key methods, mathematical significance, and real-world applications.
Duality Theory: Lagrangian and Fenchel Duality
A detailed guide to duality theory: lagrangian and fenchel duality. Covers key methods, mathematical significance, and real-world applications.
Gradient Descent: Analysis and Convergence
A detailed guide to gradient descent: analysis and convergence. Covers key methods, mathematical significance, and real-world applications.
Integer Programming: Cutting Planes and Branch-and-Bound
A detailed guide to integer programming: cutting planes and branch-and-bound. Covers key methods, mathematical significance, and real-world applications.
Karush-Kuhn-Tucker Conditions
A detailed guide to karush-kuhn-tucker conditions. Covers key methods, mathematical significance, and real-world applications.
Linear Programming: Standard Form and Geometry
A detailed guide to linear programming: standard form and geometry. Covers key methods, mathematical significance, and real-world applications.
Mathematical Optimization
A detailed guide to mathematical optimization. Covers key methods, mathematical significance, and real-world applications.
Multiobjective Optimization and Pareto Optimality
A detailed guide to multiobjective optimization and pareto optimality. Covers key methods, mathematical significance, and real-world applications.
Newton's Method and Quasi-Newton Methods
A detailed guide to newton's method and quasi-newton methods. Covers key methods, mathematical significance, and real-world applications.
Nonconvex Optimization and Global Methods
A detailed guide to nonconvex optimization and global methods. Covers key methods, mathematical significance, and real-world applications.
Optimality Conditions and Sensitivity Analysis
A detailed guide to optimality conditions and sensitivity analysis. Covers key methods, mathematical significance, and real-world applications.
Optimization Problems: Formulation and Classification
A detailed guide to optimization problems: formulation and classification. Covers key methods, mathematical significance, and real-world applications.
Proximal Methods and Operator Splitting
A detailed guide to proximal methods and operator splitting. Covers key methods, mathematical significance, and real-world applications.
Quadratic Programming
A detailed guide to quadratic programming. Covers key methods, mathematical significance, and real-world applications.
Semidefinite Programming
A detailed guide to semidefinite programming. Covers key methods, mathematical significance, and real-world applications.
Stochastic Gradient Descent and Large-Scale Optimization
A detailed guide to stochastic gradient descent and large-scale optimization. Covers key methods, mathematical significance, and real-world applications.
The Simplex Method: Implementation and Analysis
A detailed guide to the simplex method: implementation and analysis. Covers key methods, mathematical significance, and real-world applications.