Constrained Optimization
Overall Course Objectives
When modelling a technical or economical problem it often happens that free parameters are determined by the solution to an optimization problem subject to some constraints on the solution. The simplest example is that the parameters must be positive or lie in certain intervals due to physical constraints in the underlying physical problem.
In this course the participant learns about efficient algorithms for constrained optimization. The student will be able both to develop algorithms and to use existing software for numerical solution of optimization problems with constraints. The course concerns numerical algorithms for linear programming (LP), convex quadratic programming (QP), convex optimization, and non-linear programming (NLP).
See course description in Danish
Learning Objectives
- derive and explain the KKT optimality conditions for constrained optimization
- use the KKT conditions to construct active set and interior point algorithms
- derive, implement and use interior-point algorithms for LP, QP and NLP problems
- derive, implement and use interior-point algorithms for convex optimization
- derive, implement and use active set and interior point algorithms for convex quadratic programming (QP) and linear programming (LP)
- explain the principles of the SQP algorithm for nonlinear, constrained optimization problems
- combine the LP and QP algorithms into an SQP algorithm
- develop, test and compare alternative optimization algorithms in Matlab for the solution of a given problem
- use existing Matlab software libraries for constrained optimization
- use optimization algorithms for the solution of problems from engineering and finance
- apply convex optimization
- apply optimization algorithms to numerically solve dynamic optimization problems and optimal control problems
Course Content
First and second order optimalitty conditions (KKT conditions. Active set and interior point algorithms for linear programming (LP) and convex quadratic programming (QP). Methods for nonlinear programming (NLP): Sequential quadratic programming (SQP) algorithms and augmented Lagrange algorithms. Development of simple numerical algorithms and use of existing software libraries for constrained optimization (LP, QP, NLP). Apply convex optimization (SOCP, SDP). Optimization of dynamic systems and optimal control. Application examples from Engineering and Finance.
Teaching Method
Lectures and project work.
Faculty
Remarks
The course may be followed by 02619 “Model Predictive Control”, and a master thesis project.