The OPTLP Procedure
The Interior Point Algorithm
The interior point algorithm in PROC OPTLP implements an infeasible primal-dual predictor-corrector interior point algorithm. To illustrate the algorithm and the concepts of duality and dual infeasibility, consider the following LP formulation (the primal):
The corresponding dual formulation is as follows:
where 
refers to the vector of dual variables and 
refers to the vector of dual slack variables.
The dual formulation makes an important contribution to the certificate of optimality for the primal formulation. The primal and dual constraints combined with complementarity conditions define the first-order optimality conditions, also known as KKT (Karush-Kuhn-Tucker) conditions, which can be stated as follows:
where 
of appropriate dimension and 
is the vector of primal slack variables.
Note: Slack variables (the s vector) are automatically introduced by the algorithm when necessary; it is therefore recommended that you not introduce any slack variables explicitly. This enables the algorithm to handle slack variables much more efficiently.
The letters 
and 
denote matrices with corresponding x, y, w, and s on the main diagonal and zero elsewhere, as in the following example:
If 
is a solution of the previously defined system of equations that represent the KKT conditions, then 
is also an optimal solution to the original LP model.
At each iteration the interior point algorithm solves a large, sparse system of linear equations,
where 
and 
denote the vector of search directions in the primal and dual spaces, respectively, and 
and 
constitute the vector of the right-hand sides.
The preceding system is known as the reduced KKT system. The interior point algorithm uses a preconditioned quasi-minimum residual algorithm to solve this system of equations efficiently.
An important feature of the interior point algorithm is that it takes full advantage of the sparsity in the constraint matrix, thereby enabling it to efficiently solve large-scale linear programs.
The interior point algorithm works simultaneously in the primal and dual spaces. It attains optimality when both primal and dual feasibility are achieved and when complementarity conditions hold. Therefore, it is of interest to observe the following four measures:
-
Relative primal infeasibility measure
: 
-
Relative dual infeasibility measure
: 
-
Relative duality gap
: 
-
Absolute complementarity
: 
where 
is the Euclidean norm of the vector v. These measures are displayed in the iteration log.