VARMAX Procedure

VARMAX Model

The vector autoregressive moving-average model with exogenous variables is called the VARMAX(p,q,s) model. The form of the model can be written as

StartLayout 1st Row  bold y Subscript t Baseline equals sigma-summation Underscript i equals 1 Overscript p Endscripts normal upper Phi Subscript i Baseline bold y Subscript t minus i Baseline plus sigma-summation Underscript i equals 0 Overscript s Endscripts normal upper Theta Subscript i Superscript asterisk Baseline bold x Subscript t minus i Baseline plus bold-italic epsilon Subscript t Baseline minus sigma-summation Underscript i equals 1 Overscript q Endscripts normal upper Theta Subscript i Baseline bold-italic epsilon Subscript t minus i EndLayout

where the output variables of interest, bold y Subscript t Baseline equals left-parenthesis y Subscript 1 t Baseline comma ellipsis comma y Subscript k t Baseline right-parenthesis prime, can be influenced by other input variables, bold x Subscript t Baseline equals left-parenthesis x Subscript 1 t Baseline comma ellipsis comma x Subscript r t Baseline right-parenthesis prime, which are determined outside of the system of interest. The variables bold y Subscript t are referred to as dependent, response, or endogenous variables, and the variables bold x Subscript t are referred to as independent, input, predictor, regressor, or exogenous variables. The unobserved noise variables, bold-italic epsilon Subscript t Baseline equals left-parenthesis epsilon Subscript 1 t Baseline comma ellipsis comma epsilon Subscript k t Baseline right-parenthesis prime, are a vector white noise process.

The VARMAX(p,q,s) model can be written

StartLayout 1st Row 1st Column normal upper Phi left-parenthesis upper B right-parenthesis bold y Subscript t 2nd Column equals 3rd Column normal upper Theta Superscript asterisk Baseline left-parenthesis upper B right-parenthesis bold x Subscript t plus normal upper Theta left-parenthesis upper B right-parenthesis bold-italic epsilon Subscript t EndLayout

where

StartLayout 1st Row 1st Column normal upper Phi left-parenthesis upper B right-parenthesis 2nd Column equals 3rd Column upper I Subscript k Baseline minus normal upper Phi 1 upper B minus midline-horizontal-ellipsis minus normal upper Phi Subscript p Baseline upper B Superscript p 2nd Row 1st Column normal upper Theta Superscript asterisk Baseline left-parenthesis upper B right-parenthesis 2nd Column equals 3rd Column normal upper Theta 0 Superscript asterisk Baseline plus normal upper Theta 1 Superscript asterisk Baseline upper B plus midline-horizontal-ellipsis plus normal upper Theta Subscript s Superscript asterisk Baseline upper B Superscript s 3rd Row 1st Column normal upper Theta left-parenthesis upper B right-parenthesis 2nd Column equals 3rd Column upper I Subscript k Baseline minus normal upper Theta 1 upper B minus midline-horizontal-ellipsis minus normal upper Theta Subscript q Baseline upper B Superscript q EndLayout

are matrix polynomials in B in the backshift operator, such that upper B Superscript i Baseline bold y Subscript t Baseline equals bold y Subscript t minus i, the normal upper Phi Subscript i and normal upper Theta Subscript i are k times k matrices, and the normal upper Theta Subscript i Superscript asterisk are k times r matrices.

The following assumptions are made:

  • normal upper E left-parenthesis bold-italic epsilon Subscript t Baseline right-parenthesis equals 0, normal upper E left-parenthesis bold-italic epsilon Subscript t Baseline bold-italic epsilon prime Subscript t right-parenthesis equals normal upper Sigma, which is positive-definite, and normal upper E left-parenthesis bold-italic epsilon Subscript t Baseline bold-italic epsilon prime Subscript s right-parenthesis equals 0 for t not-equals s.

  • For stationarity and invertibility of the VARMAX process, the roots of StartAbsoluteValue normal upper Phi left-parenthesis z right-parenthesis EndAbsoluteValue equals 0 and StartAbsoluteValue normal upper Theta left-parenthesis z right-parenthesis EndAbsoluteValue equals 0 are outside the unit circle.

  • The exogenous (independent) variables bold x Subscript t are not correlated with residuals bold-italic epsilon Subscript t, normal upper E left-parenthesis bold x Subscript t Baseline bold-italic epsilon prime Subscript t right-parenthesis equals 0. The exogenous variables can be stochastic or nonstochastic. When the exogenous variables are stochastic and their future values are unknown, forecasts of these future values are needed to forecast the future values of the endogenous (dependent) variables. On occasion, future values of the exogenous variables can be assumed to be known because they are deterministic variables. The VARMAX procedure assumes that the exogenous variables are nonstochastic if future values are available in the input data set. Otherwise, the exogenous variables are assumed to be stochastic and their future values are forecasted by assuming that they follow the VARMA(p,q) model, prior to forecasting the endogenous variables, where p and q are the same as in the VARMAX(p,q,s) model.

State Space Representation

Another representation of the VARMAX(p,q,s) model is in the form of a state variable or a state space model, which consists of a state equation

bold z Subscript t Baseline equals upper F bold z Subscript t minus 1 Baseline plus upper K bold x Subscript t Baseline plus upper G bold-italic epsilon Subscript t

and an observation equation

bold y Subscript t Baseline equals upper H bold z Subscript t

where

bold z Subscript t Baseline equals Start 9 By 1 Matrix 1st Row  bold y Subscript t Baseline 2nd Row  vertical-ellipsis 3rd Row  bold y Subscript t minus p plus 1 Baseline 4th Row  bold x Subscript t Baseline 5th Row  vertical-ellipsis 6th Row  bold x Subscript t minus s plus 1 Baseline 7th Row  bold-italic epsilon Subscript t Baseline 8th Row  vertical-ellipsis 9th Row  bold-italic epsilon Subscript t minus q plus 1 Baseline EndMatrix comma upper K equals Start 11 By 1 Matrix 1st Row  normal upper Theta 0 Superscript asterisk Baseline 2nd Row  0 Subscript k times r Baseline 3rd Row  vertical-ellipsis 4th Row  0 Subscript k times r Baseline 5th Row  upper I Subscript r Baseline 6th Row  0 Subscript r times r Baseline 7th Row  vertical-ellipsis 8th Row  0 Subscript r times r Baseline 9th Row  0 Subscript k times r Baseline 10th Row  vertical-ellipsis 11th Row  0 Subscript k times r Baseline EndMatrix comma upper G equals Start 11 By 1 Matrix 1st Row  upper I Subscript k Baseline 2nd Row  0 Subscript k times k Baseline 3rd Row  vertical-ellipsis 4th Row  0 Subscript k times k Baseline 5th Row  0 Subscript r times k Baseline 6th Row  vertical-ellipsis 7th Row  0 Subscript r times k Baseline 8th Row  upper I Subscript k times k Baseline 9th Row  0 Subscript k times k Baseline 10th Row  vertical-ellipsis 11th Row  0 Subscript k times k Baseline EndMatrix

upper F equals Start 12 By 12 Matrix 1st Row 1st Column normal upper Phi 1 2nd Column midline-horizontal-ellipsis 3rd Column normal upper Phi Subscript p minus 1 Baseline 4th Column normal upper Phi Subscript p Baseline 5th Column normal upper Theta 1 Superscript asterisk Baseline 6th Column midline-horizontal-ellipsis 7th Column normal upper Theta Subscript s minus 1 Superscript asterisk Baseline 8th Column normal upper Theta Subscript s Superscript asterisk Baseline 9th Column minus normal upper Theta 1 10th Column midline-horizontal-ellipsis 11th Column minus normal upper Theta Subscript q minus 1 Baseline 12th Column minus normal upper Theta Subscript q Baseline 2nd Row 1st Column upper I Subscript k Baseline 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 3rd Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column vertical-ellipsis 4th Column vertical-ellipsis 5th Column vertical-ellipsis 6th Column vertical-ellipsis 7th Column vertical-ellipsis 8th Column vertical-ellipsis 9th Column vertical-ellipsis 10th Column vertical-ellipsis 11th Column vertical-ellipsis 12th Column vertical-ellipsis 4th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column upper I Subscript k Baseline 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 5th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 6th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column upper I Subscript r Baseline 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 7th Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column vertical-ellipsis 4th Column vertical-ellipsis 5th Column vertical-ellipsis 6th Column vertical-ellipsis 7th Column vertical-ellipsis 8th Column vertical-ellipsis 9th Column vertical-ellipsis 10th Column vertical-ellipsis 11th Column vertical-ellipsis 12th Column vertical-ellipsis 8th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column upper I Subscript r Baseline 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 9th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 10th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column upper I Subscript k Baseline 10th Column midline-horizontal-ellipsis 11th Column 0 12th Column 0 11th Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column vertical-ellipsis 4th Column vertical-ellipsis 5th Column vertical-ellipsis 6th Column vertical-ellipsis 7th Column vertical-ellipsis 8th Column vertical-ellipsis 9th Column vertical-ellipsis 10th Column vertical-ellipsis 11th Column vertical-ellipsis 12th Column vertical-ellipsis 12th Row 1st Column 0 2nd Column midline-horizontal-ellipsis 3rd Column 0 4th Column 0 5th Column 0 6th Column midline-horizontal-ellipsis 7th Column 0 8th Column 0 9th Column 0 10th Column midline-horizontal-ellipsis 11th Column upper I Subscript k Baseline 12th Column 0 EndMatrix

and

upper H equals left-bracket upper I Subscript k Baseline comma 0 Subscript k times k Baseline comma ellipsis comma 0 Subscript k times k Baseline comma 0 Subscript k times r Baseline comma ellipsis comma 0 Subscript k times r Baseline comma 0 Subscript k times k Baseline comma ellipsis comma 0 Subscript k times k Baseline right-bracket

On the other hand, it is assumed that bold x Subscript t follows a VARMA(p,q) model

bold x Subscript t Baseline equals sigma-summation Underscript i equals 1 Overscript p Endscripts upper A Subscript i Baseline bold x Subscript t minus i Baseline plus bold a Subscript t Baseline minus sigma-summation Underscript i equals 1 Overscript q Endscripts upper C Subscript i Baseline bold a Subscript t minus i

The model can also be expressed as

upper A left-parenthesis upper B right-parenthesis bold x Subscript t Baseline equals upper C left-parenthesis upper B right-parenthesis bold a Subscript t

where upper A left-parenthesis upper B right-parenthesis equals upper I Subscript r Baseline minus upper A 1 upper B minus midline-horizontal-ellipsis minus upper A Subscript p Baseline upper B Superscript p and upper C left-parenthesis upper B right-parenthesis equals upper I Subscript r Baseline minus upper C 1 upper B minus midline-horizontal-ellipsis minus upper C Subscript q Baseline upper B Superscript q are matrix polynomials in B, and the upper A Subscript i and upper C Subscript i are r times r matrices. Without loss of generality, the AR and MA orders can be taken to be the same as the VARMAX(p,q,s) model, and bold a Subscript t and bold-italic epsilon Subscript t are independent white noise processes.

Under suitable conditions such as stationarity, bold x Subscript t is represented by an infinite order moving-average process

StartLayout 1st Row  bold x Subscript t Baseline equals upper A left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline upper C left-parenthesis upper B right-parenthesis bold a Subscript t Baseline equals normal upper Psi Superscript x Baseline left-parenthesis upper B right-parenthesis bold a Subscript t Baseline equals sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts normal upper Psi Subscript j Superscript x Baseline bold a Subscript t minus j EndLayout

where normal upper Psi Superscript x Baseline left-parenthesis upper B right-parenthesis equals upper A left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline upper C left-parenthesis upper B right-parenthesis equals sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts normal upper Psi Subscript j Superscript x Baseline upper B Superscript j.

The optimal minimum mean squared error (minimum MSE) i-step-ahead forecast of bold x Subscript t plus i is

StartLayout 1st Row 1st Column bold x Subscript t plus i vertical-bar t 2nd Column equals 3rd Column sigma-summation Underscript j equals i Overscript normal infinity Endscripts normal upper Psi Subscript j Superscript x Baseline bold a Subscript t plus i minus j 2nd Row 1st Column bold x Subscript t plus i vertical-bar t plus 1 2nd Column equals 3rd Column bold x Subscript t plus i vertical-bar t Baseline plus normal upper Psi Subscript i minus 1 Superscript x Baseline bold a Subscript t plus 1 EndLayout

For i greater-than q,

bold x Subscript t plus i vertical-bar t Baseline equals sigma-summation Underscript j equals 1 Overscript p Endscripts upper A Subscript j Baseline bold x Subscript t plus i minus j vertical-bar t

The VARMAX(p,q,s) model has an absolutely convergent representation as

StartLayout 1st Row 1st Column bold y Subscript t 2nd Column equals 3rd Column normal upper Phi left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline normal upper Theta Superscript asterisk Baseline left-parenthesis upper B right-parenthesis bold x Subscript t plus normal upper Phi left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline normal upper Theta left-parenthesis upper B right-parenthesis bold-italic epsilon Subscript t 2nd Row 1st Column Blank 2nd Column equals 3rd Column normal upper Psi Superscript asterisk Baseline left-parenthesis upper B right-parenthesis normal upper Psi Superscript x Baseline left-parenthesis upper B right-parenthesis bold a Subscript t plus normal upper Phi left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline normal upper Theta left-parenthesis upper B right-parenthesis bold-italic epsilon Subscript t 3rd Row 1st Column Blank 2nd Column equals 3rd Column upper V left-parenthesis upper B right-parenthesis bold a Subscript t plus normal upper Psi left-parenthesis upper B right-parenthesis bold-italic epsilon Subscript t EndLayout

or

bold y Subscript t Baseline equals sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts upper V Subscript j Baseline bold a Subscript t minus j Baseline plus sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts normal upper Psi Subscript j Baseline bold-italic epsilon Subscript t minus j

where normal upper Psi left-parenthesis upper B right-parenthesis equals normal upper Phi left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline normal upper Theta left-parenthesis upper B right-parenthesis equals sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts normal upper Psi Subscript j Baseline upper B Superscript j, normal upper Psi Superscript asterisk Baseline left-parenthesis upper B right-parenthesis equals normal upper Phi left-parenthesis upper B right-parenthesis Superscript negative 1 Baseline normal upper Theta Superscript asterisk Baseline left-parenthesis upper B right-parenthesis, and upper V left-parenthesis upper B right-parenthesis equals normal upper Psi Superscript asterisk Baseline left-parenthesis upper B right-parenthesis normal upper Psi Superscript x Baseline left-parenthesis upper B right-parenthesis equals sigma-summation Underscript j equals 0 Overscript normal infinity Endscripts upper V Subscript j Baseline upper B Superscript j.

The optimal (minimum MSE) i-step-ahead forecast of bold y Subscript t plus i is

StartLayout 1st Row 1st Column bold y Subscript t plus i vertical-bar t 2nd Column equals 3rd Column sigma-summation Underscript j equals i Overscript normal infinity Endscripts upper V Subscript j Baseline bold a Subscript t plus i minus j plus sigma-summation Underscript j equals i Overscript normal infinity Endscripts normal upper Psi Subscript j Baseline bold-italic epsilon Subscript t plus i minus j 2nd Row 1st Column bold y Subscript t plus i vertical-bar t plus 1 2nd Column equals 3rd Column bold y Subscript t plus i vertical-bar t Baseline plus upper V Subscript i minus 1 Baseline bold a Subscript t plus 1 plus normal upper Psi Subscript i minus 1 Baseline bold-italic epsilon Subscript t plus 1 EndLayout

for i equals 1 comma ellipsis comma v with v equals normal m normal a normal x left-parenthesis p comma q plus 1 right-parenthesis. For i greater-than q,

StartLayout 1st Row 1st Column bold y Subscript t plus i vertical-bar t 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus i minus j vertical-bar t plus sigma-summation Underscript j equals 0 Overscript s Endscripts normal upper Theta Subscript j Superscript asterisk Baseline bold x Subscript t plus i minus j vertical-bar t 2nd Row 1st Column Blank 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus i minus j vertical-bar t plus normal upper Theta 0 Superscript asterisk Baseline bold x Subscript t plus i vertical-bar t plus sigma-summation Underscript j equals 1 Overscript s Endscripts normal upper Theta Subscript j Superscript asterisk Baseline bold x Subscript t plus i minus j vertical-bar t 3rd Row 1st Column Blank 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus i minus j vertical-bar t plus normal upper Theta 0 Superscript asterisk Baseline sigma-summation Underscript j equals 1 Overscript p Endscripts upper A Subscript j Baseline bold x Subscript t plus i minus j vertical-bar t plus sigma-summation Underscript j equals 1 Overscript s Endscripts normal upper Theta Subscript j Superscript asterisk Baseline bold x Subscript t plus i minus j vertical-bar t 4th Row 1st Column Blank 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus i minus j vertical-bar t plus sigma-summation Underscript j equals 1 Overscript u Endscripts left-parenthesis normal upper Theta 0 Superscript asterisk Baseline upper A Subscript j Baseline plus normal upper Theta Subscript j Superscript asterisk Baseline right-parenthesis bold x Subscript t plus i minus j vertical-bar t EndLayout

where u equals normal m normal a normal x left-parenthesis p comma s right-parenthesis.

Define normal upper Pi Subscript j Baseline equals normal upper Theta 0 Superscript asterisk Baseline upper A Subscript j Baseline plus normal upper Theta Subscript j Superscript asterisk. For i equals v greater-than q with v equals normal m normal a normal x left-parenthesis p comma q plus 1 right-parenthesis, you obtain

StartLayout 1st Row 1st Column bold y Subscript t plus v vertical-bar t 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus v minus j vertical-bar t Baseline plus sigma-summation Underscript j equals 1 Overscript u Endscripts normal upper Pi Subscript j Baseline bold x Subscript t plus v minus j vertical-bar t Baseline normal f normal o normal r u less-than-or-equal-to v 2nd Row 1st Column bold y Subscript t plus v vertical-bar t 2nd Column equals 3rd Column sigma-summation Underscript j equals 1 Overscript p Endscripts normal upper Phi Subscript j Baseline bold y Subscript t plus v minus j vertical-bar t Baseline plus sigma-summation Underscript j equals 1 Overscript r Endscripts normal upper Pi Subscript j Baseline bold x Subscript t plus v minus j vertical-bar t Baseline normal f normal o normal r u greater-than v EndLayout

From the preceding relations, a state equation is

bold z Subscript t plus 1 Baseline equals upper F bold z Subscript t Baseline plus upper K bold x Subscript t Superscript asterisk Baseline plus upper G bold e Subscript t plus 1

and an observation equation is

bold y Subscript t Baseline equals upper H bold z Subscript t

where

bold z Subscript t Baseline equals Start 8 By 1 Matrix 1st Row  bold y Subscript t Baseline 2nd Row  bold y Subscript t plus 1 vertical-bar t Baseline 3rd Row  vertical-ellipsis 4th Row  bold y Subscript t plus v minus 1 vertical-bar t Baseline 5th Row  bold x Subscript t Baseline 6th Row  bold x Subscript t plus 1 vertical-bar t Baseline 7th Row  vertical-ellipsis 8th Row  bold x Subscript t plus v minus 1 vertical-bar t Baseline EndMatrix comma bold x Subscript t Superscript asterisk Baseline equals Start 4 By 1 Matrix 1st Row  bold x Subscript t plus v minus u Baseline 2nd Row  bold x Subscript t plus v minus u plus 1 Baseline 3rd Row  vertical-ellipsis 4th Row  bold x Subscript t minus 1 Baseline EndMatrix comma bold e Subscript t plus 1 Baseline equals StartBinomialOrMatrix bold a Subscript t plus 1 Baseline Choose bold-italic epsilon Subscript t plus 1 Baseline EndBinomialOrMatrix
upper F equals Start 8 By 10 Matrix 1st Row 1st Column 0 2nd Column upper I Subscript k Baseline 3rd Column 0 4th Column midline-horizontal-ellipsis 5th Column 0 6th Column 0 7th Column 0 8th Column 0 9th Column midline-horizontal-ellipsis 10th Column 0 2nd Row 1st Column 0 2nd Column 0 3rd Column upper I Subscript k Baseline 4th Column midline-horizontal-ellipsis 5th Column 0 6th Column 0 7th Column 0 8th Column 0 9th Column midline-horizontal-ellipsis 10th Column 0 3rd Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column vertical-ellipsis 4th Column down-right-diagonal-ellipsis 5th Column vertical-ellipsis 6th Column vertical-ellipsis 7th Column vertical-ellipsis 8th Column vertical-ellipsis 9th Column down-right-diagonal-ellipsis 10th Column vertical-ellipsis 4th Row 1st Column normal upper Phi Subscript v Baseline 2nd Column normal upper Phi Subscript v minus 1 Baseline 3rd Column normal upper Phi Subscript v minus 2 Baseline 4th Column midline-horizontal-ellipsis 5th Column normal upper Phi 1 6th Column normal upper Pi Subscript v Baseline 7th Column normal upper Pi Subscript v minus 1 Baseline 8th Column normal upper Pi Subscript v minus 2 Baseline 9th Column midline-horizontal-ellipsis 10th Column normal upper Pi 1 5th Row 1st Column 0 2nd Column 0 3rd Column 0 4th Column midline-horizontal-ellipsis 5th Column 0 6th Column 0 7th Column upper I Subscript r Baseline 8th Column 0 9th Column midline-horizontal-ellipsis 10th Column 0 6th Row 1st Column 0 2nd Column 0 3rd Column 0 4th Column midline-horizontal-ellipsis 5th Column 0 6th Column 0 7th Column 0 8th Column upper I Subscript r Baseline 9th Column midline-horizontal-ellipsis 10th Column 0 7th Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column vertical-ellipsis 4th Column down-right-diagonal-ellipsis 5th Column vertical-ellipsis 6th Column vertical-ellipsis 7th Column vertical-ellipsis 8th Column vertical-ellipsis 9th Column down-right-diagonal-ellipsis 10th Column vertical-ellipsis 8th Row 1st Column 0 2nd Column 0 3rd Column 0 4th Column midline-horizontal-ellipsis 5th Column 0 6th Column upper A Subscript v Baseline 7th Column upper A Subscript v minus 1 Baseline 8th Column upper A Subscript v minus 2 Baseline 9th Column midline-horizontal-ellipsis 10th Column upper A 1 EndMatrix
upper K equals Start 7 By 4 Matrix 1st Row 1st Column 0 2nd Column 0 3rd Column midline-horizontal-ellipsis 4th Column 0 2nd Row 1st Column 0 2nd Column 0 3rd Column midline-horizontal-ellipsis 4th Column 0 3rd Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column down-right-diagonal-ellipsis 4th Column vertical-ellipsis 4th Row 1st Column normal upper Pi Subscript u Baseline 2nd Column normal upper Pi Subscript u minus 1 Baseline 3rd Column midline-horizontal-ellipsis 4th Column normal upper Pi Subscript v plus 1 Baseline 5th Row 1st Column 0 2nd Column 0 3rd Column midline-horizontal-ellipsis 4th Column 0 6th Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 3rd Column down-right-diagonal-ellipsis 4th Column vertical-ellipsis 7th Row 1st Column 0 2nd Column 0 3rd Column midline-horizontal-ellipsis 4th Column 0 EndMatrix comma upper G equals Start 8 By 2 Matrix 1st Row 1st Column upper V 0 2nd Column upper I Subscript k Baseline 2nd Row 1st Column upper V 1 2nd Column normal upper Psi 1 3rd Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 4th Row 1st Column upper V Subscript v minus 1 Baseline 2nd Column normal upper Psi Subscript v minus 1 Baseline 5th Row 1st Column upper I Subscript r Baseline 2nd Column 0 Subscript r times k Baseline 6th Row 1st Column normal upper Psi 1 Superscript x Baseline 2nd Column 0 Subscript r times k Baseline 7th Row 1st Column vertical-ellipsis 2nd Column vertical-ellipsis 8th Row 1st Column normal upper Psi Subscript v minus 1 Superscript x Baseline 2nd Column 0 Subscript r times k Baseline EndMatrix

and

upper H equals left-bracket upper I Subscript k Baseline comma 0 Subscript k times k Baseline comma ellipsis comma 0 Subscript k times k Baseline comma 0 Subscript k times r Baseline comma ellipsis comma 0 Subscript k times r Baseline right-bracket

Note that the matrix K and the input vector bold x Subscript t Superscript asterisk are defined only when u greater-than v.

Last updated: June 19, 2025