The VARMAX Procedure

Vector Autoregressive Model

(View the complete code for this example.)

Let denote a k-dimensional time series vector of random variables of interest. The pth-order VAR process is written as

where is a vector white noise process such that , , and for ; is a constant vector; and is a matrix.

Analyzing and modeling the series jointly enables you to understand the dynamic relationships over time among the series and to improve the accuracy of forecasts for individual series by using the additional information available from the related series and their forecasts.

Consider the first-order stationary bivariate vector autoregressive model:

The following IML procedure statements simulate a bivariate vector time series from this model to provide test data for the VARMAX procedure:

proc iml;
   sig = {1.0  0.5, 0.5 1.25};
   phi = {1.2 -0.5, 0.6 0.3};
   /* simulate the vector time series */
   call varmasim(y,phi) sigma = sig n = 100 seed = 34657;
   cn = {'y1' 'y2'};
   create simul1 from y[colname=cn];
   append from y;
quit;

The following statements plot the simulated vector time series , which is shown in Figure 42.1:

data simul1;
   set simul1;
   date = intnx( 'year', '01jan1900'd, _n_-1 );
   format date year4.;
run;

proc sgplot data=simul1;
   series x=date y=y1 / lineattrs=(pattern=solid);
   series x=date y=y2 / lineattrs=(pattern=dash);
   yaxis label="Series";
run;

Figure 42.1: Plot of the Generated Data Process

Plot of the Generated Data Process


The following statements fit a VAR(1) model to the simulated data:

/*--- Vector Autoregressive Model ---*/

proc varmax data=simul1;
   id date interval=year;
   model y1 y2 / p=1 noint lagmax=3
                 print=(estimates diagnose);
   output out=for lead=5;
run;

First, you specify the input data set in the PROC VARMAX statement. Then, you use the MODEL statement to designate the dependent variables, and . To estimate a zero-mean VAR model, you specify the order of the autoregressive model in the P= option and the NOINT option. The MODEL statement fits the model to the data and prints parameter estimates and their significance. The PRINT=ESTIMATES option prints the matrix form of parameter estimates, and the PRINT=DIAGNOSE option prints various diagnostic tests. The LAGMAX=3 option prints the output for the residual diagnostic checks.

To output the forecasts to a data set, you specify the OUT= option in the OUTPUT statement. If you want to forecast five steps ahead, you use the LEAD=5 option. The ID statement specifies the yearly interval between observations and provides the Time column in the forecast output.

The VARMAX procedure output is shown in Figure 42.2 through Figure 42.10. The VARMAX procedure first displays descriptive statistics, as shown in Figure 42.2. The Type column indicates that the variables are dependent variables. The N column indicates the number of nonmissing observations.

Figure 42.2: Descriptive Statistics

The VARMAX Procedure

Number of Observations100
Number of Pairwise Missing0

Simple Summary Statistics
VariableTypeNMeanStandard
Deviation
MinMax
y1Dependent100-0.216532.78210-4.758268.37032
y2Dependent1000.169052.58184-6.047189.58487


Figure 42.3 shows the model type and the estimation method that is used to fit the model to the simulated data. It also shows the AR coefficient matrix in terms of lag 1, the schematic representation, and the parameter estimates and their significance that can indicate how well the model fits the data.

The "AR" table shows the AR coefficient matrix. The "Schematic Representation" table schematically represents the parameter estimates and enables you to easily verify their significance in matrix form.

In the "Model Parameter Estimates" table, the first column shows the variable on the left side of the equation; the second column is the parameter name AR, which indicates the (i, j) element of the lag l autoregressive coefficient; the next four columns provide the estimate, standard error, t value, and p-value for the parameter; and the last column is the regressor that corresponds to the displayed parameter.

Figure 42.3: Model Type and Parameter Estimates

The VARMAX Procedure

Type of ModelVAR(1)
Estimation MethodLeast Squares Estimation

AR
LagVariabley1y2
1y11.15977-0.51058
 y20.546340.38499

Schematic
Representation
Variable/LagAR1
y1+-
y2++
+ is > 2*std error,  - is < -2*std error,  . is between,  * is N/A

Model Parameter Estimates
EquationParameterEstimateStandard
Error
t ValuePr > |t|Variable
y1AR1_1_11.159770.0550821.060.0001y1(t-1)
 AR1_1_2-0.510580.05898-8.660.0001y2(t-1)
y2AR1_2_10.546340.057799.450.0001y1(t-1)
 AR1_2_20.384990.061886.220.0001y2(t-1)


The fitted VAR(1) model with estimated standard errors in parentheses is given as

Clearly, all parameter estimates in the coefficient matrix are significant.

The model can also be written as two univariate regression equations:

The table in Figure 42.4 shows the innovation covariance matrix estimates, the log likelihood, and the various information criteria results. The variable names in the table for the innovation covariance matrix estimates are printed for convenience: means the innovation for , and means the innovation for . The log likelihood for a VAR model that is estimated through least squares method is defined as , where is the sample size except the presample being skipped because of the AR lag order, is the number of dependent variables, and is the maximum likelihood estimate (MLE) of innovation covariance matrix. The matrix is computed from the reported least squares estimate of the innovation covariance matrix, , by adjusting the degrees of freedom. , where is the number of parameters in each equation. You can use the information criteria to compare the fit of competing models to a set of data. The model that has a smaller value of the information criterion is preferred when it is compared to other models. For more information about how to calculate the information criteria, see the section Multivariate Model Diagnostic Checks.

Figure 42.4: Innovation Covariance Estimates, Log Likelihood, and Information Criteria

Covariances of Innovations
Variabley1y2
y11.288750.39751
y20.397511.41839

Log-likelihood-122.362

Information Criteria
AICC259.9557
HQC266.0748
AIC258.7249
SBC276.8908
FPEC1.738092


Figure 42.5 shows the cross covariances of the residuals. The values of the lag 0 are slightly different from Figure 42.4 because of the different degrees of freedom.

Figure 42.5: Multivariate Diagnostic Checks

Cross Covariances of Residuals
LagVariabley1y2
0y11.262710.38948
 y20.389481.38974
1y10.031210.05675
 y2-0.04646-0.05398
2y10.081340.10599
 y20.03482-0.01549
3y10.016440.11734
 y20.006090.11414


Figure 42.6 and Figure 42.7 show tests for white noise residuals that are based on the cross correlations of the residuals. The output shows that you cannot reject the null hypothesis that the residuals are uncorrelated.

Figure 42.6: Multivariate Diagnostic Checks, Continued

Cross Correlations of Residuals
LagVariabley1y2
0y11.000000.29401
 y20.294011.00000
1y10.024720.04284
 y2-0.03507-0.03884
2y10.064420.08001
 y20.02628-0.01115
3y10.013020.08858
 y20.004600.08213

Schematic Representation
of Cross Correlations
of Residuals
Variable/Lag0123
y1++......
y2++......
+ is > 2*std error,  - is < -2*std error,  . is between


Figure 42.7: Multivariate Diagnostic Checks, Continued

Portmanteau Test for Cross Correlations
of Residuals
Up To LagDFChi-SquarePr > ChiSq
241.580.8124
382.780.9473


The VARMAX procedure provides diagnostic checks for the univariate form of the equations. The table in Figure 42.8 describes how well each univariate equation fits the data. From the two univariate regression equations shown in Figure 42.3, the values of in the second column of Figure 42.8 are 0.84 and 0.79. The standard deviations in the third column are the square roots of the diagonal elements of the covariance matrix from Figure 42.4. The F statistics in the fourth column test the null hypotheses and , where is the (i, j) element of the matrix . The last column shows the p-values of the F statistics. The results show that each univariate model is significant.

Figure 42.8: Univariate Diagnostic Checks

Univariate Model ANOVA Diagnostics
VariableR-SquareStandard
Deviation
F ValuePr > F
y10.83511.13523491.25<.0001
y20.79061.19096366.29<.0001


The check for white noise residuals in terms of the univariate equation is shown in Figure 42.9. This output contains information that indicates whether the residuals are correlated and heteroscedastic. In the first table, the second column contains the Durbin-Watson test statistics to test the null hypothesis that the residuals are uncorrelated. The third and fourth columns show the Jarque-Bera normality test statistics and their p-values to test the null hypothesis that the residuals have normality. The last two columns show F statistics and their p-values for ARCH(1) disturbances to test the null hypothesis that the residuals have equal covariances. The second table includes F statistics and their p-values for AR(1), AR(1,2), AR(1,2,3) and AR(1,2,3,4) models of residuals to test the null hypothesis that the residuals are uncorrelated.

Figure 42.9: Univariate Diagnostic Checks, Continued

Univariate Model White Noise Diagnostics
VariableDurbin
Watson
NormalityARCH
Chi-SquarePr > ChiSqF ValuePr > F
y11.945343.560.16860.130.7199
y22.062765.420.06672.100.1503

Univariate Model AR Diagnostics
VariableAR1AR2AR3AR4
F ValuePr > FF ValuePr > FF ValuePr > FF ValuePr > F
y10.020.89800.140.86620.090.96290.820.5164
y20.520.47090.410.66500.320.81360.320.8664


The table in Figure 42.10 shows forecasts, their prediction errors, and 95% confidence limits. For more information, see the section Forecasting.

Figure 42.10: Forecasts

Forecasts
VariableObsTimeForecastStandard
Error
95% Confidence Limits
y11012000-3.592121.13523-5.81713-1.36711
 1022001-3.094481.70915-6.444350.25539
 1032002-2.174332.14472-6.377922.02925
 1042003-1.113952.43166-5.879923.65203
 1052004-0.143422.58740-5.214634.92779
y21012000-2.098731.19096-4.432980.23551
 1022001-2.770501.47666-5.664690.12369
 1032002-2.757241.74212-6.171730.65725
 1042003-2.249432.01925-6.207091.70823
 1052004-1.474602.25169-5.887822.93863


Last updated: November 05, 2018