VARMAX Procedure

Model Diagnostic Checks

Multivariate Model Diagnostic Checks

Log Likelihood

The log-likelihood function for the fitted model is reported in the LogLikelihood ODS table. The log-likelihood functions for different models are defined as follows:

  • For VARMAX models that are estimated through the (conditional) maximum likelihood method, see the section VARMA and VARMAX Modeling.

  • For Bayesian VAR and VARX models, see the section Bayesian VAR and VARX Modeling.

  • For (Bayesian) vector error correction models, see the section Vector Error Correction Modeling.

  • For multivariate GARCH models, see the section Multivariate GARCH Modeling.

  • For VARFIMA and VARFIMAX models, see the section VARFIMA and VARFIMAX Modeling.

  • For VAR and VARX models that are estimated through the least squares (LS) method, the log likelihood is defined as

    script l equals minus one-half left-parenthesis upper T log StartAbsoluteValue normal upper Sigma overTilde EndAbsoluteValue plus k upper T right-parenthesis

    where normal upper Sigma overTilde is the maximum likelihood estimate of the innovation covariance matrix, k is the number of dependent variables, and T is the number of observations used in the estimation.

Information Criteria

The information criteria include Akaike’s information criterion (AIC), the corrected Akaike’s information criterion (AICC), the final prediction error criterion (FPE), the Hannan-Quinn criterion (HQC), and the Schwarz Bayesian criterion (SBC, also referred to as BIC). These criteria are defined as

StartLayout 1st Row 1st Column AIC 2nd Column equals 3rd Column minus 2 script l plus 2 r 2nd Row 1st Column AICC 2nd Column equals 3rd Column minus 2 script l plus 2 r upper T slash left-parenthesis upper T minus r minus 1 right-parenthesis 3rd Row 1st Column FPE 2nd Column equals 3rd Column left-parenthesis StartFraction upper T plus r Subscript b Baseline Over upper T minus r Subscript b Baseline EndFraction right-parenthesis Superscript k Baseline StartAbsoluteValue normal upper Sigma overTilde EndAbsoluteValue 4th Row 1st Column HQC 2nd Column equals 3rd Column minus 2 script l plus 2 r log left-parenthesis log left-parenthesis upper T right-parenthesis right-parenthesis 5th Row 1st Column SBC 2nd Column equals 3rd Column minus 2 script l plus r log left-parenthesis upper T right-parenthesis EndLayout

where script l is the log likelihood, r is the total number of parameters in the model, k is the number of dependent variables, T is the number of observations that are used to estimate the model, r Subscript b is the number of parameters in each mean equation, and normal upper Sigma overTilde is the maximum likelihood estimate of normal upper Sigma. As suggested by Burnham and Anderson (2004) for least squares estimation, the total number of parameters, r, must include the parameters in the innovation covariance matrix. When comparing models, choose the model that has the smallest criterion values.

For an example of the output, see Figure 4 earlier in this chapter.

Portmanteau Statistic

The portmanteau statistic, upper Q Subscript s, is used to test whether correlation remains on the model residuals. The null hypothesis is that the residuals are uncorrelated. Let upper C Subscript epsilon Baseline left-parenthesis l right-parenthesis be the residual cross-covariance matrices, ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis l right-parenthesis be the residual cross-correlation matrices as

StartLayout 1st Row  upper C Subscript epsilon Baseline left-parenthesis l right-parenthesis equals upper T Superscript negative 1 Baseline sigma-summation Underscript t equals 1 Overscript upper T minus l Endscripts bold-italic epsilon Subscript t Baseline bold-italic epsilon prime Subscript t plus l EndLayout

and

StartLayout 1st Row  ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis l right-parenthesis equals ModifyingAbove upper V With caret Subscript epsilon Superscript negative 1 slash 2 Baseline upper C Subscript epsilon Baseline left-parenthesis l right-parenthesis ModifyingAbove upper V With caret Subscript epsilon Superscript negative 1 slash 2 Baseline normal a normal n normal d ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis negative l right-parenthesis equals ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis l right-parenthesis prime EndLayout

where ModifyingAbove upper V With caret Subscript epsilon Baseline equals normal upper D normal i normal a normal g left-parenthesis ModifyingAbove sigma With caret Subscript 11 Superscript 2 Baseline comma ellipsis comma ModifyingAbove sigma With caret Subscript k k Superscript 2 Baseline right-parenthesis and ModifyingAbove sigma With caret Subscript i i Superscript 2 are the diagonal elements of ModifyingAbove normal upper Sigma With caret. The multivariate portmanteau test defined in Hosking (1980) is

StartLayout 1st Row  upper Q Subscript s Baseline equals upper T squared sigma-summation Underscript l equals 1 Overscript s Endscripts left-parenthesis upper T minus l right-parenthesis Superscript negative 1 Baseline normal t normal r StartSet ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis l right-parenthesis ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis 0 right-parenthesis Superscript negative 1 Baseline ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis negative l right-parenthesis ModifyingAbove rho With caret Subscript epsilon Baseline left-parenthesis 0 right-parenthesis Superscript negative 1 Baseline EndSet EndLayout

The statistic upper Q Subscript s has approximately the chi-square distribution with k squared left-parenthesis s minus p minus q right-parenthesis degrees of freedom. An example of the output is displayed in Figure 7.

Univariate Model Diagnostic Checks

There are various ways to perform diagnostic checks for a univariate model. For more information, see the section Testing for Nonlinear Dependence: Heteroscedasticity Tests in Chapter 8, AUTOREG Procedure. An example of the output is displayed in Figure 8 and Figure 9.

  • Durbin-Watson (DW) statistics: The DW test statistics test for the first order autocorrelation in the residuals.

  • Jarque-Bera normality test: This test is helpful in determining whether the model residuals represent a white noise process. This tests the null hypothesis that the residuals have normality.

  • F tests for autoregressive conditional heteroscedastic (ARCH) disturbances: F test statistics test for the heteroscedastic disturbances in the residuals. This tests the null hypothesis that the residuals have equal covariances

  • F tests for AR disturbance: These test statistics are computed from the residuals of the univariate AR(1), AR(1,2), AR(1,2,3), and AR(1,2,3,4) models to test the null hypothesis that the residuals are uncorrelated.

Last updated: June 19, 2025