ARIMA Procedure

The ESACF Method

The extended sample autocorrelation function (ESACF) method can tentatively identify the orders of a stationary or nonstationary ARMA process based on iterated least squares estimates of the autoregressive parameters. Tsay and Tiao (1984) proposed the technique, and Choi (1992) provides useful descriptions of the algorithm.

Given a stationary or nonstationary time series StartSet z Subscript t Baseline colon 1 less-than-or-equal-to t less-than-or-equal-to n EndSet with mean corrected form z overTilde Subscript t Baseline equals z Subscript t Baseline minus mu Subscript z with a true autoregressive order of p plus d and with a true moving-average order of q, you can use the ESACF method to estimate the unknown orders p plus d and q by analyzing the autocorrelation functions associated with filtered series of the form

w Subscript t Superscript left-parenthesis m comma j right-parenthesis Baseline equals ModifyingAbove normal upper Phi With caret Subscript left-parenthesis m comma j right-parenthesis Baseline left-parenthesis upper B right-parenthesis z overTilde Subscript t Baseline equals z overTilde Subscript t Baseline minus sigma-summation Underscript i equals 1 Overscript m Endscripts ModifyingAbove phi With caret Subscript i Superscript left-parenthesis m comma j right-parenthesis Baseline z overTilde Subscript t minus i

where upper B represents the backshift operator, where m equals p Subscript m i n Baseline comma ellipsis comma p Subscript m a x Baseline are the autoregressive test orders, where j equals q Subscript m i n Baseline plus 1 comma ellipsis comma q Subscript m a x Baseline plus 1 are the moving-average test orders, and where ModifyingAbove phi With caret Subscript i Superscript left-parenthesis m comma j right-parenthesis are the autoregressive parameter estimates under the assumption that the series is an ARMA(m comma j) process.

For purely autoregressive models (j equals 0), ordinary least squares (OLS) is used to consistently estimate ModifyingAbove phi With caret Subscript i Superscript left-parenthesis m comma 0 right-parenthesis. For ARMA models, consistent estimates are obtained by the iterated least squares recursion formula, which is initiated by the pure autoregressive estimates:

ModifyingAbove phi With caret Subscript i Superscript left-parenthesis m comma j right-parenthesis Baseline equals ModifyingAbove phi With caret Subscript i Superscript left-parenthesis m plus 1 comma j minus 1 right-parenthesis Baseline minus ModifyingAbove phi With caret Subscript i minus 1 Superscript left-parenthesis m comma j minus 1 right-parenthesis Baseline StartFraction ModifyingAbove phi With caret Subscript m plus 1 Superscript left-parenthesis m plus 1 comma j minus 1 right-parenthesis Baseline Over ModifyingAbove phi With caret Subscript m Superscript left-parenthesis m comma j minus 1 right-parenthesis Baseline EndFraction

The jth lag of the sample autocorrelation function of the filtered series w Subscript t Superscript left-parenthesis m comma j right-parenthesis is the extended sample autocorrelation function, and it is denoted as r Subscript j left-parenthesis m right-parenthesis Baseline equals r Subscript j Baseline left-parenthesis w Superscript left-parenthesis m comma j right-parenthesis Baseline right-parenthesis.

The standard errors of r Subscript j left-parenthesis m right-parenthesis are computed in the usual way by using Bartlett’s approximation of the variance of the sample autocorrelation function, v a r left-parenthesis r Subscript j left-parenthesis m right-parenthesis Baseline right-parenthesis almost-equals left-parenthesis 1 plus sigma-summation Underscript t equals 1 Overscript j minus 1 Endscripts r Subscript j Superscript 2 Baseline left-parenthesis w Superscript left-parenthesis m comma j right-parenthesis Baseline right-parenthesis right-parenthesis.

If the true model is an ARMA (p plus d comma q) process, the filtered series w Subscript t Superscript left-parenthesis m comma j right-parenthesis follows an MA(q) model for j greater-than-or-equal-to q so that

r Subscript j left-parenthesis p plus d right-parenthesis Baseline almost-equals 0 j greater-than q
r Subscript j left-parenthesis p plus d right-parenthesis Baseline not-equals 0 j equals q

Additionally, Tsay and Tiao (1984) show that the extended sample autocorrelation satisfies

r Subscript j left-parenthesis m right-parenthesis Baseline almost-equals 0 j minus q greater-than m minus p minus d less-than-or-equal-to 0
r Subscript j left-parenthesis m right-parenthesis Baseline not-equals c left-parenthesis m minus p minus d comma j minus q right-parenthesis 0 less-than-or-equal-to j minus q less-than-or-equal-to m minus p minus d

where c left-parenthesis m minus p minus d comma j minus q right-parenthesis is a nonzero constant or a continuous random variable bounded by –1 and 1.

An ESACF table is then constructed by using the r Subscript j left-parenthesis m right-parenthesis for m equals p Subscript m i n comma Baseline ellipsis comma p Subscript m a x Baseline and j equals q Subscript m i n Baseline plus 1 comma ellipsis comma q Subscript m a x Baseline plus 1 to identify the ARMA orders (see Table 4). The orders are tentatively identified by finding a right (maximal) triangular pattern with vertices located at left-parenthesis p plus d comma q right-parenthesis and left-parenthesis p plus d comma q Subscript m a x Baseline right-parenthesis and in which all elements are insignificant (based on asymptotic normality of the autocorrelation function). The vertex left-parenthesis p plus d comma q right-parenthesis identifies the order. Table 5 depicts the theoretical pattern associated with an ARMA(1,2) series.

Table 4: ESACF Table

MA
AR 0 1 2 3 dot dot
0 r Subscript 1 left-parenthesis 0 right-parenthesis r Subscript 2 left-parenthesis 0 right-parenthesis r Subscript 3 left-parenthesis 0 right-parenthesis r Subscript 4 left-parenthesis 0 right-parenthesis dot dot
1 r Subscript 1 left-parenthesis 1 right-parenthesis r Subscript 2 left-parenthesis 1 right-parenthesis r Subscript 3 left-parenthesis 1 right-parenthesis r Subscript 4 left-parenthesis 1 right-parenthesis dot dot
2 r Subscript 1 left-parenthesis 2 right-parenthesis r Subscript 2 left-parenthesis 2 right-parenthesis r Subscript 3 left-parenthesis 2 right-parenthesis r Subscript 4 left-parenthesis 2 right-parenthesis dot dot
3 r Subscript 1 left-parenthesis 3 right-parenthesis r Subscript 2 left-parenthesis 3 right-parenthesis r Subscript 3 left-parenthesis 3 right-parenthesis r Subscript 4 left-parenthesis 3 right-parenthesis dot dot
dot dot dot dot dot dot dot
dot dot dot dot dot dot dot


Table 5: Theoretical ESACF Table for an ARMA(1,2) Series

MA
AR 0 1 2 3 4 5 6 7
0 * X X X X X X X
1 * X 0 0 0 0 0 0
2 * X X 0 0 0 0 0
3 * X X X 0 0 0 0
4 * X X X X 0 0 0
X = significant terms
0 = insignificant terms
* = no pattern


Last updated: June 19, 2025