The CORR Procedure

Hoeffding Dependence Coefficient

Hoeffding’s measure of dependence, D, is a nonparametric measure of association that detects more general departures from independence. The statistic approximates a weighted sum over observations of chi-square statistics for two-by-two classification tables (Hoeffding 1948). Each set of left-parenthesis x comma y right-parenthesis values are cut points for the classification. The formula for Hoeffding’s D is

upper D equals 30 StartFraction left-parenthesis n minus 2 right-parenthesis left-parenthesis n minus 3 right-parenthesis upper D 1 plus upper D 2 minus 2 left-parenthesis n minus 2 right-parenthesis upper D 3 Over n left-parenthesis n minus 1 right-parenthesis left-parenthesis n minus 2 right-parenthesis left-parenthesis n minus 3 right-parenthesis left-parenthesis n minus 4 right-parenthesis EndFraction

where upper D 1 equals sigma-summation Underscript i Endscripts left-parenthesis upper Q Subscript i Baseline minus 1 right-parenthesis left-parenthesis upper Q Subscript i Baseline minus 2 right-parenthesis, upper D 2 equals sigma-summation Underscript i Endscripts left-parenthesis upper R Subscript i Baseline minus 1 right-parenthesis left-parenthesis upper R Subscript i Baseline minus 2 right-parenthesis left-parenthesis upper S Subscript i Baseline minus 1 right-parenthesis left-parenthesis upper S Subscript i Baseline minus 2 right-parenthesis, and upper D 3 equals sigma-summation Underscript i Endscripts left-parenthesis upper R Subscript i Baseline minus 2 right-parenthesis left-parenthesis upper S Subscript i Baseline minus 2 right-parenthesis left-parenthesis upper Q Subscript i Baseline minus 1 right-parenthesis. upper R Subscript i is the rank of x Subscript i, upper S Subscript i is the rank of y Subscript i, and upper Q Subscript i (also called the bivariate rank) is 1 plus the number of points with both x and y values less than the ith point.

A point that is tied on only the x value or y value contributes 1/2 to upper Q Subscript i if the other value is less than the corresponding value for the ith point.

A point that is tied on both x and y contributes 1/4 to upper Q Subscript i. PROC CORR obtains the upper Q Subscript i values by first ranking the data. The data are then double sorted by ranking observations according to values of the first variable and reranking the observations according to values of the second variable. Hoeffding’s D statistic is computed using the number of interchanges of the first variable. When no ties occur among data set observations, the D statistic values are between –0.5 and 1, with 1 indicating complete dependence. However, when ties occur, the D statistic might result in a smaller value. That is, for a pair of variables with identical values, the Hoeffding’s D statistic might be less than 1. With a large number of ties in a small data set, the D statistic might be less than –0.5. For more information about Hoeffding’s D, see Hollander and Wolfe (1999).

Probability Values

The probability values for Hoeffding’s D statistic are computed using the asymptotic distribution computed by Blum, Kiefer, and Rosenblatt (1961). The formula is

StartFraction left-parenthesis n minus 1 right-parenthesis pi Superscript 4 Baseline Over 60 EndFraction upper D plus StartFraction pi Superscript 4 Baseline Over 72 EndFraction

which comes from the asymptotic distribution. If the sample size is less than 10, refer to the tables for the distribution of D in Hollander and Wolfe (1999).

Last updated: April 10, 2023