The CORR Procedure

Fisher’s z Transformation

For a sample correlation r that uses a sample from a bivariate normal distribution with correlation rho equals 0, the statistic

t Subscript r Baseline equals left-parenthesis n minus 2 right-parenthesis Superscript 1 slash 2 Baseline left-parenthesis StartFraction r squared Over 1 minus r squared EndFraction right-parenthesis Superscript 1 slash 2

has a Student’s t distribution with (n-2) degrees of freedom.

With the monotone transformation of the correlation r (Fisher 1921)

z Subscript r Baseline equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis r right-parenthesis equals one-half log left-parenthesis StartFraction 1 plus r Over 1 minus r EndFraction right-parenthesis

the statistic z Subscript r has an approximate normal distribution with mean and variance

upper E left-parenthesis z Subscript r Baseline right-parenthesis equals zeta plus StartFraction rho Over 2 left-parenthesis n minus 1 right-parenthesis EndFraction
upper V left-parenthesis z Subscript r Baseline right-parenthesis equals StartFraction 1 Over n minus 3 EndFraction

where zeta equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis rho right-parenthesis.

For the transformed z Subscript r, the approximate variance upper V left-parenthesis z Subscript r Baseline right-parenthesis equals 1 slash left-parenthesis n minus 3 right-parenthesis is independent of the correlation rho. Furthermore, even the distribution of z Subscript r is not strictly normal, it tends to normality rapidly as the sample size increases for any values of rho (Fisher 1973, pp. 200–201).

For the null hypothesis upper H 0 colon rho equals rho 0, the p-values are computed by treating

z Subscript r Baseline minus zeta 0 minus StartFraction rho 0 Over 2 left-parenthesis n minus 1 right-parenthesis EndFraction

as a normal random variable with mean zero and variance 1 slash left-parenthesis n minus 3 right-parenthesis, where zeta 0 equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis rho 0 right-parenthesis (Fisher 1973, p. 207; Anderson 1984, p. 123).

Note that the bias adjustment, rho 0 slash left-parenthesis 2 left-parenthesis n minus 1 right-parenthesis right-parenthesis, is always used when computing p-values under the null hypothesis upper H 0 colon rho equals rho 0 in the CORR procedure.

The ALPHA= option in the FISHER option specifies the value alpha for the confidence level 1 minus alpha, the RHO0= option specifies the value rho 0 in the hypothesis upper H 0 colon rho equals rho 0, and the BIASADJ= option specifies whether the bias adjustment is to be used for the confidence limits.

The TYPE= option specifies the type of confidence limits. The TYPE=TWOSIDED option requests two-sided confidence limits and a p-value under the hypothesis upper H 0 colon rho equals rho 0. For a one-sided confidence limit, the TYPE=LOWER option requests a lower confidence limit and a p-value under the hypothesis upper H 0 colon rho less-than equals rho 0, and the TYPE=UPPER option requests an upper confidence limit and a p-value under the hypothesis upper H 0 colon rho greater-than equals rho 0.

Confidence Limits for the Correlation

The confidence limits for the correlation rho are derived through the confidence limits for the parameter zeta, with or without the bias adjustment.

Without a bias adjustment, confidence limits for zeta are computed by treating

z Subscript r Baseline minus zeta

as having a normal distribution with mean zero and variance 1 slash left-parenthesis n minus 3 right-parenthesis.

That is, the two-sided confidence limits for zeta are computed as

zeta Subscript l Baseline equals z Subscript r Baseline minus z Subscript left-parenthesis 1 minus alpha slash 2 right-parenthesis Baseline StartRoot StartFraction 1 Over n minus 3 EndFraction EndRoot
zeta Subscript u Baseline equals z Subscript r Baseline plus z Subscript left-parenthesis 1 minus alpha slash 2 right-parenthesis Baseline StartRoot StartFraction 1 Over n minus 3 EndFraction EndRoot

where z Subscript left-parenthesis 1 minus alpha slash 2 right-parenthesis is the 100 left-parenthesis 1 minus alpha slash 2 right-parenthesis percentage point of the standard normal distribution.

With a bias adjustment, confidence limits for zeta are computed by treating

z Subscript r Baseline minus zeta minus normal b normal i normal a normal s left-parenthesis r right-parenthesis

as having a normal distribution with mean zero and variance 1 slash left-parenthesis n minus 3 right-parenthesis, where the bias adjustment function (Keeping 1962, p. 308) is

normal b normal i normal a normal s left-parenthesis r right-parenthesis equals StartFraction r Over 2 left-parenthesis n minus 1 right-parenthesis EndFraction

That is, the two-sided confidence limits for zeta are computed as

zeta Subscript l Baseline equals z Subscript r Baseline minus normal b normal i normal a normal s left-parenthesis r right-parenthesis minus z Subscript left-parenthesis 1 minus alpha slash 2 right-parenthesis Baseline StartRoot StartFraction 1 Over n minus 3 EndFraction EndRoot
zeta Subscript u Baseline equals z Subscript r Baseline minus normal b normal i normal a normal s left-parenthesis r right-parenthesis plus z Subscript left-parenthesis 1 minus alpha slash 2 right-parenthesis Baseline StartRoot StartFraction 1 Over n minus 3 EndFraction EndRoot

These computed confidence limits of zeta Subscript l and zeta Subscript u are then transformed back to derive the confidence limits for the correlation rho:

r Subscript l Baseline equals hyperbolic tangent left-parenthesis zeta Subscript l Baseline right-parenthesis equals StartFraction exp left-parenthesis 2 zeta Subscript l Baseline right-parenthesis minus 1 Over exp left-parenthesis 2 zeta Subscript l Baseline right-parenthesis plus 1 EndFraction
r Subscript u Baseline equals hyperbolic tangent left-parenthesis zeta Subscript u Baseline right-parenthesis equals StartFraction exp left-parenthesis 2 zeta Subscript u Baseline right-parenthesis minus 1 Over exp left-parenthesis 2 zeta Subscript u Baseline right-parenthesis plus 1 EndFraction

Note that with a bias adjustment, the CORR procedure also displays the following correlation estimate:

r Subscript normal a normal d normal j Baseline equals hyperbolic tangent left-parenthesis z Subscript r Baseline minus normal b normal i normal a normal s left-parenthesis r right-parenthesis right-parenthesis

Applications of Fisher’s z Transformation

Fisher (1973, p. 199) describes the following practical applications of the z transformation:

  • testing whether a population correlation is equal to a given value

  • testing for equality of two population correlations

  • combining correlation estimates from different samples

To test if a population correlation rho 1 from a sample of n 1 observations with sample correlation r 1 is equal to a given rho 0, first apply the z transformation to r 1 and rho 0: z 1 equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis r 1 right-parenthesis and zeta 0 equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis rho 0 right-parenthesis.

The p-value is then computed by treating

z 1 minus zeta 0 minus StartFraction rho 0 Over 2 left-parenthesis n 1 minus 1 right-parenthesis EndFraction

as a normal random variable with mean zero and variance 1 slash left-parenthesis n 1 minus 3 right-parenthesis.

Assume that sample correlations r 1 and r 2 are computed from two independent samples of n 1 and n 2 observations, respectively. To test whether the two corresponding population correlations, rho 1 and rho 2, are equal, first apply the z transformation to the two sample correlations: z 1 equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis r 1 right-parenthesis and z 2 equals hyperbolic tangent Superscript negative 1 Baseline left-parenthesis r 2 right-parenthesis.

The p-value is derived under the null hypothesis of equal correlation. That is, the difference z 1 minus z 2 is distributed as a normal random variable with mean zero and variance 1 slash left-parenthesis n 1 minus 3 right-parenthesis plus 1 slash left-parenthesis n 2 minus 3 right-parenthesis.

Assuming further that the two samples are from populations with identical correlation, a combined correlation estimate can be computed. The weighted average of the corresponding z values is

z overbar equals StartFraction left-parenthesis n 1 minus 3 right-parenthesis z 1 plus left-parenthesis n 2 minus 3 right-parenthesis z 2 Over n 1 plus n 2 minus 6 EndFraction

where the weights are inversely proportional to their variances.

Thus, a combined correlation estimate is r overbar equals hyperbolic tangent left-parenthesis z overbar right-parenthesis and upper V left-parenthesis z overbar right-parenthesis equals 1 slash left-parenthesis n 1 plus n 2 minus 6 right-parenthesis. See Example 1.4 for further illustrations of these applications.

Note that this approach can be extended to include more than two samples.

Last updated: April 10, 2023