The CORR Procedure

Confidence and Prediction Ellipses

When the relationship between two variables is nonlinear or when outliers are present, the correlation coefficient might incorrectly estimate the strength of the relationship. Plotting the data enables you to verify the linear relationship and to identify the potential outliers.

The partial correlation between two variables, after controlling for variables in the PARTIAL statement, is the correlation between the residuals of the linear regression of the two variables on the partialled variables. Thus, if a PARTIAL statement is also specified, the residuals of the analysis variables are displayed in the scatter plot matrix and scatter plots.

The CORR procedure optionally provides two types of ellipses for each pair of variables in a scatter plot. One is a confidence ellipse for the population mean, and the other is a prediction ellipse for a new observation. Both assume a bivariate normal distribution.

Let bold upper Z overbar and bold upper S be the sample mean and sample covariance matrix of a random sample of size n from a bivariate normal distribution with mean bold-italic mu and covariance matrix bold upper Sigma. The variable bold upper Z overbar minus bold-italic mu is distributed as a bivariate normal variate with mean zero and covariance left-parenthesis 1 slash n right-parenthesis bold upper Sigma, and it is independent of bold upper S. Using Hotelling’s upper T squared statistic, which is defined as

upper T squared equals n left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis prime bold upper S Superscript negative 1 Baseline left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis

a 100 left-parenthesis 1 minus alpha right-parenthesis percent-sign confidence ellipse for bold-italic mu is computed from the equation

StartFraction n Over n minus 1 EndFraction left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis prime bold upper S Superscript negative 1 Baseline left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis equals StartFraction 2 Over n minus 2 EndFraction upper F Subscript 2 comma n minus 2 Baseline left-parenthesis 1 minus alpha right-parenthesis

where upper F Subscript 2 comma n minus 2 Baseline left-parenthesis 1 minus alpha right-parenthesis is the left-parenthesis 1 minus alpha right-parenthesis critical value of an F distribution with degrees of freedom 2 and n-2.

A prediction ellipse is a region for predicting a new observation in the population. It also approximates a region that contains a specified percentage of the population.

Denote a new observation as the bivariate random variable bold upper Z Subscript normal n normal e normal w. The variable

bold upper Z Subscript normal n normal e normal w Baseline minus bold upper Z overbar equals left-parenthesis bold upper Z Subscript normal n normal e normal w Baseline minus bold-italic mu right-parenthesis minus left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis

is distributed as a bivariate normal variate with mean zero (the zero vector) and covariance left-parenthesis 1 plus 1 slash n right-parenthesis bold upper Sigma, and it is independent of bold upper S. A 100 left-parenthesis 1 minus alpha right-parenthesis percent-sign prediction ellipse is then given by the equation

StartFraction n Over n minus 1 EndFraction left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis prime bold upper S Superscript negative 1 Baseline left-parenthesis bold upper Z overbar minus bold-italic mu right-parenthesis equals StartFraction 2 left-parenthesis n plus 1 right-parenthesis Over n minus 2 EndFraction upper F Subscript 2 comma n minus 2 Baseline left-parenthesis 1 minus alpha right-parenthesis

The family of ellipses generated by different critical values of the F distribution has a common center (the sample mean) and common major and minor axis directions.

The shape of an ellipse depends on the aspect ratio of the plot. The ellipse indicates the correlation between the two variables if the variables are standardized (by dividing the variables by their respective standard deviations). In this situation, the ratio between the major and minor axis lengths is

StartRoot StartFraction 1 plus StartAbsoluteValue r EndAbsoluteValue Over 1 minus StartAbsoluteValue r EndAbsoluteValue EndFraction EndRoot

In particular, if r=0, the ratio is 1, which corresponds to a circular confidence contour and indicates that the variables are uncorrelated. A larger value of the ratio indicates a larger positive or negative correlation between the variables.

Last updated: November 06, 2022