Specifies the convergence criterion for the LASSO method
The optimization options are fully described in the section Optimization Options in Chapter 3: Shared Concepts. The following list describes the other options available in the PROC LOGSELECT statement:
ALPHA=number
specifies a global significance level for the construction of confidence intervals. The confidence level is 1–number. The value of number must be between 0 and 1. You can override the global specification by specifying the ALPHA= option in the OUTPUT statement. By default, ALPHA=0.05.
ASSOCIATION
displays measures of association between predicted probabilities and observed responses for binary, binomial, and ordinal response models. These measures assess the predictive ability of the model. The displayed statistics are the concordance index c (the area under the ROC curve, AUC), Somers’ D statistic (Gini’s coefficient), the Goodman-Kruskal gamma statistic, and Kendall’s tau-a statistic. These statistics are based on the number of pairs of observations that have different response values, the number of concordant pairs, and the number of discordant pairs. For more information, see the section Association Statistics.
BINEPS=number
specifies the precision to use for the association and classification computations. The predicted probabilities or scores are rounded to the nearest multiple of number, which effectively bins and sorts the observations. You can specify a number between 0 and 1; if number does not evenly divide the unit interval, then it is reduced to a valid value. By default, BINEPS=1e–5. For more information, see the section Classification Table and ROC Curves.
CORRB
creates the "Parameter Estimates Correlation Matrix" table. The correlation matrix is computed by normalizing the covariance matrix . That is, if is an element of , then the corresponding element of the correlation matrix is , where .
COVB
creates the "Parameter Estimates Covariance Matrix" table. The covariance matrix is computed as the inverse of the negative of the matrix of second derivatives of the log-likelihood function with respect to the model parameters (the Hessian matrix).
CTABLE<(options)>
displays a table for binary or binomial response models that, for a set of probabilities or cutpoints, contains the frequencies of observations that are correctly and incorrectly classified as events and nonevents, and optionally the sensitivity, the 1–specificity, the positive and negative predictive values, the correct classification rate, the error rate, and the lift.
Because the number of cutpoints that are generated from your data can be very large, you can write the classification table to an output data table, or you can specify your own list of cutpoints.
If you specify the PRIOR= option, then the reported predicted probabilities are unchanged, but the statistics that are specified by the keywords PPV, NPV, PC, ACCURACY, MISCLASS, and LIFT are modified.
If you specify a PARTITION statement, then a table is created for each role. If you do not specify the PRIOR= option, then the training proportions are used as the prevalences for computing the statistics that are specified by the keywords PPV, NPV, PC, ACCURACY, MISCLASS, and LIFT for the validation and test data.
requests all the statistics that are listed in Table 11.2.
CUTPT=number-list
specifies cutpoints to include in the classification table.
NOCOUNTS
suppresses the classification table columns that contain the number of true positives, the number of true negatives, the number of false positives, and the number of false negatives.
OUT=CAS-libref.data-table
suppresses the display of the classification table and names the output data table in which to store the classification table. CAS-libref.data-table is a two-level name, where CAS-libref refers to the caslib and session identifier, and data-table specifies the name of the output data table. For more information about this two-level name, see the DATA= option and the section Using CAS Sessions and CAS Engine Librefs.
keyword <=name>
specifies statistics to include in the classification table and optionally names the statistics. If you do not provide a name, the LOGSELECT procedure uses the keyword as the name. Table 11.2 lists the available keywords.
Table 11.2: CTABLE Option Keywords
Keyword
Description
ACCURACY
Requests and names the accuracy
FNF
Requests and names the false negative fraction
FPF
Requests and names the false positive fraction. Also called 1–specificity.
LIFT
Requests and names the lift
MISCLASS
Requests and names the misclassification rate. Also called the error rate.
NPV
Requests and names the negative predictive value
PC
Requests and names the proportion classified correctly
PPV
Requests and names the positive predictive value. Also called the precision.
TNF
Requests and names the true negative fraction. Also called the specificity.
TPF
Requests and names the true positive fraction. Also called the sensitivity or recall.
DATA=CAS-libref.data-table
names the input data table for PROC LOGSELECT to use. The default is the most recently created data table. CAS-libref.data-table is a two-level name, where
CAS-libref
refers to a collection of information that is defined in the LIBNAME statement and includes the caslib, which includes a path to the data, and a session identifier, which defaults to the active session but which can be explicitly defined in the LIBNAME statement. For more information about CAS-libref, see the section Using CAS Sessions and CAS Engine Librefs.
data-table
specifies the name of the input data table.
ITHIST
generates the "Iteration History" table.
LASSORHO=r
specifies the base regularization parameter for the LASSO model selection method. The regularization parameter for step i is r. By default, LASSORHO=0.8.
LASSOSTEPS=n
specifies the maximum number of steps for LASSO model selection. By default, LASSOSTEPS=20.
LASSOTOL=r
specifies the convergence tolerance for the optimization algorithm that solves for the LASSO parameter estimates at each step of LASSO model selection. By default, LASSOTOL=1E–6.
NOCHECK
disables the checking process that determines whether maximum likelihood estimates of the regression parameters exist. For more information, see the section Existence of Maximum Likelihood Estimates.
NOCLPRINT<=number>
suppresses the display of the "Class Level Information" table if you do not specify number. If you specify number, the values of the classification variables are displayed for only those variables whose number of levels is less than number. Specifying number helps to reduce the size of the "Class Level Information" table if some classification variables have a large number of levels.
NOSTDERR
suppresses computation of the covariance matrix and the standard errors of the regression coefficients. When the model contains many variables (thousands), the inversion of the Hessian matrix to derive the covariance matrix and the standard errors of the regression coefficients can be time-consuming. The CORRB, COVB, and TYPE3 options are not available when the NOSTDERR option is specified. This option also disables the quasi-complete separation check; for more information, see the section Existence of Maximum Likelihood Estimates.
PAGEOBS=number | AUTO
MAXOPTBATCH=number | AUTO
specifies the maximum number of observations to be included in a batch. During the optimization, the LOGSELECT procedure reads at most number observations from the data table into memory, performs the appropriate log-likelihood, gradient, and Hessian computations on that batch of observations, then discards those observations and reads in the next batch of data for processing. Generally, a smaller number decreases memory usage but might lead to longer computation times, whereas a larger number might lead to shorter computation times but increases memory usage. The default PAGEOBS=AUTO option determines whether the entire data table can be conveniently held in memory; if it cannot, then number is set to 256. For more information, see the section Memory Usage.
PARTFIT
displays fit statistics in the "Fit Statistics" table that are usually produced when your data are partitioned. This option is not required when you specify a PARTITION statement.
The additional statistics include the R-square, the adjusted R-square, McFadden’s R-square, the average square error (Brier score), the misclassification rate, the null-model log likelihood, and the difference in means.
STB
displays the standardized estimates of the parameters in the "Parameter Estimates" table. The standardized estimate of is given by , where is the total sample standard deviation for the ith explanatory variable and
The sample standard deviations for parameters that are associated with CLASS variables are computed using their codings. The standardized estimates are not computed for the intercept parameters.