ENTROPY Procedure(Experimental)

Analyzing Multinomial Response Data

Multinomial discrete choice models suffer the same problems with collinearity of the regressors and small sample sizes as linear models. Unordered multinomial discrete choice models can be estimated using a variant of GME for discrete models called GME-D.

Consider the model shown in Golan, Judge, and Perloff (1996). In this model, there are five occupational categories, and the categories are considered a function of four individual characteristics. The sample contains 337 individuals.

title "Analyzing Multinomial Response Data";
data kpdata;
   input job x1 x2 x3 x4;
datalines;
   0 1 3 11 1

   ... more lines ...   

The dependent variable in these data, job, takes on values 0 through 4. Support points are used only for the error terms; so error supports are specified in the MODEL statement.

proc entropy data=kpdata gmed tech=nra;
   model job = x1 x2 x3 x4 / noint
         esupports=( -.1 -0.0666 -0.0333 0 0.0333 0.0666 .1 );
run;

Figure 20: Estimate of Jobs Model by Using GME-D

Analyzing Multinomial Response Data

The ENTROPY Procedure

GME-D Variable Estimates
VariableEstimateApprox Std Errt ValueApprox
Pr > |t|
x1_11.8025721.36101.320.1863
x2_1-0.002510.0154-0.160.8705
x3_1-0.172820.0885-1.950.0517
x4_11.0546590.69861.510.1321
x1_20.0891561.27640.070.9444
x2_20.0199470.01461.370.1718
x3_20.0107160.08300.130.8974
x4_20.2886290.57750.500.6176
x1_3-4.620471.6476-2.800.0053
x2_30.0261750.01661.580.1157
x3_30.2451980.09862.490.0134
x4_31.2854660.83671.540.1254
x1_4-9.727341.5813-6.15<.0001
x2_40.0273820.01561.750.0805
x3_40.6608360.09476.98<.0001
x4_41.474790.69702.120.0351


Note there are five estimates of the parameters produced for each regressor, one for each choice. The first choice is restricted to zero for normalization purposes. PROC ENTROPY drops the zeroed regressors. PROC ENTROPY also generates tables of marginal effects for each regressor. The following statements generate the marginal effects table for the previous analysis at the means of the variables:

proc entropy data=kpdata gmed tech=nra;
   model job = x1 x2 x3 x4 / noint
         esupports=( -.1 -0.0666 -0.0333 0 0.0333 0.0666 .1 )
         marginals;
run;

Figure 21: Estimate of Jobs Model by Using GME-D (Marginals)

Analyzing Multinomial Response Data

The ENTROPY Procedure

GME-D Variable Marginal Effects Table
VariableMarginal EffectMean
x1_00.3387581
x2_0-0.001920.50148
x3_0-0.0212913.09496
x4_0-0.099170.916914
x1_10.8598831
x2_1-0.0034520.50148
x3_1-0.064813.09496
x4_10.0343960.916914
x1_20.861011
x2_20.00096320.50148
x3_2-0.0494813.09496
x4_2-0.162970.916914
x1_3-0.259691
x2_30.001520.50148
x3_30.00928913.09496
x4_30.0655690.916914
x1_4-1.799961
x2_40.0028820.50148
x3_40.12628313.09496
x4_40.1621720.916914


The marginals are derivatives of the probabilities with respect to each variable and so summarize how a small change in each variable affects the overall probability.

PROC ENTROPY also enables the user to specify where the derivative is evaluated, as follows:

proc entropy data=kpdata gmed tech=nra;
   model job = x1 x2 x3 x4 / noint
         esupports=( -.1 -0.0666 -0.0333 0 0.0333 0.0666 .1 )
         marginals=( x2=.4 x3=10 x4=0);
run;

Figure 22: Estimate of Jobs Model by Using GME-D (Marginals)

Analyzing Multinomial Response Data

The ENTROPY Procedure

GME-D Variable Marginal Effects Table
VariableMarginal EffectMeanMarginal Effect
at User Supplied
Values
User Supplied
Values
x1_00.3387581-0.09011
x2_0-0.001920.50148-0.002170.4
x3_0-0.0212913.094960.00958610
x4_0-0.099170.916914-0.142040
x1_10.85988310.4631811
x2_1-0.0034520.50148-0.003110.4
x3_1-0.064813.09496-0.0433910
x4_10.0343960.9169140.1748760
x1_20.861011-0.078941
x2_20.00096320.501480.0044050.4
x3_2-0.0494813.094960.01555510
x4_2-0.162970.916914-0.0720
x1_3-0.259691-0.164591
x2_30.001520.501480.0006230.4
x3_30.00928913.094960.0092910
x4_30.0655690.9169140.026480
x1_4-1.799961-0.129551
x2_40.0028820.501480.0002560.4
x3_40.12628313.094960.00895610
x4_40.1621720.9169140.0126840


In this example, you evaluate the derivative when x1=1, x2=0.4, x3=10, and x4=0. If the user neglects a variable, PROC ENTROPY uses its mean value.

Last updated: June 19, 2025