The TEXTMINE Procedure

This example uses the data table that is generated in Example 24.1. The following statements run PROC TEXTMINE to parse the documents. Because the NOSTEMMING option is not specified in the PARSE statement, words are stemmed (the default).

/* create data table */
data mycas.CarNominations;
infile datalines delimiter='|' missover;
length text $70 ;
input text$ i;
datalines;
   The Ford Taurus is the World Car of the Year. |1
   Hyundai won the award last year. |2
   Toyota sold the Toyota Tacoma in bright green. |3
   The Ford Taurus is sold in all colors except for lime green. |4
   The Honda Insight was World Car of the Year in 2008. |5
   ;
run;

proc textmine data=mycas.CarNominations;
doc_id i;
var text;
parse
   notagging nonoungroups
   termwgt  = none
   cellwgt  = none
   reducef  = 1
   entities = none
   outparent= mycas.outparent
   outterms = mycas.outterms
   outchild = mycas.outchild
   outconfig= mycas.outconfig
   ;
run;
data outterms; set mycas.outterms; run;
proc print data = outterms; run;

Output 24.2.1 shows the content of the mycas.outterms data table. In this example, words are stemmed. You can see that the term "sold" now stems to the parent term "sell." Also, the mycas.outparent data table and the mycas.outchild data table are different. The parent term "sell" shows up in mycas.outparent (key=11), but not the child term "sold" (key=27). Only "sold" appears in the mycas.outchild data table, and "sell" does not appear.