TEXTMINE Procedure

This example uses the data table that is generated in Example 41.1. The following statements run PROC TEXTMINE to parse the documents. Because the NOTAGGING option is not specified in the PARSE statement, the procedure uses context clues to determine a term’s part of speech.

/* create data table */
data mylib.CarNominations;
infile datalines delimiter='|' missover;
length text $70 ;
input text$ i;
datalines;
   The Ford Taurus is the World Car of the Year. |1
   Hyundai won the award last year. |2
   Toyota sold the Toyota Tacoma in bright green. |3
   The Ford Taurus is sold in all colors except for lime green. |4
   The Honda Insight was World Car of the Year in 2008. |5
   ;
run;

proc textmine data=mylib.CarNominations;
doc_id i;
var text;
parse
   termwgt   = none
   cellwgt   = none
   reducef   = 1
   entities  = std
   outparent = mylib.outparent
   outterms  = mylib.outterms
   outchild  = mylib.outchild
   ;
run;
data outterms; set mylib.outterms; run;
proc print data= outterms; run;

Output 41.4.1 shows the contents of the mylib.outterms data table. As in Output 41.3.1, the mylib.outterms data table contains the part-of-speech tag for the terms.