Side note: Tokenizing
P | N


"First parse into words"

| aString |

aString := 'Now is the time for all good men to come to the aid of their blah blah blah'.

aString findTokens: ' '.

"--> OrderedCollection ('Now' 'is' 'the' 'time' 'for' 'all' 'good' 'men' 'to' 'come' 'to' 'the' 'aid' 'of' 'their' 'blah' 'blah' 'blah' )"


Previous | Next


Last modified at 7/24/97; 1:43:43 PM
Other Links of Interest
College of Computing | EduTech Institute | GVU Center
Mark Guzdial | Papers | CS 2390 Spring '97 Home Page | STABLE | MMC-CaMILE

Slide Master