The base.StringTokenizer class is designed to parse a string to extract tokens
according to delimiters.
The steps to use a string tokenizer are:
- Define a variable with the base.StringTokenizer type.
- Create the string tokenizer object with one of the create methods, passing the string to be parsed as parameter.
- Optionally, cound the number of tokens with countTokens() before processing.
- Use a WHILE loop to process the different tokens, by using hasMoreTokens()
as loop condition and nextToken() inside the loop body to get the next token.