The base.StringTokenizer class is designed to parse a string to
extract tokens according to delimiters.
The steps to use a string tokenizer are:
- Define a variable with the base.StringTokenizer type.
- Create the string tokenizer object with one of the create methods, passing the string to be parsed as parameter.
- Optionally, count the number of tokens with countTokens() before
processing.
- Use a WHILE loop to process the different tokens, by using hasMoreTokens()
as loop condition and nextToken() inside the loop body to get the next token.