When you tokenize a string entered by the user and the string contains characters other than white spaces as delimiters, you do not need to trim the string before tokenizing it.

Question

Quizplus · Accepted Answer

If the string contains non-white space characters as delimiters, then those characters should be removed or replaced with a valid delimiter before tokenizing the string. If the string is not trimmed or cleaned beforehand, it may result in invalid tokens or errors during tokenization.

When You Tokenize a String Entered by the User and the String