Community
Participate
Working Groups
When a scanner is created to tokenize whitespaces, it may return incorrect whitespaces if unicode characters are used. For example, if a source contains \u003b (which is ';'), the scanner will report '\u003' as a whitespace. This is wrong.
Fixed and released in 2.1 stream. Regression tests added.
Verified.