Bug 23181

Summary:	IScanner returns incorrect whitespaces
Product:	[Eclipse Project] JDT	Reporter:	Olivier Thomann <Olivier_Thomann>
Component:	Core	Assignee:	Philipe Mulet <philippe_mulet>
Status:	VERIFIED FIXED	QA Contact:
Severity:	major
Priority:	P3
Version:	2.0
Target Milestone:	2.1 M1
Hardware:	All
OS:	All
Whiteboard:

Description Olivier Thomann

2002-09-04 16:13:11 EDT

When a scanner is created to tokenize whitespaces, it may return incorrect
whitespaces if unicode characters are used.
For example, if a source contains \u003b (which is ';'), the scanner will report
'\u003' as a whitespace. This is wrong.

Comment 1 Olivier Thomann

2002-09-06 10:55:09 EDT

Fixed and released in 2.1 stream. Regression tests added.

Comment 2 David Audel

2002-09-19 09:32:44 EDT

Verified.