Bug 22979 - using IScanner inside comments
Summary: using IScanner inside comments
Status: RESOLVED WONTFIX
Alias: None
Product: JDT
Classification: Eclipse Project
Component: Core (show other bugs)
Version: 2.0   Edit
Hardware: PC Windows 2000
: P3 enhancement (vote)
Target Milestone: 2.1 M2   Edit
Assignee: Philipe Mulet CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: 58205
  Show dependency tree
 
Reported: 2002-08-29 10:13 EDT by Adam Kiezun CLA
Modified: 2007-07-24 02:52 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Adam Kiezun CLA 2002-08-29 10:13:42 EDT 
i'd like to be able to feed IScanner with a content of a comment and get access 
to tokens
Comment 1 Philipe Mulet CLA 2002-09-03 04:29:07 EDT 
The scanner is a Java one, and recognize comments as tokens.
Now, you may want to position the scanner behind the comment starting 
delimiter, and tokenize from there. However, the comment content is not meant 
to follow Java specs, and thus illegal tokens are likely to be found in there.

You probably should use a StringTokenizer for this matter.
Comment 2 Adam Kiezun CLA 2002-09-03 04:36:09 EDT 
will that not cause some encoding problems? i mean, IScanner handles all the 
unicode problems. will i have to do it myself when using StringTokenizer?

maybe a separate scanner? IJavaDocScanner :)?
Comment 3 Philipe Mulet CLA 2002-09-23 04:43:22 EDT 
Closing, IScanner isn't meant for parsing comments (unless you know what you're 
doing). Parsing javadocs isn't supported, we have other requests on this front, 
unclear which action we will take.
Comment 4 Philipe Mulet CLA 2003-08-26 08:56:46 EDT 
*** Bug 41190 has been marked as a duplicate of this bug. ***