Description David Audel 2005-10-11 11:06:20 EDT

build I20050928-1300 + jdtcore head

In the method Scanner#getNextToken() at line 1212, the lookahead loop haven't
the same behavior with "\u004Ca\n" as with "\u004Ca\n\u0022 (\u004C=Z \u0022=")
and that's seems strange. In both case an InvalidInputException is thrown but
currentPosition is not the same and i don't find why. The algorithm looks
strange but i didn't find a visible bug.

Another question is why this code is reach only if the first character is an
unicode ?

---------------------------------------------------------------
if (isUnicode) {
  int start = this.currentPosition;
  for (int lookAhead = 0; lookAhead < 50; lookAhead++) {
    if (this.currentPosition >= this.eofPosition) {
      this.currentPosition = start;
      break;
    }
    if (((this.currentCharacter = this.source[this.currentPosition++]) == '\\')
&& (this.source[this.currentPosition] == 'u')) {
      isUnicode = true;
      getNextUnicodeChar();
    } else {
      isUnicode = false;
    }
    if (!isUnicode && this.currentCharacter == '\n') {
      this.currentPosition--; // set current position on new line character
      break;
    }
    if (this.currentCharacter == '\"') {
      throw new InvalidInputException(INVALID_CHAR_IN_STRING);
    }
  }
} else {
  this.currentPosition--; // set current position on new line character
}
throw new InvalidInputException(INVALID_CHAR_IN_STRING);