[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [imp-dev] Case-insensitiv lexer - lpg
- From: "Ovidiu Diac" <contact@xxxxxxxxxxxxx>
- Date: Tue, 29 Mar 2011 19:13:00 +0300
- Delivered-to: email@example.com
- Thread-index: AcvuKc/x+8QgLw++R1utPYb9d6n+1AAAUUDw
Ah, yes this is the keywords map. Indeed works great with keywords, but my
problem is with identifiers (member names, variables...) i can't get those
For ex: int A; int a; it should detect it as a redeclaration of A and show
an error, but it doesn't complain about it.
While with keywords, Double, double, DOUblE - are correctly detected as
being the same - double
From: Beverly Sanders [mailto:sanders@xxxxxxxxxxxx]
Sent: Tuesday, March 29, 2011 6:56 PM
To: Ovidiu Diac
Subject: RE: [imp-dev] Case-insensitiv lexer - lpg
Here it is. The $ and % are significant in our language, so you may need to
adjust. Hope it works for you--I'm sure it is very old.
On Tue, March 29, 2011 10:56 am, Ovidiu Diac wrote:
> It would be great if you'd send it to me.
> I checked the repository and didn't find it there.
> -----Original Message-----
> From: imp-dev-bounces@xxxxxxxxxxx [mailto:imp-dev-bounces@xxxxxxxxxxx]
> On Behalf Of Beverly Sanders
> Sent: Tuesday, March 29, 2011 5:39 PM
> To: IMP Developers List
> Subject: Re: [imp-dev] Case-insensitiv lexer - lpg
> Our language is case insensitive. We use a file called
> LexerFoldedCaseMap.gi with entries like
> tokenKind['A'] = $prefix$a$suffix$;
> tokenKind['B'] = $prefix$b$suffix$;
> tokenKind['C'] = $prefix$c$suffix$;
> This works for us. I think I found LexerFoldedCaseMap.gi in the
> imp/lpg distribution somewhere, but if you want me to send you a copy,
> (I have no idea what the $sym_type. in Bob's suggestion is.) Beverly
> On Tue, March 29, 2011 10:07 am, Robert M. Fuhrer wrote:
>> Hi Ovidiu,
>> I'm cc'ing Philippe Charles, the main author of LPG, in case he has
>> something to add.
>> I think you need to use a modified copy of the LexerBasicMapF.gi
>> include file to effect the case-folding you're looking for.
>> Specifically, to fold everything to lower-case, find the
>> letter-related entries in the tokenKind array that look like:
>> $sym_type.$prefix$A$suffix$, // 065 0x41
>> $sym_type.$prefix$B$suffix$, // 066 0x42
>> $sym_type.$prefix$C$suffix$, // 067 0x43
>> and replace them with their lower-case equivalents:
>> $sym_type.$prefix$a$suffix$, // 097 0x61
>> $sym_type.$prefix$b$suffix$, // 098 0x62
>> $sym_type.$prefix$c$suffix$, // 099 0x63
>> I haven't actually tried this myself, but I believe it should work.
>> On Mar 29, 2011, at 9:26 AM, Ovidiu Diac wrote:
>>> I'm currently working on an ide for a Java-like scripting language.
>>> The problem i have is that this script is supposed to be
>>> I managed to make the keywords case-insensitive by using the
>>> KWLexerFoldedCaseMapF.gi include in KWLexer but i don't know what to
>>> do about identifiers. - i'm using the lpg parser Any help is much
>>> Ovidiu Diac
>>> imp-dev mailing list
>> -- Bob
>> Robert M. Fuhrer
>> Research Staff Member
>> Programming Technologies Dept.
>> IBM T.J. Watson Research Center
>> IMP Team Lead (http://www.eclipse.org/imp)
>> X10: Productivity for High-Performance Parallel Programming
>> imp-dev mailing list
> Beverly A. Sanders, Ph.D.
> Associate Professor
> Department of Computer & Information Science & Engineering P.O. Box
> 116120 University of Florida Gainesville, FL 32611-6120
> tel: (352) 450-9213
> fax: (352) 392-1220
> imp-dev mailing list
Beverly A. Sanders, Ph.D.
Department of Computer & Information Science & Engineering P.O. Box 116120
University of Florida Gainesville, FL 32611-6120 www.cise.ufl.edu/~sanders
tel: (352) 450-9213
fax: (352) 392-1220