Re: [imp-dev] Case-insensitiv lexer - lpg

["Ovidiu Diac" <contact@xxxxxxxxxxxxx>]

Ah, yes this is the keywords map. Indeed works great with keywords, but my
problem is with identifiers (member names, variables...) i can't get those
to work
For ex: int A; int a; it should detect it as a redeclaration of A and show
an error, but it doesn't complain about it.
While with keywords, Double, double, DOUblE - are correctly detected as
being the same - double

Thanks

-----Original Message-----
From: Beverly Sanders [mailto:sanders@xxxxxxxxxxxx] 
Sent: Tuesday, March 29, 2011 6:56 PM
To: Ovidiu Diac
Subject: RE: [imp-dev] Case-insensitiv lexer - lpg

Here it is.  The $ and % are significant in our language, so you may need to
adjust.  Hope it works for you--I'm sure it is very old.


On Tue, March 29, 2011 10:56 am, Ovidiu Diac wrote:
> It would be great if you'd send it to me.
> I checked the repository and didn't find it there.
>
> Thanks,
> Ovidiu
>
> -----Original Message-----
> From: imp-dev-bounces@xxxxxxxxxxx [mailto:imp-dev-bounces@xxxxxxxxxxx] 
> On Behalf Of Beverly Sanders
> Sent: Tuesday, March 29, 2011 5:39 PM
> To: IMP Developers List
> Subject: Re: [imp-dev] Case-insensitiv lexer - lpg
>
> Our language is case insensitive.  We use a file called 
> LexerFoldedCaseMap.gi with entries like
>
>             tokenKind['A'] = $prefix$a$suffix$;
>             tokenKind['B'] = $prefix$b$suffix$;
>             tokenKind['C'] = $prefix$c$suffix$;
>
> This works for us.  I think I found LexerFoldedCaseMap.gi in the 
> imp/lpg distribution somewhere, but if you want me to send you a copy,
just ask.
> (I have no idea what the $sym_type. in Bob's suggestion is.) Beverly
>
> On Tue, March 29, 2011 10:07 am, Robert M. Fuhrer wrote:
>> Hi Ovidiu,
>>
>> I'm cc'ing Philippe Charles, the main author of LPG, in case he has 
>> something to add.
>>
>> I think you need to use a modified copy of the LexerBasicMapF.gi 
>> include file to effect the case-folding you're looking for.
>>
>> Specifically, to fold everything to lower-case, find the 
>> letter-related entries in the tokenKind[] array that look like:
>>
>>             $sym_type.$prefix$A$suffix$,               // 065    0x41
>>             $sym_type.$prefix$B$suffix$,               // 066    0x42
>>             $sym_type.$prefix$C$suffix$,               // 067    0x43
>>             ...
>>
>> and replace them with their lower-case equivalents:
>>
>>             $sym_type.$prefix$a$suffix$,               // 097    0x61
>>             $sym_type.$prefix$b$suffix$,               // 098    0x62
>>             $sym_type.$prefix$c$suffix$,               // 099    0x63
>>             ...
>>
>> I haven't actually tried this myself, but I believe it should work.
>>
>> On Mar 29, 2011, at 9:26 AM, Ovidiu Diac wrote:
>>
>>> Hi,
>>>
>>> I'm currently working on an ide for a Java-like scripting language. 
>>> The problem i have is that this script is supposed to be
case-insensitive.
>>> I managed to make the keywords case-insensitive by using the 
>>> KWLexerFoldedCaseMapF.gi include in KWLexer but i don't know what to 
>>> do about identifiers. - i'm using the lpg parser Any help is much 
>>> appreciated.
>>> Thanks,
>>> Ovidiu Diac
>>>
>>> _______________________________________________
>>> imp-dev mailing list
>>> imp-dev@xxxxxxxxxxx
>>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>
>> --
>> Cheers,
>>   -- Bob
>> --------------------------------
>> Robert M. Fuhrer
>> Research Staff Member
>> Programming Technologies Dept.
>> IBM T.J. Watson Research Center
>>
>> IMP Team Lead (http://www.eclipse.org/imp)
>> X10: Productivity for High-Performance Parallel Programming
>> (http://x10-lang.org)
>>
>> _______________________________________________
>> imp-dev mailing list
>> imp-dev@xxxxxxxxxxx
>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>
>
>
> --
> Beverly A. Sanders, Ph.D.
> Associate Professor
> Department of Computer & Information Science & Engineering P.O. Box 
> 116120 University of Florida Gainesville, FL 32611-6120 
> www.cise.ufl.edu/~sanders
> tel: (352) 450-9213
> fax: (352) 392-1220
>
> _______________________________________________
> imp-dev mailing list
> imp-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/imp-dev
>
>


--
Beverly A. Sanders, Ph.D.
Associate Professor
Department of Computer & Information Science & Engineering P.O. Box 116120
University of Florida Gainesville, FL 32611-6120 www.cise.ufl.edu/~sanders
tel: (352) 450-9213
fax: (352) 392-1220