[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [imp-dev] Case-insensitiv lexer - lpg
|
Did you try converting names to lower case when inserting or looking up in
the symbol table?
On Tue, March 29, 2011 12:13 pm, Ovidiu Diac wrote:
> Ah, yes this is the keywords map. Indeed works great with keywords, but my
> problem is with identifiers (member names, variables...) i can't get those
> to work
> For ex: int A; int a; it should detect it as a redeclaration of A and show
> an error, but it doesn't complain about it.
> While with keywords, Double, double, DOUblE - are correctly detected as
> being the same - double
>
> Thanks
>
> -----Original Message-----
> From: Beverly Sanders [mailto:sanders@xxxxxxxxxxxx]
> Sent: Tuesday, March 29, 2011 6:56 PM
> To: Ovidiu Diac
> Subject: RE: [imp-dev] Case-insensitiv lexer - lpg
>
> Here it is. The $ and % are significant in our language, so you may need
> to
> adjust. Hope it works for you--I'm sure it is very old.
>
>
> On Tue, March 29, 2011 10:56 am, Ovidiu Diac wrote:
>> It would be great if you'd send it to me.
>> I checked the repository and didn't find it there.
>>
>> Thanks,
>> Ovidiu
>>
>> -----Original Message-----
>> From: imp-dev-bounces@xxxxxxxxxxx [mailto:imp-dev-bounces@xxxxxxxxxxx]
>> On Behalf Of Beverly Sanders
>> Sent: Tuesday, March 29, 2011 5:39 PM
>> To: IMP Developers List
>> Subject: Re: [imp-dev] Case-insensitiv lexer - lpg
>>
>> Our language is case insensitive. We use a file called
>> LexerFoldedCaseMap.gi with entries like
>>
>> tokenKind['A'] = $prefix$a$suffix$;
>> tokenKind['B'] = $prefix$b$suffix$;
>> tokenKind['C'] = $prefix$c$suffix$;
>>
>> This works for us. I think I found LexerFoldedCaseMap.gi in the
>> imp/lpg distribution somewhere, but if you want me to send you a copy,
> just ask.
>> (I have no idea what the $sym_type. in Bob's suggestion is.) Beverly
>>
>> On Tue, March 29, 2011 10:07 am, Robert M. Fuhrer wrote:
>>> Hi Ovidiu,
>>>
>>> I'm cc'ing Philippe Charles, the main author of LPG, in case he has
>>> something to add.
>>>
>>> I think you need to use a modified copy of the LexerBasicMapF.gi
>>> include file to effect the case-folding you're looking for.
>>>
>>> Specifically, to fold everything to lower-case, find the
>>> letter-related entries in the tokenKind[] array that look like:
>>>
>>> $sym_type.$prefix$A$suffix$, // 065 0x41
>>> $sym_type.$prefix$B$suffix$, // 066 0x42
>>> $sym_type.$prefix$C$suffix$, // 067 0x43
>>> ...
>>>
>>> and replace them with their lower-case equivalents:
>>>
>>> $sym_type.$prefix$a$suffix$, // 097 0x61
>>> $sym_type.$prefix$b$suffix$, // 098 0x62
>>> $sym_type.$prefix$c$suffix$, // 099 0x63
>>> ...
>>>
>>> I haven't actually tried this myself, but I believe it should work.
>>>
>>> On Mar 29, 2011, at 9:26 AM, Ovidiu Diac wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm currently working on an ide for a Java-like scripting language.
>>>> The problem i have is that this script is supposed to be
> case-insensitive.
>>>> I managed to make the keywords case-insensitive by using the
>>>> KWLexerFoldedCaseMapF.gi include in KWLexer but i don't know what to
>>>> do about identifiers. - i'm using the lpg parser Any help is much
>>>> appreciated.
>>>> Thanks,
>>>> Ovidiu Diac
>>>>
>>>> _______________________________________________
>>>> imp-dev mailing list
>>>> imp-dev@xxxxxxxxxxx
>>>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>>
>>> --
>>> Cheers,
>>> -- Bob
>>> --------------------------------
>>> Robert M. Fuhrer
>>> Research Staff Member
>>> Programming Technologies Dept.
>>> IBM T.J. Watson Research Center
>>>
>>> IMP Team Lead (http://www.eclipse.org/imp)
>>> X10: Productivity for High-Performance Parallel Programming
>>> (http://x10-lang.org)
>>>
>>> _______________________________________________
>>> imp-dev mailing list
>>> imp-dev@xxxxxxxxxxx
>>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>>
>>
>>
>> --
>> Beverly A. Sanders, Ph.D.
>> Associate Professor
>> Department of Computer & Information Science & Engineering P.O. Box
>> 116120 University of Florida Gainesville, FL 32611-6120
>> www.cise.ufl.edu/~sanders
>> tel: (352) 450-9213
>> fax: (352) 392-1220
>>
>> _______________________________________________
>> imp-dev mailing list
>> imp-dev@xxxxxxxxxxx
>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>
>>
>
>
> --
> Beverly A. Sanders, Ph.D.
> Associate Professor
> Department of Computer & Information Science & Engineering P.O. Box 116120
> University of Florida Gainesville, FL 32611-6120 www.cise.ufl.edu/~sanders
> tel: (352) 450-9213
> fax: (352) 392-1220
>
>
--
Beverly A. Sanders, Ph.D.
Associate Professor
Department of Computer & Information Science & Engineering
P.O. Box 116120
University of Florida
Gainesville, FL 32611-6120
www.cise.ufl.edu/~sanders
tel: (352) 450-9213
fax: (352) 392-1220
