[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [imp-dev] Case-insensitiv lexer - lpg

No. i'm looking at this now.
Just so to know that i'm looking in the right place, i'm checking
SymbolTableVisitor. I think this is where the table of symbols is built. Is
this correct?


-----Original Message-----
From: Beverly Sanders [mailto:sanders@xxxxxxxxxxxx] 
Sent: Tuesday, March 29, 2011 7:48 PM
To: Ovidiu Diac
Cc: sanders@xxxxxxxxxxxx; 'IMP Developers List'
Subject: RE: [imp-dev] Case-insensitiv lexer - lpg


Did you try converting names to lower case when inserting or looking up in
the symbol table?

On Tue, March 29, 2011 12:13 pm, Ovidiu Diac wrote:
> Ah, yes this is the keywords map. Indeed works great with keywords, but my
> problem is with identifiers (member names, variables...) i can't get those
> to work
> For ex: int A; int a; it should detect it as a redeclaration of A and show
> an error, but it doesn't complain about it.
> While with keywords, Double, double, DOUblE - are correctly detected as
> being the same - double
>
> Thanks
>
> -----Original Message-----
> From: Beverly Sanders [mailto:sanders@xxxxxxxxxxxx]
> Sent: Tuesday, March 29, 2011 6:56 PM
> To: Ovidiu Diac
> Subject: RE: [imp-dev] Case-insensitiv lexer - lpg
>
> Here it is.  The $ and % are significant in our language, so you may need
> to
> adjust.  Hope it works for you--I'm sure it is very old.
>
>
> On Tue, March 29, 2011 10:56 am, Ovidiu Diac wrote:
>> It would be great if you'd send it to me.
>> I checked the repository and didn't find it there.
>>
>> Thanks,
>> Ovidiu
>>
>> -----Original Message-----
>> From: imp-dev-bounces@xxxxxxxxxxx [mailto:imp-dev-bounces@xxxxxxxxxxx]
>> On Behalf Of Beverly Sanders
>> Sent: Tuesday, March 29, 2011 5:39 PM
>> To: IMP Developers List
>> Subject: Re: [imp-dev] Case-insensitiv lexer - lpg
>>
>> Our language is case insensitive.  We use a file called
>> LexerFoldedCaseMap.gi with entries like
>>
>>             tokenKind['A'] = $prefix$a$suffix$;
>>             tokenKind['B'] = $prefix$b$suffix$;
>>             tokenKind['C'] = $prefix$c$suffix$;
>>
>> This works for us.  I think I found LexerFoldedCaseMap.gi in the
>> imp/lpg distribution somewhere, but if you want me to send you a copy,
> just ask.
>> (I have no idea what the $sym_type. in Bob's suggestion is.) Beverly
>>
>> On Tue, March 29, 2011 10:07 am, Robert M. Fuhrer wrote:
>>> Hi Ovidiu,
>>>
>>> I'm cc'ing Philippe Charles, the main author of LPG, in case he has
>>> something to add.
>>>
>>> I think you need to use a modified copy of the LexerBasicMapF.gi
>>> include file to effect the case-folding you're looking for.
>>>
>>> Specifically, to fold everything to lower-case, find the
>>> letter-related entries in the tokenKind[] array that look like:
>>>
>>>             $sym_type.$prefix$A$suffix$,               // 065    0x41
>>>             $sym_type.$prefix$B$suffix$,               // 066    0x42
>>>             $sym_type.$prefix$C$suffix$,               // 067    0x43
>>>             ...
>>>
>>> and replace them with their lower-case equivalents:
>>>
>>>             $sym_type.$prefix$a$suffix$,               // 097    0x61
>>>             $sym_type.$prefix$b$suffix$,               // 098    0x62
>>>             $sym_type.$prefix$c$suffix$,               // 099    0x63
>>>             ...
>>>
>>> I haven't actually tried this myself, but I believe it should work.
>>>
>>> On Mar 29, 2011, at 9:26 AM, Ovidiu Diac wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm currently working on an ide for a Java-like scripting language.
>>>> The problem i have is that this script is supposed to be
> case-insensitive.
>>>> I managed to make the keywords case-insensitive by using the
>>>> KWLexerFoldedCaseMapF.gi include in KWLexer but i don't know what to
>>>> do about identifiers. - i'm using the lpg parser Any help is much
>>>> appreciated.
>>>> Thanks,
>>>> Ovidiu Diac
>>>>
>>>> _______________________________________________
>>>> imp-dev mailing list
>>>> imp-dev@xxxxxxxxxxx
>>>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>>
>>> --
>>> Cheers,
>>>   -- Bob
>>> --------------------------------
>>> Robert M. Fuhrer
>>> Research Staff Member
>>> Programming Technologies Dept.
>>> IBM T.J. Watson Research Center
>>>
>>> IMP Team Lead (http://www.eclipse.org/imp)
>>> X10: Productivity for High-Performance Parallel Programming
>>> (http://x10-lang.org)
>>>
>>> _______________________________________________
>>> imp-dev mailing list
>>> imp-dev@xxxxxxxxxxx
>>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>>
>>
>>
>> --
>> Beverly A. Sanders, Ph.D.
>> Associate Professor
>> Department of Computer & Information Science & Engineering P.O. Box
>> 116120 University of Florida Gainesville, FL 32611-6120
>> www.cise.ufl.edu/~sanders
>> tel: (352) 450-9213
>> fax: (352) 392-1220
>>
>> _______________________________________________
>> imp-dev mailing list
>> imp-dev@xxxxxxxxxxx
>> https://dev.eclipse.org/mailman/listinfo/imp-dev
>>
>>
>
>
> --
> Beverly A. Sanders, Ph.D.
> Associate Professor
> Department of Computer & Information Science & Engineering P.O. Box 116120
> University of Florida Gainesville, FL 32611-6120 www.cise.ufl.edu/~sanders
> tel: (352) 450-9213
> fax: (352) 392-1220
>
>


-- 
Beverly A. Sanders, Ph.D.
Associate Professor
Department of Computer & Information Science & Engineering
P.O. Box 116120
University of Florida
Gainesville, FL 32611-6120
www.cise.ufl.edu/~sanders
tel: (352) 450-9213
fax: (352) 392-1220