Bug 221370 - Language pack builder needs to convert UTF-8 to escaped unicode
Summary: Language pack builder needs to convert UTF-8 to escaped unicode
Status: RESOLVED FIXED
Alias: None
Product: Babel
Classification: Technology
Component: Server (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: Babel server inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2008-03-04 13:23 EST by Denis Roy CLA
Modified: 2008-04-08 13:30 EDT (History)
1 user (show)

See Also:


Attachments
Screenshot of preferences, Russian and Arabic (43.07 KB, image/jpeg)
2008-03-04 15:33 EST, Denis Roy CLA
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Denis Roy CLA 2008-03-04 13:23:48 EST
As per Daniel's message on babel-dev:

http://www-306.ibm.com/software/globalization/topics/dev_java/lesson1.jsp
Keep in mind that property files must be written using Latin-1 and/or Unicode escape sequence characters. native2ascii, which comes with Java SDK, converts files which contain other character encodings into the format above.

http://java.sun.com/javase/6/docs/api/java/util/Properties.html
Characters that cannot be directly represented in this encoding [ISO 8859-1]can be written using Unicode escapes ; only a single 'u' character is allowed in an escape sequence. The native2ascii tool can be used to convert property files to and from other character encodings.
Comment 1 Denis Roy CLA 2008-03-04 15:08:50 EST
I've committed a fix for this.  Looks like our jsons library can do this.  I'm generating a test update site now.

generate1.php > 1.12
Comment 2 Denis Roy CLA 2008-03-04 15:33:12 EST
Created attachment 91565 [details]
Screenshot of preferences, Russian and Arabic

This looks much better.

I created a staging area update site for testing.  Not all the language packs work  as not all the files/strings are on the staging area, but Russian, Arabic and Spanish are known to work.

http://build.eclipse.org/technology/babel/test-updates/

This fix will be live in the next code deployment.
Comment 3 Denis Roy CLA 2008-03-06 09:00:35 EST
Released > R_0_200803051327
Comment 4 Denis Roy CLA 2008-04-08 13:30:54 EDT
Released > R_0_200804081317