Bug 282012 - [Build] Core LRG: 256Mb object allocation requires increase from 512 to 1024 Mb or 2048 on 64-bit JVM
Summary: [Build] Core LRG: 256Mb object allocation requires increase from 512 to 1024 ...
Status: RESOLVED FIXED
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: Eclipselink (show other bugs)
Version: unspecified   Edit
Hardware: PC Windows Vista
: P3 major (vote)
Target Milestone: ---   Edit
Assignee: Nobody - feel free to take it CLA
QA Contact:
URL: http://wiki.eclipse.org/EclipseLink/B...
Whiteboard:
Keywords: test
Depends on:
Blocks: 286004 295381
  Show dependency tree
 
Reported: 2009-06-30 10:05 EDT by Michael OBrien CLA
Modified: 2022-06-09 10:23 EDT (History)
1 user (show)

See Also:


Attachments
Core LRG build.xml patch to increase maxmemory to 1024 (932 bytes, patch)
2009-06-30 10:11 EDT, Michael OBrien CLA
no flags Details | Diff
Core Test build.xml upgrade from 1024 to 2048 for 64 bit Vista (933 bytes, patch)
2009-09-29 16:19 EDT, Michael OBrien CLA
no flags Details | Diff
jconsole heap memory capture for test-core reaches past 512 but fails on xml report processing on 64 bit JVM without at least 1536 (98.94 KB, image/pjpeg)
2009-09-30 09:00 EDT, Michael OBrien CLA
no flags Details
Reduce max ram for test-core from 2048 to 1536 for backwards compatibility with older XP 2GB system (1.15 KB, patch)
2009-10-02 10:19 EDT, Michael OBrien CLA
no flags Details | Diff
Decrease maxmemory to 1024 from 1536 to accomidate 2GB RAM machines - introduce max.heap.memory variable that power users can override (2.33 KB, patch)
2009-10-06 16:03 EDT, Michael OBrien CLA
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Michael OBrien CLA 2009-06-30 10:05:07 EDT
>Problem: For the last couple weeks I noticed that the core-lrg has been failing with an OutOfMemoryError, causing the whole suite to fail.
This does not appear to be JVM or PC related.
JVM=SUN 1.6.0_05 to _10
RAM=4Gb

>Fix: Increase the hardcoded maxmemory from 512 to 1024
>Optionally: add a build.properties variable so that users can change this in the future without modifying the build


>Failed: Core LRG has OutOfMemoryError running with maxmemory="512m"
foundation\eclipselink.core.test\build.xml
    <target name="run-test" depends="process-resource">
        <junit printsummary="yes" failureproperty="junit.failed" fork="yes" showoutput="true" maxmemory="512m" dir="${eclipselink.core.test}/${run.dir}">


C:\view_w342f>ant test-core > 20090630_core_clean.txt
....
    [junit] [EL Info]: 2009-06-30 09:39:56.062--DatabaseSessionImpl(20461199)--Thread(Thread[Main Thread,5,main])-- login successful
    [junit] Test org.eclipse.persistence.testing.tests.TestRunModel FAILED (crashed)
    [junit] Exception in thread "Main Thread" java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 257307144, Num elements: 128653563
    [junit] 	at java.lang.String.<init>(String.java:571)
    [junit] 	at java.lang.String.<init>(String.java:594)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:448)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
    [junit] 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
    [junit] Running org.eclipse.persistence.testing.tests.TestRunModel
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junitreport] Processing C:\view_w342f\foundation\eclipselink.core.test\reports\TESTS-TestSuites.xml to C:\view_w342f\foundation\eclipselink.core.test\reports\junit-noframes.html
[junitreport] Loading stylesheet jar:file:/C:/opt/ant171/lib/ant-junit.jar!/org/apache/tools/ant/taskdefs/optional/junit/xsl/junit-noframes.xsl
[junitreport] Transform time: 1265ms

BUILD SUCCESSFUL
Total time: 33 minutes 17 seconds


>Fixed: Core LRG completes with maxmemory="1024m"
foundation\eclipselink.core.test\build.xml
    <target name="run-test" depends="process-resource">
        <junit printsummary="yes" failureproperty="junit.failed" fork="yes" showoutput="true" maxmemory="1024m" dir="${eclipselink.core.test}/${run.dir}">


    [junit] [EL Info]: 2009-06-29 17:10:28.234--DatabaseSessionImpl(26265111)--Thread(Thread[Main Thread,5,main])-- login successful
    [junit] Tests run: 8731, Failures: 0, Errors: 14, Time elapsed: 3,694.203 sec
    [junit] Test org.eclipse.persistence.testing.tests.TestRunModel FAILED
[junitreport] Processing C:\view_w342e\foundation\eclipselink.core.test\reports\TESTS-TestSuites.xml to C:\view_w342e\foundation\eclipselink.core.test\reports\junit-noframes.html
[junitreport] Loading stylesheet jar:file:/C:/opt/ant171/lib/ant-junit.jar!/org/apache/tools/ant/taskdefs/optional/junit/xsl/junit-noframes.xsl
[junitreport] Transform time: 11063ms

BUILD SUCCESSFUL
Total time: 64 minutes 15 seconds



>Review:
Discussed this in the daily scrum meeting, other developers see the same issue.
Comment 1 Michael OBrien CLA 2009-06-30 10:11:10 EDT
Created attachment 140502 [details]
Core LRG build.xml patch to increase maxmemory to 1024
Comment 2 Michael OBrien CLA 2009-06-30 10:19:23 EDT
>Fixed in 2.0 trunk, see rev# 4586
http://fisheye2.atlassian.com/changelog/eclipselink/?cs=4586
Comment 3 Michael OBrien CLA 2009-08-06 22:51:07 EDT
>getting out-of-memory on an 8GB Corei7 running on Vista 64-bit SP2 on the SUN 1.6.0_14 64-bit JVM after 14 min
One of the JUnit java.exe processes reaches a peak of 1034Mb within a 5GB system peak (2 GB for 32-bit Oracle11)
The JPA lrg runs fine in 7 min

>Fix - increase to 2048 or 1536
    [junit] Tests run: 8831, Failures: 0, Errors: 14, Time elapsed: 742.294 sec
[junitreport] Transform time: 843ms
BUILD SUCCESSFUL
Total time: 12 minutes 25 seconds
Comment 4 Michael OBrien CLA 2009-08-06 22:53:01 EDT
>This issue is likely the fact that double the word length from 32 to 64 bits reduces the effective memory back down to 512.
>we may want to create a test.properties variable for 64 bit JVM users so they can increase beyond 1024GB as needed.
Comment 5 Michael OBrien CLA 2009-09-29 16:19:35 EDT
Created attachment 148364 [details]
Core Test build.xml upgrade from 1024 to 2048 for 64 bit Vista
Comment 6 Michael OBrien CLA 2009-09-30 09:00:27 EDT
Created attachment 148417 [details]
jconsole heap memory capture for test-core reaches past 512 but fails on xml report processing on 64 bit JVM without at least 1536

>jconsole heap memory capture for test-core reaches past 512 but fails on xml report processing on 64 bit JVM without at least 1536

Note: It is not the lack of GC during the test run that fails with an OOM - it is the XML processing by the 64-bit JVM at the end.
Comment 7 Michael OBrien CLA 2009-09-30 10:14:50 EDT
>see SVN rev# 5365
http://fisheye2.atlassian.com/changelog/eclipselink/?cs=5365
Comment 8 Michael OBrien CLA 2009-10-02 10:19:53 EDT
Created attachment 148648 [details]
Reduce max ram for test-core from 2048 to 1536 for backwards compatibility with older XP 2GB system
Comment 9 Michael OBrien CLA 2009-10-02 10:28:58 EDT
>see SVN rev# 5412
http://fisheye2.atlassian.com/changelog/eclipselink/?cs=5412

- reduce max heap ram from 2048 to 1536 to be compatible with some other legacy XP OS machines running 2GB ram
  We avoid the following message on these slower machines during a trunk>ant test-core
    [junit] [WARN ] Unable to acquire some virtual address space - reduced from 2048 to 1908 MB.
Tested on Vista 64 i7 with 12GB and an XP p630 with 2GB
Comment 10 Michael OBrien CLA 2009-10-05 15:40:28 EDT
>See related bug# 291410 for "test-jpa"
Comment 11 Michael OBrien CLA 2009-10-06 15:49:15 EDT
>We are limitied by the 2GB RAM footprint of some of the build servers - this 1536 fix will only run on 4GB XP machines - I am reducing to 1024 and adding a variable for developers to bump it up to 1536 if they get an OOME
Comment 12 Michael OBrien CLA 2009-10-06 16:03:20 EDT
Created attachment 148937 [details]
Decrease maxmemory to 1024 from 1536 to accomidate 2GB RAM machines - introduce max.heap.memory variable that power users can override
Comment 13 Michael OBrien CLA 2009-10-06 16:03:54 EDT
>Reviewed by Yan - running the LRG to test now
Comment 14 Michael OBrien CLA 2009-10-08 10:34:07 EDT
>see SVN rev# 5465
http://fisheye2.atlassian.com/changelog/~author=mobrien/eclipselink/?cs=5465
Comment 15 Michael OBrien CLA 2010-05-17 10:48:12 EDT
>The moxy project will also require heap increase during XML test results generation on lines 356,381,403,443,485,538,588 in build.xml off eclipselink.moxy.test.
- another developer is getting the same out of heap message.
Comment 16 Eclipse Webmaster CLA 2022-06-09 10:14:03 EDT
The Eclipselink project has moved to Github: https://github.com/eclipse-ee4j/eclipselink
Comment 17 Eclipse Webmaster CLA 2022-06-09 10:23:10 EDT
The Eclipselink project has moved to Github: https://github.com/eclipse-ee4j/eclipselink