Bug 99445 - investigate build performance test failures
Summary: investigate build performance test failures
Status: RESOLVED WORKSFORME
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Ant (show other bugs)
Version: 3.1   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: Kevin Barnes CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance
Depends on:
Blocks:
 
Reported: 2005-06-10 15:18 EDT by Kevin Barnes CLA
Modified: 2006-03-11 00:24 EST (History)
1 user (show)

See Also:


Attachments
performance test using regular java class (5.04 KB, patch)
2005-06-10 17:44 EDT, Kevin Barnes CLA
no flags Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Kevin Barnes CLA 2005-06-10 15:18:26 EDT
SeparateVMTests.testBuild and testBuildMinusDebug have been failing. Need to 
make them pass or explain the failures.
Comment 1 Kevin Barnes CLA 2005-06-10 15:26:39 EDT
changes made to the ant test suite during 3.1 improved the reliability of the 
tests, but made them run slower in some cases. See bug #82598.

Specifically, in the 3.0 test suite, a launched build file does not always 
wait for the console to complete before proceding, in the 3.1 test suite the 
test always wait for the console closed notification.

This may account for some of 3.1 test failures (or at least contribute to 
those failures)
Comment 2 Kevin Barnes CLA 2005-06-10 15:41:18 EDT
I was wrong. The measured runs do wait for the console closed notification, 
it's only the first unmeasured launch that does not.
Still investigating.
Comment 3 Kevin Barnes CLA 2005-06-10 17:38:36 EDT
launching is slower in 3.1 than it was in 3.0. This is at least partially due to the console. It takes longer to 
create a console than it used to. Have to test enablement expressions for pattern matchers, create pattern 
matchers from extension, and compile the patterns. None this had to be done in 3.0.

(not giving up on making this faster yet)
Comment 4 Kevin Barnes CLA 2005-06-10 17:44:07 EDT
Created attachment 22844 [details]
performance test using regular java class

Launches a HelloWorld type application. Demonstrates 3.1 launching is slower in
general.
Comment 5 Darin Swanson CLA 2006-03-11 00:24:43 EST
We have investigated the performance, made some tweaks.
Time to move on :-)