Bug 206500

Summary: Regression in performance test "Layout Composites"
Product: [Eclipse Project] Platform Reporter: Frederic Fusier <frederic_fusier>
Component: SWTAssignee: Bogdan Gheorghe <gheorghe>
Status: RESOLVED WONTFIX QA Contact:
Severity: minor    
Priority: P3 CC: steve_northover
Version: 3.3Keywords: performance, test
Target Milestone: 3.4.2   
Hardware: PC   
OS: All   
Whiteboard:

Description Frederic Fusier CLA 2007-10-16 12:52:55 EDT
org.eclipse.swt.test.Layout Composites test shows negative numbers on Linux performance test boxes since build N20070819-0010:
 - RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB): between -1.6% and -8.5%
 - RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB): between -3.4% and -14.7%
 - RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB): between +0.2% and -8.3%

The standard error of this test is OK (always below the 3% threshold), hence
confirms this regression which needs to be investigated.

Note that test duration is between 1s and 1.6s approx. and so, this
regression may not be noticeable by users => open with minor severity
Comment 1 Steve Northover CLA 2008-01-22 18:25:18 EST
Let's investigate.
Comment 2 Frederic Fusier CLA 2008-01-30 10:09:25 EST
In fact, it does not seem specific to Linux boxes as it's almost negative on Windows boxes as well.

Here are the intervals since 3.4M3:
Win XP Sun 1.4.2_10 (3 GHz 2 GB):   between -0.3% and -8.9%
Win XP Sun 1.4.2_10 (2 GHz 512 MB): between +1.7% and -9.6%
Comment 3 Frederic Fusier CLA 2009-03-18 10:56:04 EDT
Close as WONTFIX as there won't be more performance tests on 3.4...