Bug 206500 - Regression in performance test "Layout Composites"
Summary: Regression in performance test "Layout Composites"
Status: RESOLVED WONTFIX
Alias: None
Product: Platform
Classification: Eclipse Project
Component: SWT (show other bugs)
Version: 3.3   Edit
Hardware: PC All
: P3 minor (vote)
Target Milestone: 3.4.2   Edit
Assignee: Bogdan Gheorghe CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks:
 
Reported: 2007-10-16 12:52 EDT by Frederic Fusier CLA
Modified: 2009-03-18 10:56 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2007-10-16 12:52:55 EDT 
org.eclipse.swt.test.Layout Composites test shows negative numbers on Linux performance test boxes since build N20070819-0010:
 - RHEL 4.0 Sun 1.4.2_10 (3 GHz 2.5 GB): between -1.6% and -8.5%
 - RHEL 3.0 Sun 1.4.2_10 (3 GHz 2 GB): between -3.4% and -14.7%
 - RHEL 3.0 Sun 1.4.2_10 (2 GHz 512 MB): between +0.2% and -8.3%

The standard error of this test is OK (always below the 3% threshold), hence
confirms this regression which needs to be investigated.

Note that test duration is between 1s and 1.6s approx. and so, this
regression may not be noticeable by users => open with minor severity
Comment 1 Steve Northover CLA 2008-01-22 18:25:18 EST 
Let's investigate.
Comment 2 Frederic Fusier CLA 2008-01-30 10:09:25 EST 
In fact, it does not seem specific to Linux boxes as it's almost negative on Windows boxes as well.

Here are the intervals since 3.4M3:
Win XP Sun 1.4.2_10 (3 GHz 2 GB):   between -0.3% and -8.9%
Win XP Sun 1.4.2_10 (2 GHz 512 MB): between +1.7% and -9.6%
Comment 3 Frederic Fusier CLA 2009-03-18 10:56:04 EDT 
Close as WONTFIX as there won't be more performance tests on 3.4...