Bug 269193 - [perfs] Comment should be removed on 'Draw on a window' test
Summary: [perfs] Comment should be removed on 'Draw on a window' test
Status: RESOLVED WONTFIX
Alias: None
Product: Platform
Classification: Eclipse Project
Component: SWT (show other bugs)
Version: 3.5   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.5 M7   Edit
Assignee: Kevin Barnes CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks: 270824
  Show dependency tree
 
Reported: 2009-03-18 10:27 EDT by Frederic Fusier CLA
Modified: 2009-04-28 12:45 EDT (History)
4 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2009-03-18 10:27:12 EDT
Verifying performance results for I20090317-1029, I see that there's a regression on 'Draw on a window' on Win/XP machine. The test results is currently grayed in the fingerprint with the following comment:
'Regression due to a issue on the Releng test machine'

If I remember well, this comment was added to explain a regression occurring on a 3.4 test machine but was incorrectly released in HEAD stream. So, it should be removed now or changed to a new reason (e.g. looking at history, surely a repeatability problem).
Comment 1 Kevin Barnes CLA 2009-03-18 11:13:26 EDT
It's only repeatable on the releng test machine. When I run the test locally I get consistent results. 
Furthermore, the results on the releng test machine don't make sense to me. The mean result there is 14.39 seconds, but on my XP box (a much slower machine) the Elapsed time is 1.12-1.15 seconds. How come this test runs so slowly on the test machine? How are the tests run on the releng machine? What kind of video card does that machine have? Is there a screen saver or something else running that is preventing windows from drawing properly?

Comment 2 Frederic Fusier CLA 2009-03-18 11:21:44 EDT
(In reply to comment #1)
> It's only repeatable on the releng test machine. When I run the test locally I
> get consistent results. 
> Furthermore, the results on the releng test machine don't make sense to me. The
> mean result there is 14.39 seconds, but on my XP box (a much slower machine)
> the Elapsed time is 1.12-1.15 seconds. How come this test runs so slowly on the
> test machine? How are the tests run on the releng machine? What kind of video
> card does that machine have? Is there a screen saver or something else running
> that is preventing windows from drawing properly?
> 
Kim, would it be possible that some background processes were running on the XP machine polluting the results?
 
Comment 3 Kevin Barnes CLA 2009-03-18 11:28:55 EDT
The linux test machines are much faster also.
SLED: 	1.04s
RHEL:   1.93s
Comment 4 Frederic Fusier CLA 2009-04-28 12:11:47 EDT
(In reply to comment #3)
> The linux test machines are much faster also.
> SLED:   1.04s
> RHEL:   1.93s
> 
Kevin, can you reproduce the same differences locally (i.e. while running this test from an eclipse session)?
Comment 5 Kevin Barnes CLA 2009-04-28 12:13:31 EDT
That is how I run the tests
Comment 6 Frederic Fusier CLA 2009-04-28 12:45:47 EDT
ok. I hoped that when the Windows releng machine was cleaned a little while ago, this test would go back to normal, but it seems not to be the case.

So, I guess we could keep the test commented and close this bug...