Bug 269191 - [perfs] Some fingerprint tests does not last enough
Summary: [perfs] Some fingerprint tests does not last enough
Status: VERIFIED FIXED
Alias: None
Product: PDE
Classification: Eclipse Project
Component: UI (show other bugs)
Version: 3.5   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.5 M7   Edit
Assignee: PDE-UI-Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks: 270824
  Show dependency tree
 
Reported: 2009-03-18 10:17 EDT by Frederic Fusier CLA
Modified: 2009-05-06 05:33 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2009-03-18 10:17:14 EDT 
Verifying I20090317-1029 performance results, I saw a big regression on test
SchemaTraversePerfTest#testSchemaTraverse(). However, it happens only once and on only one machine, so I didn't intend to open a bug for this regression...

But... looking more closely to the test numbers, it appears that this only lasts 28ms on the XP machine, 24ms and 21ms on the linux ones. This is not enough, the minimum for the elapsed process should be at least 100ms to be significant...

Note that the test SchemaLoaderPerfTest#testSchemaAbbreviated() has the same problem: 27ms, 24ms and 22ms respectively on windows and linux boxes...

So, either change the number of iterations done in the loop to increase the time or remove these two tests from the fingerprints.
Comment 1 Frederic Fusier CLA 2009-04-28 12:19:11 EDT 
Please remove these two tests from the fingerprints if there's no time to change their behavior before M7, thanks
Comment 2 Darin Wright CLA 2009-04-28 12:40:07 EDT 
Removed from fingerprint.
Comment 3 Frederic Fusier CLA 2009-05-06 05:33:10 EDT 
Verified for M7 with I20090430-2300 results