Bug 298934 - NonInitialTypingTest#testTypeAMethod() results are not reliable
Summary: NonInitialTypingTest#testTypeAMethod() results are not reliable
Status: RESOLVED FIXED
Alias: None
Product: JDT
Classification: Eclipse Project
Component: Text (show other bugs)
Version: 3.6   Edit
Hardware: All All
: P4 minor (vote)
Target Milestone: 3.6 M7   Edit
Assignee: Dani Megert CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance, test
Depends on:
Blocks: 286955
  Show dependency tree
 
Reported: 2010-01-06 06:30 EST by Frederic Fusier CLA
Modified: 2010-05-21 07:01 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2010-01-06 06:30:33 EST 
Verifying performance results for all 3.6M4 scenarios, it appears that results for NonInitialTypingTest#testTypeAMethod() test are completely unreliable (at least on Linux test machines).

It seems that something should be done to stabilize this test or remove it from the benchmark.
Comment 1 Dani Megert CLA 2010-01-06 06:38:35 EST 
Time permitting.
Comment 2 Frederic Fusier CLA 2010-01-06 06:58:04 EST 
I see also the same unreliability for TextNonInitialTypingTest#testTypeAMethod() test...
Comment 3 Dani Megert CLA 2010-04-13 10:31:39 EDT 
>(at least on Linux test machines).
Yes, we know - it's like that for years that's why we've taken it out of the fingerprint.

I have increased the runs to make it a bit more stable but I don't want to remove it completely.

Fixed in HEAD and perf_35x.