Bug 198895 - [misc] LineTrackerPerformanceTest is run twice while running jdt.text performance tests
Summary: [misc] LineTrackerPerformanceTest is run twice while running jdt.text perform...
Status: VERIFIED FIXED
Alias: None
Product: JDT
Classification: Eclipse Project
Component: Text (show other bugs)
Version: 3.3   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.4 M1   Edit
Assignee: JDT-Text-Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2007-08-05 13:20 EDT by Frederic Fusier CLA
Modified: 2007-08-09 06:15 EDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2007-08-05 13:20:29 EDT 
LineTrackerPerformanceTest is defined both in PerformanceTestSuite and DocumentPerformanceTestSuite test suites. As test.xml launches both of these test suites, LineTrackerPerformanceTest is run twice during JDT/Text performance tests.

I do not know if this is really intentional, but currently the performance framework does not really support this kind of pattern while computing the tests statistics.

See StatisticsSessions line 160:
       stats.stddev= stdevSum / aggregateCount; // XXX this does not work! have to treat multiple runs like normal measurement data

I also agree that this does not work and so, until this bug is fixed in the performance framewotrk, such duplicate run should be avoided...
Comment 1 Dani Megert CLA 2007-08-06 03:11:21 EDT 
Did you file a bug report against the perf framwork?

Fixed in HEAD.
Available in builds > I20070806-0010.
Comment 2 Dani Megert CLA 2007-08-06 03:24:25 EDT 
Backported to perf_33x.
Comment 3 Frederic Fusier CLA 2007-08-06 12:43:19 EDT 
(In reply to comment #1)
> Did you file a bug report against the perf framwork?
> 
I've opened bug 198957 for this problem in the performance framework.
Comment 4 Dani Megert CLA 2007-08-09 03:32:00 EDT 
Frédéric, can you verify that bug. Thanks.
Comment 5 Frederic Fusier CLA 2007-08-09 06:15:15 EDT 
Verified for 3.4M1 by looking at releng database content: there's only one set of data for each variation since I20070806-0010...