Bug 365846 - [performance] Performance regression in OpenManifestEditorPerfTest#testEditorOpenMF()
Summary: [performance] Performance regression in OpenManifestEditorPerfTest#testEditor...
Status: RESOLVED WONTFIX
Alias: None
Product: PDE
Classification: Eclipse Project
Component: UI (show other bugs)
Version: 3.8   Edit
Hardware: PC Windows 7
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: PDE-UI-Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance
Depends on:
Blocks: 348419
  Show dependency tree
 
Reported: 2011-12-07 04:28 EST by Satyam Kandula CLA
Modified: 2012-07-19 03:02 EDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Satyam Kandula CLA 2011-12-07 04:28:04 EST
There is ~15% preformance regression in OpenManifestEditorPerfTest#testEditorOpenMF() noticed only on windows.
Comment 1 Curtis Windatt CLA 2011-12-07 12:18:17 EST
We haven't made any changes to the editor that would account for this.  Marking for M5 to do a bit more investigation,
Comment 2 Curtis Windatt CLA 2012-01-17 17:42:55 EST
We did not make any changes to the editor and do not have the resources to investigate further.  Closing as WONTFIX.
Comment 3 Dani Megert CLA 2012-01-18 03:58:07 EST
Deepak, please take a look during M6.
Comment 4 Curtis Windatt CLA 2012-04-26 17:35:28 EDT
Deepak, please reopen if you plan to look at this.
Comment 5 Deepak Azad CLA 2012-04-27 00:27:47 EDT
I will take a look during RC1.
Comment 6 Deepak Azad CLA 2012-05-10 13:16:42 EDT
The test seems to have an interesting history on Windows...

It slowed down significantly in 3.6 - http://archive.eclipse.org/eclipse/downloads/drops/R-3.6-201006080911/performance/org.eclipse.pde.ui.php?fp_type=0

but then it improved significantly in 3.7 (probably back to 3.5 level) - http://fullmoon.ottawa.ibm.com/downloads/drops/R-3.7-201106131736/performance/org.eclipse.pde.ui.php?fp_type=0

Unfortunately for 3.8 the test results for windows seem to be missing on the downloads page -
http://fullmoon.ottawa.ibm.com/downloads/drops/S-3.8M4-201112091447/performance/org.eclipse.pde.ui.php?fp_type=0

http://fullmoon.ottawa.ibm.com/downloads/drops/I20120320-0800/performance/org.eclipse.pde.ui.php?fp_type=0
Comment 7 Dani Megert CLA 2012-05-11 02:18:47 EDT
> Unfortunately for 3.8 the test results for windows seem to be missing on the
> downloads page -

Simply run them locally and compare.
Comment 8 Deepak Azad CLA 2012-05-14 06:19:02 EDT
I do see a small slowdown in 3.8

With Master
Elapsed Process:         255ms        (95% in [249ms, 261ms])

3.7.1
Elapsed Process:         227ms        (95% in [221ms, 233ms])
Comment 9 Deepak Azad CLA 2012-05-16 03:03:42 EDT
I ran the test with all miletsone builds, and there seems to be a gradual slowdown, once around M3 and then around M6/M7

3.7
Elapsed Process:         156ms        (95% in [154ms, 158ms])        Measurable effect: 3ms (0.2 SDs)

M3 
Elapsed Process:         167ms        (95% in [165ms, 169ms])        Measurable effect: 4ms (0.2 SDs)

M6
Elapsed Process:         170ms        (95% in [168ms, 172ms])        Measurable effect: 3ms (0.2 SDs)

M7
Elapsed Process:         179ms        (95% in [177ms, 181ms])        Measurable effect: 3ms (0.2 SDs)

(Note: I increased the number of test runs from 25 to 500 to increase the accuracy)
Comment 10 Michael Rennie CLA 2012-05-18 11:27:41 EDT
Not sure if we will get to this in 3.8/4.2, the slowdown is not much. Deepak, if you think you will have time to get to it for RC2 feel free to to set milestone as needed.
Comment 11 Deepak Azad CLA 2012-07-18 09:44:55 EDT
Slowdown is not much. We can close this as WONTFIX. Dani?
Comment 12 Dani Megert CLA 2012-07-19 03:02:41 EDT
(In reply to comment #11)
> Slowdown is not much. We can close this as WONTFIX. Dani?

Agreed.