Bug 267941 - [perfs] Possible regression on 'Code assist in expression' test
Summary: [perfs] Possible regression on 'Code assist in expression' test
Status: VERIFIED FIXED
Alias: None
Product: JDT
Classification: Eclipse Project
Component: Core (show other bugs)
Version: 3.5   Edit
Hardware: PC Linux-GTK
: P3 normal (vote)
Target Milestone: 3.5 M6   Edit
Assignee: Frederic Fusier CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-03-10 14:35 EDT by Frederic Fusier CLA
Modified: 2009-03-12 12:15 EDT (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2009-03-10 14:35:02 EDT
The perf results verification for I2009030รง-0100 build shows that a
regression may have occurred for  FullSourceWorkspaceCompletionTests#testPerfCompleteMemberAccess()
scenario since I20090224-0800 build.

It's only clear on one machine (REHL 5.0), the test is really unstable on other
machines, hence the regression cannot be confirmed.

Here are the numbers for REHL 5.0 machine since 3.5M5:
        builds          Codeassist in expression
M5      I20090202-1535	-2.30%
	I20090203-1200	-2.20%
	N20090205-2000	-2.60%
	I20090210-0950	-0.30%
	N20090212-2000	-0.80%
	I20090217-2200	1.40%
	N20090219-2000	0.50%
	N20090221-2000	-5.40%
	I20090224-0800	-1.60%
	N20090226-2000	-13.00%
	N20090228-2000	-2.10%
	I20090303-0800	-12.60%
	N20090305-2000	-2.50%
	N20090307-2000	-1.00%
	I20090308-2000	-1.10%
	I20090309-0100	-13.30%
Comment 1 Frederic Fusier CLA 2009-03-10 14:36:30 EDT
May be related to bug 250454 which also implies regression in JDT/UI test(s) (see bug 266886)?
Comment 2 Frederic Fusier CLA 2009-03-10 14:43:25 EDT
Note that even when regression is 17%, the additional time is around 100ms and may be we can also live with it...

So, as it was done for bug 266886, I'll also add a comment on the test for M6...
Comment 3 Frederic Fusier CLA 2009-03-10 14:43:51 EDT
Released for 3.5M6 in HEAD stream.
Comment 4 David Audel CLA 2009-03-12 12:15:27 EDT
Verified for 3.6M6