Bug 178499

Summary:

[perfs] JDT/Core model performances tests must be improved

Product:

[Eclipse Project] JDT

Reporter:

Frederic Fusier <frederic_fusier>

Component:

Core

Assignee:

Frederic Fusier <frederic_fusier>

Status:

VERIFIED FIXED

QA Contact:

Severity:

normal

Priority:

CC:

eric_jodet, jerome_lanneluc

Version:

3.3

Keywords:

performance

Target Milestone:

3.3 M7

Hardware:

OS:

Windows XP

Whiteboard:

Attachments:

Description	Flags
Additional tests on HEAD stream	none
Corresponding patch for perf_32x branch	none
Complete patch on top of v_746	none
Complete corresponding patch for perf_32x branch	none
New patch for perf_32x branch	none
New patch on top of v_746	none

Description Frederic Fusier

2007-03-21 05:13:14 EDT

Some of tests in FullSourceWorkspaceModelTests run in a too small time (around 10ms). According to performance framework, to be measurable and rely on measures, a test should last at least 100ms. So, those tests must be removed from test suite.

Also some additional test will be added to this test suite (test for bug 174920 and startup tests).

Comment 1 Frederic Fusier

2007-03-28 07:51:48 EDT

Created attachment 62213 [details]
Additional tests on HEAD stream

Comment 2 Frederic Fusier

2007-03-28 11:42:10 EDT

Created attachment 62243 [details]
Corresponding patch for perf_32x branch

Comment 3 Frederic Fusier

2007-03-29 13:45:24 EDT

Created attachment 62407 [details]
Complete patch on top of v_746

This patch includes:
 - additional tests closeProjects and startup on model tests
 - tune time for lookup, find type and seek package fragments on model tests
 - remove testFullBuildDefault() from fingerprint 
 - improve all builder tests by removing unnecessary tree lock test
 - improve all compiler tests by removing unnecessary runnable
 - tune iterations on DOM/AST tests
 - fix warmup issue in DOM/AST one file JLS2 test

Comment 4 Frederic Fusier

2007-03-29 13:46:10 EDT

Created attachment 62408 [details]
Complete corresponding patch for perf_32x branch

Comment 5 Frederic Fusier

2007-03-30 07:36:34 EDT

Created attachment 62477 [details]
New patch for perf_32x branch

This patch renames the tests which have been modified as their duration will be really different than previous version...

Released in perf_32x branch which has been versionned as v_671_perf_32xb

Comment 6 Frederic Fusier

2007-03-30 10:43:42 EDT

Created attachment 62499 [details]
New patch on top of v_746

Comment 7 Frederic Fusier

2007-03-30 10:44:07 EDT

Released for 3.3 M7 in HEAD stream.

Comment 8 Frederic Fusier

2007-04-27 13:41:26 EDT

Verified for 3.3M7 using perf results of I20070427-0010. Less tests are yellow and most of them have a standard error lower than 1%.
Note that to verify this bug, perf results were got directly from releng DB as the generation of HTML pages are not finished yet...