Bug 178499 - [perfs] JDT/Core model performances tests must be improved
Summary: [perfs] JDT/Core model performances tests must be improved
Status: VERIFIED FIXED
Alias: None
Product: JDT
Classification: Eclipse Project
Component: Core (show other bugs)
Version: 3.3   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: 3.3 M7   Edit
Assignee: Frederic Fusier CLA
QA Contact:
URL:
Whiteboard:
Keywords: performance
Depends on:
Blocks:
 
Reported: 2007-03-21 05:13 EDT by Frederic Fusier CLA
Modified: 2007-04-27 13:41 EDT (History)
2 users (show)

See Also:

Attachments
Additional tests on HEAD stream (5.35 KB, patch)
2007-03-28 07:51 EDT, Frederic Fusier CLA 		no flags Details | Diff
Corresponding patch for perf_32x branch (5.53 KB, patch)
2007-03-28 11:42 EDT, Frederic Fusier CLA 		no flags Details | Diff
Complete patch on top of v_746 (12.14 KB, patch)
2007-03-29 13:45 EDT, Frederic Fusier CLA 		no flags Details | Diff
Complete corresponding patch for perf_32x branch (12.19 KB, patch)
2007-03-29 13:46 EDT, Frederic Fusier CLA 		no flags Details | Diff
New patch for perf_32x branch (16.24 KB, patch)
2007-03-30 07:36 EDT, Frederic Fusier CLA 		no flags Details | Diff
New patch on top of v_746 (12.48 KB, patch)
2007-03-30 10:43 EDT, Frederic Fusier CLA 		no flags Details | Diff
Show Obsolete (4) View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Frederic Fusier CLA 2007-03-21 05:13:14 EDT 
Some of tests in FullSourceWorkspaceModelTests run in a too small time (around 10ms). According to performance framework, to be measurable and rely on measures, a test should last at least 100ms. So, those tests must be removed from test suite.

Also some additional test will be added to this test suite (test for bug 174920 and startup tests).
Comment 1 Frederic Fusier CLA 2007-03-28 07:51:48 EDT 
Created attachment 62213 [details]
Additional tests on HEAD stream
Comment 2 Frederic Fusier CLA 2007-03-28 11:42:10 EDT 
Created attachment 62243 [details]
Corresponding patch for perf_32x branch
Comment 3 Frederic Fusier CLA 2007-03-29 13:45:24 EDT 
Created attachment 62407 [details]
Complete patch on top of v_746

This patch includes:
 - additional tests closeProjects and startup on model tests
 - tune time for lookup, find type and seek package fragments on model tests
 - remove testFullBuildDefault() from fingerprint 
 - improve all builder tests by removing unnecessary tree lock test
 - improve all compiler tests by removing unnecessary runnable
 - tune iterations on DOM/AST tests
 - fix warmup issue in DOM/AST one file JLS2 test
Comment 4 Frederic Fusier CLA 2007-03-29 13:46:10 EDT 
Created attachment 62408 [details]
Complete corresponding patch for perf_32x branch
Comment 5 Frederic Fusier CLA 2007-03-30 07:36:34 EDT 
Created attachment 62477 [details]
New patch for perf_32x branch

This patch renames the tests which have been modified as their duration will be really different than previous version...

Released in perf_32x branch which has been versionned as v_671_perf_32xb
Comment 6 Frederic Fusier CLA 2007-03-30 10:43:42 EDT 
Created attachment 62499 [details]
New patch on top of v_746
Comment 7 Frederic Fusier CLA 2007-03-30 10:44:07 EDT 
Released for 3.3 M7 in HEAD stream.
Comment 8 Frederic Fusier CLA 2007-04-27 13:41:26 EDT 
Verified for 3.3M7 using perf results of I20070427-0010. Less tests are yellow and most of them have a standard error lower than 1%.
Note that to verify this bug, perf results were got directly from releng DB as the generation of HTML pages are not finished yet...