[platform-releng-dev] Questions/Remarks about 3.1 M6 JDT/Core performanc

[Frederic Fusier <frederic_fusier@xxxxxxxxxx>]

I was just looking at 3.1 M6 performance results
(http://fullmoon.torolab.ibm.com/downloads/drops/S-3.1
M6-200504011645/performance/org.eclipse.jdt.core.php?)
and have several remarks/questions about them.

1) New tests on Scanner and Parser
We added these tests last week. We expect them to reflect a
performance increase around 30% regarding to 3.0 version.
Unfortunately, it seems that last Friday, 3.0 reference was not
rebuilt and results are negative :-(.
Would it be possible to make this reference as soon as possible
and update JDT/Core performance results page to be able to see
the *real* deltas for these tests?

Waiting for this 3.0 rebuild, I wonder why same tests with same code
(no change has been done for Scanner and Parser since tests creation)
produce deltas going from -2.6% to +7.2% (ie. dispersion near 10%).
Does it means that precision for performance tests is not better
than 10%? Or is there any issue with test box during last week?

2) Full source workspace build without comment
I do not understand why there's no 3.0 reference on Win/XP test box
although there's one on RHEL one?
What does 3.0_200406250800_200412241024 mean?

3) Difference between 2 test boxes
It seems that Win/XP results have changed a lot since last week and
do not really match reality. I wonder what happens on this machine?
Perhaps is there any change on it or something wrong happens during
reference 3.0 build which makes these results inaccurate?
Do you have any clue on this?

Cordialement/Regards,

Frédéric