Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[jdt-core-dev] Re: [platform-releng-dev] Performance re-testing on releases and 3.1 milestones

All tests have been rewritten and now use Elapsed process time instead
of CPU one.
All streams have been updated. Tests sets are not the same between
streams: 28 tests for HEAD, 20 tests for perf_30 and perf_301 and
finally 19 tests for perf_213.
However common tests between 2 streams are identical and so can be
compared.

I just want to highlight the fact that after several days of intensive
tests execution, it appears that this Elapsed process time is less
"reliable" than CPU time.
Standard deviation is often over 5% (sometimes 10%) of average for
Elapsed process although it's only around 1% for CPU time...

Cordialement/Regards,

Frédéric




Back to the top