Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
[cross-project-issues-dev] Scalability tests and execution time measurements on Hudson

Hi,

the simultaneous release page, http://eclipse.org/indigo/planning/EclipseSimultaneousRelease.php, describes the following requirement :

"Performance. Project should have measurable performance criteria that are regularly tested against. Projects should devote at least one milestone to performance and scalability improvements."

We have some non reg scalability tests dealing with memory usage for some of our components (MoDisco project) and we are thinking about additional tests for execution time non regression. We are asking ourselves how a relevant time measurement can be done on continuous integration on Hudson ... Hudson CPU availability is inconstant depending on use made from the different eclipse project teams, so one "basic" execution time measurement (using System.currentTimeMillis()) has no meaning.


Has anyone met this kind of problem ? Does the eclipse architecture council have some recommendations about that (did not find in http://wiki.eclipse.org/Architecture_Council/Top_Ten_Project_Development_Practices) ?


Fabien Giquel.

Back to the top