Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [platform-releng-dev] Status of the performance test project

Hi David,

Thanks for your detailed answer and sorry about taking so long to come back to you. I've just recently had time to look at the performance test and really I think it's very interested. It does about 90% of what we want it to do (the core part that is, the .ui plug-in has a lot of hard-coded values and I couldn't make it work at all [yet] for our project).

We'd like to use it to keep track of the performance of our project (linuxtools-lttng), possibly on our own hardware, but the students working with us will also want to use it to get performance statistics from different version of their algorithms. They will have some more needs, like keeping the results of all iterations, not just average and standard deviation.

Can we contribute to the org.eclipse.test.performance and org.eclipse.test.performance.ui plug-ins? Will patches be reviewed in good time? The "degree of support" worries me a bit. And is this the right place to discuss these plugins or should I bring this discussion to another mailing list?

Thanks,

--
Geneviève Bastien
Research Associate
École Polytechnique de Montréal

On 03/31/2014 11:06 PM, David M Williams wrote:
You are correct we have not used in a few years. But, it is our intent to again.

That said, it's "degree of support" has never been great.  See, for example, this old bug from 2008,
Bug 246613 - [results] performance test plugin has hard coded values specific to Platform

That bug's history is not all bad news ... its just not great news. In an ideal world some interested parties could join forces and improve that to the point it could become part of "CBI" or similar ... but, I honestly do not know how much work that would be, or if there are other or better alternatives, or "more trouble than its worth"?

You obviously found org.eclipse.test.performance but its companion org.eclipse.test.performance.ui may not be so easy to find.
It is now in the platform/eclipse.platform.releng.buildtools repository. We don't currently build it, and it has some minor compile or pre-req issues, last I had time to look, 2 years ago.

I know there is definitely others interested: Matthias Mailänder recently moved the "how to" html from the plugin, to the wiki (bug 390820).
Its currently at https://wiki.eclipse.org/Performance/Automated_Tests

There is an "umbrella bug" that tracks many other "to do" items, see bug 374441.

This is an area I plan to work on soon, so if others are too, would love to hear what you've learned ... or you might contribute or at least comment in bug 374441.

Sorry I don't have more specifics at the moment. Glad to hear you think it might be useful.

Thanks,








From:        Geneviève Bastien <gbastien+lttng@xxxxxxxxxxxx>
To:        platform-releng-dev@xxxxxxxxxxx,
Date:        03/31/2014 08:34 PM
Subject:        [platform-releng-dev] Status of the performance test project
Sent by:        platform-releng-dev-bounces@xxxxxxxxxxx




Hi all,

I am a developer on the linuxtools Eclipse plug-in and I am looking into
a way to make automatic benchmarks for some parts of the application and
save the results to be able to see how the application develops.

I was looking at the org.eclipse.test.performance plugin, which sounds
about right for our needs. But I see it hasn't been developed much in
the last few years. Is it still supported? Or has something else
replaced it for performance testing and keeping (and eventually
visualizing) benchmark data?

Thanks,
Geneviève Bastien
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev




_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev


Back to the top