Hi David,
Thanks for your detailed answer and sorry about taking so long to
come back to you. I've just recently had time to look at the
performance test and really I think it's very interested. It does
about 90% of what we want it to do (the core part that is, the .ui
plug-in has a lot of hard-coded values and I couldn't make it work
at all [yet] for our project).
We'd like to use it to keep track of the performance of our
project (linuxtools-lttng), possibly on our own hardware, but the
students working with us will also want to use it to get
performance statistics from different version of their algorithms.
They will have some more needs, like keeping the results of all
iterations, not just average and standard deviation.
Can we contribute to the org.eclipse.test.performance and
org.eclipse.test.performance.ui plug-ins? Will patches be reviewed
in good time? The "degree of support" worries me a bit. And is
this the right place to discuss these plugins or should I bring
this discussion to another mailing list?
Thanks,
--
Geneviève Bastien
Research Associate
École Polytechnique de Montréal
On 03/31/2014 11:06 PM, David M Williams wrote:
You are correct we
have not used in a few
years. But, it is our intent to again.
That said, it's "degree of
support"
has never been great. See, for example, this old bug from 2008,
Bug 246613
- [results] performance test plugin has hard coded values
specific to Platform
That bug's history is not all bad
news
... its just not great news. In an ideal world some interested
parties
could join forces and improve that to the point it could become
part of
"CBI" or similar ... but, I honestly do not know how much work
that would be, or if there are other or better alternatives, or
"more
trouble than its worth"?
You obviously found org.eclipse.test.performance
but its companion org.eclipse.test.performance.ui
may not be so easy
to find.
It is now in the platform/eclipse.platform.releng.buildtools
repository. We
don't currently
build it, and it has some minor compile or pre-req issues, last
I had time
to look, 2 years ago.
I know there is definitely others
interested:
Matthias Mailänder recently moved the "how to" html from the
plugin, to the wiki (bug
390820).
Its currently at https://wiki.eclipse.org/Performance/Automated_Tests
There is an "umbrella bug"
that tracks many other "to do" items, see bug 374441.
This is an area I plan to work on
soon,
so if others are too, would love to hear what you've learned ...
or you
might contribute or at least comment in bug 374441.
Sorry I don't have more specifics
at
the moment. Glad to hear you think it might be useful.
Thanks,
From:
Geneviève Bastien
<gbastien+lttng@xxxxxxxxxxxx>
To:
platform-releng-dev@xxxxxxxxxxx,
Date:
03/31/2014 08:34 PM
Subject:
[platform-releng-dev]
Status of the performance test project
Sent by:
platform-releng-dev-bounces@xxxxxxxxxxx
Hi all,
I am a developer on the linuxtools Eclipse plug-in and I am
looking into
a way to make automatic benchmarks for some parts of the
application and
save the results to be able to see how the application
develops.
I was looking at the org.eclipse.test.performance plugin,
which sounds
about right for our needs. But I see it hasn't been developed
much in
the last few years. Is it still supported? Or has something
else
replaced it for performance testing and keeping (and
eventually
visualizing) benchmark data?
Thanks,
Geneviève Bastien
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
|