Sounds very reasonable!
I don't have any patches yet, but it will mostly be for collecting
the data, analyzing and visualizing it I think. I found no need
for improvement in the running itself. I think we'll work on it on
and off in the upcoming weeks/months, so you might expect some
patches "soon".
Thanks,
On 04/22/2014 10:46 AM, David M Williams wrote:
I was afraid you'd
ask that :)
I was dreaming you'd learn how to
run
those too.
I still hope to "get them
running"
before long ... may not be fully collecting and analyzing data,
but to
get them to run should be that hard.
Are your patches more related to
"running
them" ... or more with the "data collected" and how analyzed?
Not sure what your anticipated
time-line
is, but if you are "ready to go right now", I'd give you the
benefit of doubt, if, via code inspection, the patches seemed
general purpose.
I would imagine any improvements would benefit us too, so fully
support
the effort.
But, would need your continued
help
if/when I found changes needed once I got ours running.
Sound reasonable?
From:
Geneviève Bastien
<gbastien+lttng@xxxxxxxxxxxx>
To:
platform-releng-dev@xxxxxxxxxxx,
Date:
04/22/2014 09:48 AM
Subject:
Re:
[platform-releng-dev]
Status of the performance test project
Sent by:
platform-releng-dev-bounces@xxxxxxxxxxx
I do not have the full platform code to test. How
can
I easily test that patches do not break anything for the
Platform performance
tests. I thought they were not run anymore.
Thanks,
On 04/22/2014 09:39 AM, David M Williams wrote:
Patches would be most welcome. I
was
trying to make the point that it's not supported "as much" as
the Platform itself.
Naturally, demonstrating the patches not only work for you, but
also (still)
work for Eclipse Platform would be important. For some patches,
that might
be obvious? But, for others, it might require someone having
some test
cases, or demonstrating the performance tests for the Platform
still work.
Thanks,
From: Geneviève
Bastien <gbastien+lttng@xxxxxxxxxxxx>
To: platform-releng-dev@xxxxxxxxxxx,
Date: 04/22/2014
09:33 AM
Subject: Re:
[platform-releng-dev] Status of the performance test project
Sent by: platform-releng-dev-bounces@xxxxxxxxxxx
Hi David,
Thanks for your detailed answer and sorry about taking so long
to come
back to you. I've just recently had time to look at the
performance test
and really I think it's very interested. It does about 90% of
what we want
it to do (the core part that is, the .ui plug-in has a lot of
hard-coded
values and I couldn't make it work at all [yet] for our
project).
We'd like to use it to keep track of the performance of our
project (linuxtools-lttng),
possibly on our own hardware, but the students working with us
will also
want to use it to get performance statistics from different
version of
their algorithms. They will have some more needs, like keeping
the results
of all iterations, not just average and standard deviation.
Can we contribute to the org.eclipse.test.performance and
org.eclipse.test.performance.ui
plug-ins? Will patches be reviewed in good time? The "degree of
support"
worries me a bit. And is this the right place to discuss these
plugins
or should I bring this discussion to another mailing list?
Thanks,
--
Geneviève Bastien
Research Associate
École Polytechnique de Montréal
On 03/31/2014 11:06 PM, David M Williams wrote:
You are correct we have not used in a few years. But, it is our
intent
to again.
That said, it's "degree of support" has never been great. See,
for example, this old bug from 2008,
Bug
246613 - [results]
performance test plugin
has hard coded values specific to Platform
That bug's history is not all bad news ... its just not great
news. In
an ideal world some interested parties could join forces and
improve that
to the point it could become part of "CBI" or similar ... but,
I honestly do not know how much work that would be, or if there
are other
or better alternatives, or "more trouble than its worth"?
You obviously found org.eclipse.test.performance
but its companion org.eclipse.test.performance.ui
may not be so easy
to find.
It is now in the platform/eclipse.platform.releng.buildtools
repository.
We don't currently
build it, and it has some minor compile or pre-req issues, last
I had time
to look, 2 years ago.
I know there is definitely others interested: Matthias Mailänder
recently
moved the "how to" html from the plugin, to the wiki (bug
390820).
Its currently at https://wiki.eclipse.org/Performance/Automated_Tests
There is an "umbrella bug" that tracks many other "to do"
items, see bug
374441.
This is an area I plan to work on soon, so if others are too,
would love
to hear what you've learned ... or you might contribute or at
least comment
in bug
374441.
Sorry I don't have more specifics at the moment. Glad to hear
you think
it might be useful.
Thanks,
From: Geneviève
Bastien <gbastien+lttng@xxxxxxxxxxxx>
To: platform-releng-dev@xxxxxxxxxxx,
Date: 03/31/2014
08:34 PM
Subject: [platform-releng-dev]
Status
of the performance test project
Sent by: platform-releng-dev-bounces@xxxxxxxxxxx
Hi all,
I am a developer on the linuxtools Eclipse plug-in and I am
looking into
a way to make automatic benchmarks for some parts of the
application and
save the results to be able to see how the application
develops.
I was looking at the org.eclipse.test.performance plugin,
which sounds
about right for our needs. But I see it hasn't been developed
much in
the last few years. Is it still supported? Or has something
else
replaced it for performance testing and keeping (and
eventually
visualizing) benchmark data?
Thanks,
Geneviève Bastien
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
_______________________________________________
platform-releng-dev mailing list
platform-releng-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/platform-releng-dev
|