| Re: [eclipse-dev] Fw: [Bug 215464] Regression in org.eclipse.core perf test: StartupTest. testApplicationStartup (aka 'Core Headless Startup') |
This can happen even on normal tests (eg. not commented). This is developer
responsibility to verify that he did not change the test context.
In other words, even when you see a (strong) green results, you still have
to know why it happened and be able to explain it...
Cordialement/Regards,
Frédéric
Thomas Watson
<tjwatson@xxxxxx.
com> To
Sent by: "General development mailing list
eclipse-dev-bounc of the Eclipse project."
es@xxxxxxxxxxx <eclipse-dev@xxxxxxxxxxx>
cc
01/17/2008 06:46 Subject
PM Re: [eclipse-dev] Fw: [Bug 215464]
Regression in org.eclipse.core
perf test: StartupTest.
Please respond to testApplicationStartup (aka
"General 'Core Headless Startup')
development
mailing list of
the Eclipse
project."
<eclipse-dev@ecli
pse.org>
I also think it is a little odd. Something can change in the system that
artificially improves performance also. In this case, imagine if we
dramatically reduced the number of source bundles from one release to the
next. All of a sudden our start up performance numbers would have improved
but nothing would have been done to actually make the system faster. A
product with the same amount of bundles from one release to the next would
see no improvement in performance.
Tom
(Embedded image moved to file: pic04108.gif)Inactive hide details for Mike
Wilson ---01/17/2008 11:31:40 AM---Am I the only person who thinks this is
odd?Mike Wilson ---01/17/2008 11:31:40 AM---Am I the only person who thinks
this is odd?
(Embedde (Embedded image moved to file: pic25842.gif)
d image Mike Wilson <Mike_Wilson@xxxxxxxxxx>
moved to
file:
pic13199
.gif)
From:
(Embedde (Embedded image moved to file: pic22278.gif)
d image "General development mailing list of the Eclipse project."
moved to <eclipse-dev@xxxxxxxxxxx>
file:
pic13746
.gif)
To:
(Embedde (Embedded image moved to file: pic22121.gif)
d image 01/17/2008 11:31 AM
moved to
file:
pic04212
.gif)
Date:
(Embedde (Embedded image moved to file: pic16173.gif)
d image Re: [eclipse-dev] Fw: [Bug 215464] Regression in
moved to org.eclipse.core perf test: StartupTest. testApplicationStartup
file: (aka 'Core Headless Startup')
pic16695
.gif)
Subject:
Am I the only person who thinks this is odd?
To me, the grey coloring means "there is something wrong with the test (or
the system has changed in a way that invalidates it), so the result isn't
interesting" -- I don't actually care whether it's slower or faster. For
example, ongoing fixes elsewhere could cause the test to run faster, making
the test *look* like it's working again, even though it's still not
McQ.
Frederic Fusier
<frederic_fusier@
fr.ibm.com> To
Sent by: "General development mailing list
eclipse-dev-bounc of the Eclipse project."
es@xxxxxxxxxxx <eclipse-dev@xxxxxxxxxxx>
cc
17/01/2008 12:04 Subject
PM [eclipse-dev] Fw: [Bug 215464]
Regression in org.eclipse.core perf
test: StartupTest.
Please respond to testApplicationStartup (aka 'Core
"General Headless Startup')
development
mailing list of
the Eclipse
project."
<eclipse-dev@ecli
pse.org>
Note that when a degradation comment is set on a test, the fingerprint bar
becomes gray only if the test result is negative.
Cordialement/Regards,
Frédéric
----- Forwarded by Frederic Fusier/France/IBM on 01/17/2008 05:43 PM -----
bugzilla-daemon@e
clipse.org
To
01/17/2008 04:25 Frederic Fusier/France/IBM@IBMFR
PM cc
Subject
[Bug 215464] Regression in
org.eclipse.core perf test:
StartupTest. testApplicationStartup
(aka 'Core Headless Startup')
https://bugs.eclipse.org/bugs/show_bug.cgi?id=215464
Product/Component: Equinox / Framework
--- Comment #4 from Thomas Watson <tjwatson@xxxxxxxxxx> 2008-01-17
10:25:56 -0400 ---
I released a degradation comment for the core headless startup test
(StartupTest.java) which points to this bug to explain the degradation.
--
Configure bugmail: https://bugs.eclipse.org/bugs/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You reported the bug.
_______________________________________________
eclipse-dev mailing list
eclipse-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/eclipse-dev
_______________________________________________
eclipse-dev mailing list
eclipse-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/eclipse-dev
_______________________________________________
eclipse-dev mailing list
eclipse-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/eclipse-dev
Attachment:
pic04108.gif
Description: GIF image
Attachment:
pic13199.gif
Description: GIF image
Attachment:
pic25842.gif
Description: GIF image
Attachment:
pic13746.gif
Description: GIF image
Attachment:
pic22278.gif
Description: GIF image
Attachment:
pic04212.gif
Description: GIF image
Attachment:
pic22121.gif
Description: GIF image
Attachment:
pic16695.gif
Description: GIF image
Attachment:
pic16173.gif
Description: GIF image
