Community
Participate
Working Groups
Incorrect summary verdict when generating JScrib reports on test executions with no verdicts. Using the enclosed test suite/execution, the JScrib reports generates a Pass summary verdict despite the default arbitrated verdict in the model being inconclusive.
Created attachment 48627 [details] Test resources
To be precise, a test log that is generated with no verdicts does not have an arbitrated verdict. In all TPTP tests, the arbiter runs in the remote process (as part of the runner) and assigns arbitrated verdicts based on verdict events. In the case described, inconclusive is not an arbitrated verdict. It is a default value as defined in our EMF model.
Please target to 4.4 and review the priority according to http://www.eclipse.org/tptp/home/documents/process/development/bugzilla.html.
Targeting to future since not containable in 4.4.
As discussed on this week's Test Project call (January 22, 2007), the Test Project will focus on existing P1 - P2/Blocker - Major and P1/Normal and test creation/automation defects (omitting defects dependant on outstanding features) in TPTP 4.4. All other Test Project defects have been targeted to future. If this defect has been targeted to future and you/originator feel it should be completed in 4.4, please provide the necessary reason as a reply to this comment or a post to the Test Project mailing list (tptp-test-tooling-dev@eclipse.org). We will collectively triage and assess our resources to determine a case-by-case decision.
Correction: The Test Project mailing list is tptp-testing-tools-dev@eclipse.org.
The following files checked in to CVS (HEAD): org.eclipse.hyades.test.tools.ui.common.internal.report.jscrib.JscribWriter.java org.eclipse.hyades.test.tools.ui.common.internal.report.jscrib.ReportDataUtils.java org.eclipse.tptp.test.samples.internal.resources.SamplesPluginResourceBundle.java /org.eclipse.tptp.test.samples/src/org/eclipse/tptp/test/samples/internal/resources/messages.properties
(In reply to comment #7) > The following files checked in to CVS (HEAD): > > org.eclipse.hyades.test.tools.ui.common.internal.report.jscrib.JscribWriter.java > org.eclipse.hyades.test.tools.ui.common.internal.report.jscrib.ReportDataUtils.java > org.eclipse.tptp.test.samples.internal.resources.SamplesPluginResourceBundle.java > /org.eclipse.tptp.test.samples/src/org/eclipse/tptp/test/samples/internal/resources/messages.properties > This code became deprecated when we enable BIRT. It continued to be packaged for API compatibility only. It is not clear why we are fixing defects here.
(In reply to comment #8) > This code became deprecated when we enable BIRT. It continued to be packaged > for API compatibility only. It is not clear why we are fixing defects here. The two JScrib report generators have never been deprecated, hence the fix.
Verified in 4.5.0-200802100400.