Hi,
That would be a new job. But we won’t configure a new Buckminster-based Job, as we should be moving to Tycho/CBI soon, and we’d need to reconfigure it just
a few weeks later. We may even need to request a dedicated Hudson Instance (HIPP), if a new branching workflow is to be adopted (And many jobs need to be created). So, for now, it is recommended to use these annotations (Instead of @Ignore), but the Jobs will
come later.
The details of the future Hudson configuration for Papyrus are not known yet, so it is too early to request a new Job.
We definitely need 2 (or more) separate test jobs, to clearly separate regressions from other failures.
Regards,
Camille
De : mdt-papyrus.dev-bounces@xxxxxxxxxxx [mailto:mdt-papyrus.dev-bounces@xxxxxxxxxxx]
De la part de Christian W. Damus
Envoyé : lundi 24 mars 2014 16:06
À : Papyrus Project list
Objet : Re: [mdt-papyrus.dev] [PROVENANCE INTERNET] Re: Hudson with @Ignore
If a new or updated Hudson plug-in is required to improve the presentation of test results, then that requires (I think) a request (in the form of a bugzilla) to the Foundation's Webmaster team.
Otherwise, if it's just a plug-in configuration parameter on the build job, then any committer with permission to modify our Hudson project can do that.
Question: do we know whom is to be contacted to satisfy our need of test job configuration?
To properly visualize the test results, you can import the raw XML data into the Eclipse/JUnit view (Build artifacts -> Papyrus-TestResults.zip). The ignored
tests will (should?) be properly displayed. AFAIK, this information is not displayed on Hudson.
Also, to improve the clarity of test results, we have recently implemented new JUnit annotation:
430023: [Papyrus Tests] Papyrus shall propose different levels of testing, to allow test-driven development
They can either fail or ignore the test, depending on the job configuration (However, there currently isn’t any way to “configure” the test job for these annotations,
so they are currently ignored). The idea would be to replace all @Ignore annotations with more specific and configurable annotations, to have more accurate results. In this case, the annotation would be @InvalidTest (Which is ignored in the default test configuration).
See Bug 430023 for more details on these annotations.
__________________________
CEA LIST - Laboratoire d'Ingénierie dirigée par les modèles pour les Systèmes Embarqués (LISE)
I was wondering why some tests didn’t failed for this bug:
It’s a simple copy/paste launching an exception only for linux/mac platform.
I was pretty confident with this Hudson report :
But when I looked in the TestCopyGraphicallyPasteBlock class,
I found an @Ignore on each test.
@Ignore("The test implementation is not compatible with Eclipse 4.2")
- Is
there a way to show skipped tests in yellow in Hudson/Jenkins ? (I tried to update Ant to the last version but it’s not working)
- If
not, maybe it’s best to comment tests instead of @Ignore to avoid misleading information ?
_______________________________________________
mdt-papyrus.dev mailing list
mdt-papyrus.dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/mdt-papyrus.dev
|