[News.eclipse.foundation] Re: Eclipse test-suite

[Daniel Megert <daniel_megert@xxxxxxxxxx>]

Nikita Lipsky wrote:
> "Daniel Megert" <daniel_megert@xxxxxxxxxx> wrote in message 
> news:g7os1d$3fr$1@xxxxxxxxxxxxxxxxxxxx
>
> > > There are some failures in results. There is a note in results 
> > > "failures are anticipated and checked for with assertions while 
> > > errors are unanticipated." So should I think that test passes if it 
> > > fails by failure not by error?
> > Do you have a concrete example? Normally the test should either be 
> > green or red but might log some errors in the console even if the 
> > test itself is green.
>
> See for instance this link:
> http://download.eclipse.org/eclipse/downloads/drops/R-3.4-200806172000/testresults/html/org.eclipse.releng.tests_linux.gtk.x86.html 
>
>
> There is 1 failtire, sucess rate 80%, however it is reported in the 
> overall page as all-passed: "(0)"
Yes, that was "fixed" manually on the main page(s) because the reported 
error was known/intended. This is also done when a test fails for 
unknown reasons and a rerun makes the failure go away: instead of doing 
a full rebuild the pages are adjusted manually.

Dani
> > You might find some answers here: 
> > http://wiki.eclipse.org/index.php/Platform-releng-faq
> Thank you, I will check it.
>
> Regards,
> Nikita