Bug 491070 - Intermittent test failures in FileBufferFunctions.* on CentOS or windows
Summary: Intermittent test failures in FileBufferFunctions.* on CentOS or windows
Status: ASSIGNED
Alias: None
Product: Platform
Classification: Eclipse Project
Component: Text (show other bugs)
Version: 4.6   Edit
Hardware: PC CentOS
: P3 minor (vote)
Target Milestone: ---   Edit
Assignee: Sravan Kumar Lakkimsetti CLA
QA Contact:
URL:
Whiteboard:
Keywords:
: 534543 (view as bug list)
Depends on:
Blocks:
 
Reported: 2016-04-05 07:13 EDT by Markus Keller CLA
Modified: 2022-02-25 01:01 EST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Markus Keller CLA 2016-04-05 07:13:58 EDT
http://download.eclipse.org/eclipse/downloads/drops4/N20160404-2000/testresults/html/org.eclipse.core.filebuffers.tests_ep46N-unit-cen64_linux.gtk.x86_64_8.0.html :

org.junit.ComparisonFailure: expected:<... in a linked folder.[]> but was:<... in a linked folder.[appendix]>
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:221)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:743)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:351)
at org.eclipse.test.CoreTestApplication.runTests(CoreTestApplication.java:36)
at org.eclipse.test.CoreTestApplication.run(CoreTestApplication.java:32)
at org.eclipse.equinox.internal.app.EclipseAppContainer.callMethodWithException(EclipseAppContainer.java:587)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:198)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:673)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:610)
at org.eclipse.equinox.launcher.Main.run(Main.java:1519)
at org.eclipse.equinox.launcher.Main.main(Main.java:1492)
at org.eclipse.core.launcher.Main.main(Main.java:34)

Failing test:
org.eclipse.core.filebuffers.tests.FileBuffersForFilesInLinkedFolders#test6()

On N20160403-2000, the same test method was failing, but in another test class:
org.eclipse.core.filebuffers.tests.FileStoreFileBuffersForWorkspaceFiles#test6()

We should watch these, but it's going to be hard to fix without being able to reproduce.
Comment 1 Markus Keller CLA 2016-04-05 07:16:02 EDT
The first failure was before the final commit for bug 487095, and nothing relevant had to be changed for JUnit 4 in these tests.
Comment 3 Sravan Kumar Lakkimsetti CLA 2016-05-18 08:50:27 EDT
I donot see these test failures in the latest build. so keeping in observation
Comment 5 Andrey Loskutov CLA 2018-07-30 16:46:01 EDT
*** Bug 534543 has been marked as a duplicate of this bug. ***
Comment 6 Andrey Loskutov CLA 2018-07-30 16:49:20 EDT
filebuffers tests fail ranmdomly on Linux builds, and there is no way to understand which test was it, because there are 8 classes extending the base class with identical test signatures and stupid asserts like assertTrue(1 == x).

Stack trace looks then like this:

test12_2	Error	N/A 

java.lang.AssertionError
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test12_2(FileBufferFunctions.java:588)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:689)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:346)
at org.eclipse.test.CoreTestApplication.runTests(CoreTestApplication.java:38)
at org.eclipse.test.CoreTestApplication.run(CoreTestApplication.java:34)
at org.eclipse.equinox.internal.app.EclipseAppContainer.callMethodWithException(EclipseAppContainer.java:587)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:198)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:656)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:592)
at org.eclipse.equinox.launcher.Main.run(Main.java:1498)
at org.eclipse.equinox.launcher.Main.main(Main.java:1471)
at org.eclipse.core.launcher.Main.main(Main.java:34)

or this:

test16_3	Error	N/A 

java.lang.AssertionError
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test16_3(FileBufferFunctions.java:998)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:689)
at org.eclipse.test.EclipseTestRunner.run(EclipseTestRunner.java:346)
at org.eclipse.test.CoreTestApplication.runTests(CoreTestApplication.java:38)
at org.eclipse.test.CoreTestApplication.run(CoreTestApplication.java:34)
at org.eclipse.equinox.internal.app.EclipseAppContainer.callMethodWithException(EclipseAppContainer.java:587)
at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:198)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:388)
at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:243)
at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:656)
at org.eclipse.equinox.launcher.Main.basicRun(Main.java:592)
at org.eclipse.equinox.launcher.Main.run(Main.java:1498)
at org.eclipse.equinox.launcher.Main.main(Main.java:1471)
at org.eclipse.core.launcher.Main.main(Main.java:34)

We need better asserts and test names. I will provide both.
Comment 7 Eclipse Genie CLA 2018-07-30 16:51:33 EDT
New Gerrit change created: https://git.eclipse.org/r/126798
Comment 9 Andrey Loskutov CLA 2018-08-08 16:56:42 EDT
OK, here the first de-obfuscated stack

!ENTRY org.eclipse.core.filebuffers.tests 4 0 2018-08-08 08:26:05.840
!MESSAGE FAIL in test12_2(org.eclipse.core.filebuffers.tests.FileBuffersForFilesInLinkedFolders)
!STACK 0
java.lang.AssertionError: expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:834)
	at org.junit.Assert.assertEquals(Assert.java:645)
	at org.junit.Assert.assertEquals(Assert.java:631)
	at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test12_2(FileBufferFunctions.java:617)
Comment 10 Kalyan Prasad Tatavarthi CLA 2019-10-10 06:59:41 EDT
Failed in the build I20191009-1800 

https://download.eclipse.org/eclipse/downloads/drops4/I20191009-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep414I-unit-win32-java8_win32.win32.x86_64_8.0.html 

on windows with the below error:

expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:115)
at org.junit.Assert.assertEquals(Assert.java:144)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 11 Kalyan Prasad Tatavarthi CLA 2020-08-20 13:40:37 EDT
Failed in the build I20200820-0230

https://download.eclipse.org/eclipse/downloads/drops4/I20200820-0230/testresults/html/org.eclipse.core.filebuffers.tests_ep417I-unit-win32-java11_win32.win32.x86_64_11.html

org.junit.ComparisonFailure: expected:<... of the link target.[]> but was:<... of the link target.[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 12 Kalyan Prasad Tatavarthi CLA 2020-10-08 08:30:12 EDT
Failed in the build I20201007-1800

https://download.eclipse.org/eclipse/downloads/drops4/I20201007-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep418I-unit-win32-java11_win32.win32.x86_64_11.html

with the below error
	
expected:<... of the link target.[]> but was:<... of the link target.[appendix]>

org.junit.ComparisonFailure: expected:<... of the link target.[]> but was:<... of the link target.[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 13 Kalyan Prasad Tatavarthi CLA 2020-11-26 06:38:54 EST
org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6 failed in the IBuild I20201125-1800 

https://download.eclipse.org/eclipse/downloads/drops4/I20201125-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep418I-unit-win32-java11_win32.win32.x86_64_11.html

with the below error

expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 14 Kalyan Prasad Tatavarthi CLA 2021-01-07 06:57:16 EST
org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6 failed in the IBuild I20210106-1800 

https://download.eclipse.org/eclipse/downloads/drops4/I20210106-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep419I-unit-win32-java11_win32.win32.x86_64_11.html

with the below error

expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 15 Kalyan Prasad Tatavarthi CLA 2021-11-11 04:25:46 EST
org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6 failed in the IBuild I20211110-1800

https://download.eclipse.org/eclipse/downloads/drops4/I20211110-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep422I-unit-win32-java11_win32.win32.x86_64_11.html

with the below error

expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 16 Kalyan Prasad Tatavarthi CLA 2022-01-07 00:07:16 EST
org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6 failed in the IBuild I20220106-0000

https://download.eclipse.org/eclipse/downloads/drops4/I20220106-0000/testresults/html/org.eclipse.core.filebuffers.tests_ep423I-unit-win32-java11_win32.win32.x86_64_11.html#FileBuffersTestSuite

for org.eclipse.core.filebuffers.tests.FileBuffersForWorkspaceFiles with the below error

expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253) 

and 

for org.eclipse.core.filebuffers.tests.FileBuffersForFilesInLinkedFolders with the below error

expected:<... in a linked folder.[]> but was:<... in a linked folder.[appendix]>

org.junit.ComparisonFailure: expected:<... in a linked folder.[]> but was:<... in a linked folder.[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
Comment 17 Kalyan Prasad Tatavarthi CLA 2022-02-25 01:01:23 EST
org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6 failed in the IBuild I20220223-1800 on windows with the below error

/********************/
expected:<content[]> but was:<content[appendix]>

org.junit.ComparisonFailure: expected:<content[]> but was:<content[appendix]>
at org.junit.Assert.assertEquals(Assert.java:117)
at org.junit.Assert.assertEquals(Assert.java:146)
at org.eclipse.core.filebuffers.tests.FileBufferFunctions.test6(FileBufferFunctions.java:253)
/********************/

https://download.eclipse.org/eclipse/downloads/drops4/I20220223-1800/testresults/html/org.eclipse.core.filebuffers.tests_ep423I-unit-win32-java11_win32.win32.x86_64_11.html