Re: [equinox-dev] performance problems with Eclipse startup due to long

[Jacek Pospychała <Jacek.Pospychala@xxxxxxxxxxxxxxxx>]

Thanks Pascal and Simon.
What concerns me is that this slow operation happens in 
p2.reconciler.dropins Activator.start(), actually stopping the startup 
of whole Eclipse app.
My other problem is that this is not the only case. There are other, not 
yet clear or documented enough that cause slow startup - I'm trying to 
get stacktraces for them too.
But it may be that most of p2 operations are currently slow for large 
installations.

So assuming the the metadata write is slowing us so much, could it be 
realized as a separate thread, or moved out from Activator.start() sequence?
Do you think it has any sense, or maybe there are other services that 
depend on the metadata written to disk?

Jacek

Pascal Rapicault pisze:
> Some bug fixes got made in 3.4.2, but the main problem is that p2 has 
> to generate metadata on the fly which is a non trivial operation IO-wise.
> I would recommend you to generate p2 metadata for all of those 3000 
> bundles and install them properly using the p2 director.
> One bug report about performance of the reconciler is 
> https://bugs.eclipse.org/bugs/show_bug.cgi?id=251561
>
>
> Inactive hide details for Jacek Pospychała ---01/08/2009 11:19:42 
> AM---Hi I have an Eclipse 3.4.1 install (of ~3000 plug-ins),Jacek 
> Pospychała ---01/08/2009 11:19:42 AM---Hi I have an Eclipse 3.4.1 
> install (of ~3000 plug-ins), that's starting for
>
>
> From: 	
> Jacek Pospychała <Jacek.Pospychala@xxxxxxxxxxxxxxxx>
>
> To: 	
> equinox-dev@xxxxxxxxxxx
>
> Date: 	
> 01/08/2009 11:19 AM
>
> Subject: 	
> [equinox-dev] performance problems with Eclipse startup due to long 
> DirectoryWatcher.poll() (25 minutes!)
>
> ------------------------------------------------------------------------
>
>
>
> Hi
> I have an Eclipse 3.4.1 install (of ~3000 plug-ins), that's starting for
> about 25minutes. Most of this time is spent in
> org.eclipse.equinox.internal.p2.reconciler.dropins.Activator.start()
> calling (indirectly) DirectoryWatcher.poll().
>
> Looking at several coredumps collected during this startup time it seems
> that all threads wait() or sleep() and only "Start Level Event Dispatcher"
> is working. All the time this thread is writing some XML. (See it's
> stacktrace below)
>
> Is this expected behaviour? What XML is actually written?
> I also notice that p2 directory has about 600mb.
>
> I was looking for bugs with similar stack traces, but with no luck so
> far - should I open new?
> thanks
>
> Jacek
>
>
> stacktrace:
>
> 3XMTHREADINFO      "Start Level Event Dispatcher" TID:0x4274C100,
> j9thread_t:0x0001BA70, state:CW, prio=5
> 3XMTHREADINFO1            (native thread ID:0x890, native priority:0x5,
> native policy:UNKNOWN)
> 4XESTACKTRACE          at java/io/OutputStreamWriter.write(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at java/io/PrintWriter.write(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at java/io/PrintWriter.write(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at java/io/PrintWriter.print(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/persistence/XMLWriter.print(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/persistence/XMLWriter.start(Bytecode
> PC:71(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/persistence/XMLWriter.writeProperty(Bytecode 
>
> PC:71(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/persistence/XMLWriter.writeProperties(Bytecode 
>
> PC:70(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/persistence/XMLWriter.writeProperties(Bytecode 
>
> PC:4(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepositoryIO$Writer.writeArtifacts(Bytecode 
>
> PC:102(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepositoryIO$Writer.write(Bytecode 
>
> PC:77(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepositoryIO.write(Bytecode 
>
> PC:25)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepository.save(Bytecode 
>
> PC:214(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepository.save(Bytecode 
>
> PC:24)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/simple/SimpleArtifactRepository.removeDescriptor(Bytecode 
>
> PC:9)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/RepositoryListener.synchronizeArtifactRepository(Bytecode 
>
> PC:105)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/RepositoryListener.stopPoll(Bytecode 
>
> PC:92)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/DirectoryWatcher.stopPoll(Bytecode 
>
> PC:34)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/DirectoryWatcher.poll(Bytecode 
>
> PC:9)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/extensionlocation/ExtensionLocationArtifactRepository.ensureInitialized(Bytecode 
>
> PC:80)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/extensionlocation/ExtensionLocationArtifactRepository.getProperties(Bytecode 
>
> PC:1)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/ArtifactRepositoryManager.addRepository(Bytecode 
>
> PC:108)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/ArtifactRepositoryManager.loadRepository(Bytecode 
>
> PC:106)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/artifact/repository/ArtifactRepositoryManager.loadRepository(Bytecode 
>
> PC:5)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/reconciler/dropins/Activator.loadArtifactRepository(Bytecode 
>
> PC:66)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/reconciler/dropins/PlatformXmlListener.synchronizeConfiguration(Bytecode 
>
> PC:398)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/reconciler/dropins/PlatformXmlListener.stopPoll(Bytecode 
>
> PC:31)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/DirectoryWatcher.stopPoll(Bytecode 
>
> PC:34)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/provisional/p2/directorywatcher/DirectoryWatcher.poll(Bytecode 
>
> PC:9)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/reconciler/dropins/Activator.watchConfiguration(Bytecode 
>
> PC:224)
> 4XESTACKTRACE          at
> org/eclipse/equinox/internal/p2/reconciler/dropins/Activator.start(Bytecode 
>
> PC:127)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/BundleContextImpl$2.run(Bytecode
> PC:58)
> 4XESTACKTRACE          at
> java/security/AccessController.doPrivileged(Bytecode PC:3(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/BundleContextImpl.startActivator(Bytecode 
>
> PC:22)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/BundleContextImpl.start(Bytecode
> PC:23)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/BundleHost.startWorker(Bytecode
> PC:381)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/AbstractBundle.resume(Bytecode
> PC:22(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/Framework.resumeBundle(Bytecode
> PC:35(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/StartLevelManager.resumeBundles(Bytecode 
>
> PC:91)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/StartLevelManager.incFWSL(Bytecode 
>
> PC:33)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/StartLevelManager.doSetStartLevel(Bytecode 
>
> PC:236)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/internal/core/StartLevelManager.dispatchEvent(Bytecode 
>
> PC:45)
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/eventmgr/EventManager.dispatchEvent(Bytecode
> PC:39(Compiled Code))
> 4XESTACKTRACE          at
> org/eclipse/osgi/framework/eventmgr/EventManager$EventThread.run(Bytecode
> PC:26)
>
>
> _______________________________________________
> equinox-dev mailing list
> equinox-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/equinox-dev
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> equinox-dev mailing list
> equinox-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/equinox-dev
>