Bug 527212

Summary:	Optimize the "Building Workspace" job
Product:	[Eclipse Project] Platform	Reporter:	Mickael Istria <mistria>
Component:	Resources	Assignee:	Platform-Resources-Inbox <platform-resources-inbox>
Status:	NEW ---	QA Contact:
Severity:	enhancement
Priority:	P3	CC:	akurtako, daniel_megert, gautier.desaintmartinlacaze, gregory.amerson, robert.munteanu, s.srinivasan, sbouchet, sptaszkiewicz
Version:	4.7	Keywords:	performance
Target Milestone:	---
Hardware:	All
OS:	All
See Also:	https://bugs.eclipse.org/bugs/show_bug.cgi?id=527236 https://git.eclipse.org/r/112853 https://git.eclipse.org/r/112854 https://bugs.eclipse.org/bugs/show_bug.cgi?id=528248 https://bugs.eclipse.org/bugs/show_bug.cgi?id=528258 https://git.eclipse.org/r/116717 https://git.eclipse.org/r/117207 https://git.eclipse.org/c/platform/eclipse.platform.resources.git/commit/?id=79b63f480a3d17985348d30612cb682f53789de4 https://bugs.eclipse.org/bugs/show_bug.cgi?id=538461
Whiteboard:
Bug Depends on:	531554, 538462, 568311, 331187, 528150, 528248, 530649, 531553, 531555
Bug Blocks:

Description Mickael Istria

2017-11-13 11:30:27 EST

Some recent chat with Dani have confirmed that there are probably some possible improvements to make the "Build Workspace" job performing better.
We should investigate some locking and overall performance improvements in this job.

Comment 1 Mickael Istria

2017-11-14 03:39:07 EST

It is very possible that some occurrences of blocking "Building Workspace" job do happen because of some IncrementalProjectBuilders not overriding getRule() to the best context. Bug 527236 is a proposal to more easily detect such issues.

A possible improvement would be to allow parallel jobs, using JobGroup API, to build projects that don't have inter-dependency. A related issue is that AFAIK, there is no easy API to deal with a ProgressMonitor for parallel jobs.

Comment 2 Mickael Istria

2017-12-04 15:26:26 EST

To allow some parallel build, we first need to tackle bug 331187.

Comment 3 Eclipse Genie

2017-12-05 03:25:19 EST

New Gerrit change created: https://git.eclipse.org/r/112853

Comment 4 Eclipse Genie

2017-12-05 03:25:25 EST

New Gerrit change created: https://git.eclipse.org/r/112854

Comment 5 Eclipse Genie

2018-02-05 09:22:36 EST

New Gerrit change created: https://git.eclipse.org/r/116717

Comment 6 Eclipse Genie

2018-02-12 14:11:07 EST

New Gerrit change created: https://git.eclipse.org/r/117207

Comment 7 Eclipse Genie

2018-02-23 05:44:49 EST

Gerrit change https://git.eclipse.org/r/116717 was merged to [master].
Commit: http://git.eclipse.org/c/platform/eclipse.platform.resources.git/commit/?id=79b63f480a3d17985348d30612cb682f53789de4

Comment 8 Szymon Ptaszkiewicz

2018-05-17 13:38:38 EDT

Moving to 4.9.

Comment 9 Mickael Istria

2018-11-19 16:19:32 EST

This umbrella bug still has living tentacles in several places that cannot be addressed in 4.10 => Moving to 4.11.