527212 – Optimize the "Building Workspace" job

Bug 527212 - Optimize the "Building Workspace" job

Summary: Optimize the "Building Workspace" job

Status:	NEW

Alias:	None

Product:	Platform
Classification:	Eclipse Project
Component:	Resources (show other bugs)
Version:	4.7
Hardware:	All All

Importance:	P3 enhancement with 2 votes (vote)
Target Milestone:	---
Assignee:	Platform-Resources-Inbox
QA Contact:

URL:
Whiteboard:
Keywords:	performance

Depends on:	531554 538462 568311 331187 528150 528248 530649 531553 531555
Blocks:
	Show dependency tree

Reported:	2017-11-13 11:30 EST by Mickael Istria
Modified:	2020-11-06 06:55 EST (History)
CC List:	8 users (show)

See Also:	527236 Gerrit Change Gerrit Change 528248 528258 Gerrit Change Gerrit Change Git Commit 538461

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Mickael Istria

2017-11-13 11:30:27 EST

Some recent chat with Dani have confirmed that there are probably some possible improvements to make the "Build Workspace" job performing better.
We should investigate some locking and overall performance improvements in this job.

Comment 1 Mickael Istria

2017-11-14 03:39:07 EST

It is very possible that some occurrences of blocking "Building Workspace" job do happen because of some IncrementalProjectBuilders not overriding getRule() to the best context. Bug 527236 is a proposal to more easily detect such issues.

A possible improvement would be to allow parallel jobs, using JobGroup API, to build projects that don't have inter-dependency. A related issue is that AFAIK, there is no easy API to deal with a ProgressMonitor for parallel jobs.

Comment 2 Mickael Istria

2017-12-04 15:26:26 EST

To allow some parallel build, we first need to tackle bug 331187.

Comment 3 Eclipse Genie

2017-12-05 03:25:19 EST

New Gerrit change created: https://git.eclipse.org/r/112853

Comment 4 Eclipse Genie

2017-12-05 03:25:25 EST

New Gerrit change created: https://git.eclipse.org/r/112854

Comment 5 Eclipse Genie

2018-02-05 09:22:36 EST

New Gerrit change created: https://git.eclipse.org/r/116717

Comment 6 Eclipse Genie

2018-02-12 14:11:07 EST

New Gerrit change created: https://git.eclipse.org/r/117207

Comment 7 Eclipse Genie

2018-02-23 05:44:49 EST

Gerrit change https://git.eclipse.org/r/116717 was merged to [master].
Commit: http://git.eclipse.org/c/platform/eclipse.platform.resources.git/commit/?id=79b63f480a3d17985348d30612cb682f53789de4

Comment 8 Szymon Ptaszkiewicz

2018-05-17 13:38:38 EDT

Moving to 4.9.

Comment 9 Mickael Istria

2018-11-19 16:19:32 EST

This umbrella bug still has living tentacles in several places that cannot be addressed in 4.10 => Moving to 4.11.