Bug 166021 - Improve Automatic Build System for multiprocessor machines
Summary: Improve Automatic Build System for multiprocessor machines
Status: ASSIGNED
Alias: None
Product: PDE
Classification: Eclipse Project
Component: Build (show other bugs)
Version: 3.2.1   Edit
Hardware: PC All
: P3 enhancement with 1 vote (vote)
Target Milestone: ---   Edit
Assignee: pde-build-inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2006-11-28 02:50 EST by Michael Seele CLA
Modified: 2018-12-03 09:13 EST (History)
3 users (show)

See Also:

Attachments
org.eclipse.pde.internal.build.ant.AntScript path (1.00 KB, patch)
2007-02-09 07:40 EST, Michael Seele CLA 		no flags Details | Diff
org.eclipse.pde.internal.build.AssembleConfigScriptGenerator patch (1.34 KB, patch)
2007-02-09 07:41 EST, Michael Seele CLA 		no flags Details | Diff
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Michael Seele CLA 2006-11-28 02:50:09 EST 
Build ID: M20060921-0945

Automatic Build System is not multithreaded for two- or quad-core processors.

It will be great if the automatic build system uses the power of multiple processors for automatic builds.

is it possible to make the signing and compiling multi threaded?!?

please look at the Parallel ant-task.
Comment 1 Pascal Rapicault CLA 2006-11-28 09:32:21 EST 
Parallelizing the compilation would require the computation of independent subgraphs of dependent plugins to be run in parallel, but given the nature of the dependency, I doubt that we can get a lot here.
However, on the signature front I agree that it is probably possible to make improvements.
Would you have some time to look into it?
Comment 2 Michael Seele CLA 2006-11-28 09:49:29 EST 
i'm sorry but i don't have time to look into it for the next few weeks/months... :-(
Comment 3 Michael Seele CLA 2007-02-09 07:38:23 EST 
ok, i improved the signing of the jars by including the ant jarsign tasks into a parallel task. please look at the attached patches (created against 3.2.0 source files)
Comment 4 Michael Seele CLA 2007-02-09 07:40:19 EST 
Created attachment 58649 [details]
org.eclipse.pde.internal.build.ant.AntScript path
Comment 5 Michael Seele CLA 2007-02-09 07:41:13 EST 
Created attachment 58651 [details]
org.eclipse.pde.internal.build.AssembleConfigScriptGenerator patch
Comment 6 Michael Seele CLA 2008-05-21 05:19:54 EDT 
will you release this code anytime?
Comment 7 Andrew Niefer CLA 2009-02-19 10:36:52 EST 
This got lost.

I would like to look at this if I can find the time, the patch does not look bad.
We already did parallel compilation with bug 238177
Comment 8 Pascal Rapicault CLA 2009-04-26 14:24:46 EDT 
Sorry for not being able to roll that into 3.5. Most of the time ended up being spent on the integration of the publisher and restructuration of the build to better integrate repositories.
Comment 9 Michael Seele CLA 2009-04-27 02:05:49 EDT 
hm...the patches are not that big. hopefully it will be released in 3.6/4.0...
Comment 10 Andrew Niefer CLA 2009-04-27 09:38:42 EDT 
Builds using the new p2 mode (p2.gathering = true) do signing with a single call to the p2.process.artifacts ant tasks (which in turn uses the eclipse.jarProcessor task).  Parallelization in this case would need to be handled in the java code for the jarprocessor.  This would be done in JarProcessorExecutor.process and ZipProcessor.processZip.  This should also consider bug 206971.
Comment 11 Lars Vogel CLA 2018-12-03 09:12:43 EST 
Currently we are not actively enhancing PDE build anymore. Therefore, I close this bug as WONTFIX. 

Please reopen, if you plan to provide a fix.
Comment 12 Lars Vogel CLA 2018-12-03 09:13:09 EST 
Currently we are not actively enhancing PDE build anymore. Therefore, I close this bug as WONTFIX. 

Please reopen, if you plan to provide a fix.