Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [platform-releng-dev] Ideas for build optimizations?

Here are some of the ideas I sent to Mickael. Forwarding to the list for wider audience

 

From: Sravan K Lakkimsetti <sravankumarl@xxxxxxxxxx>
Sent: 19 March 2021 13:47
To: Mickael Istria <mistria@xxxxxxxxxx>
Cc: Aleksandar Kurtakov <akurtakov@xxxxxxxxxx>
Subject: RE: [EXTERNAL] [platform-releng-dev] Ideas for build optimizations?

 

Hi Mikael,

 

Here are the steps we have during the build

 

  1. Clean Workspace
  2. Setup initial configuration
  3. Generate environment variables
  4. Export environment variables stage 1
  5. Swt build input
  6. Create Base builder
  7. Download reference repo for repo reports
  8. Clone Repositories
  9. Tag Build Inputs
  10. Create Source Bundles
  11. Update Pom files in the source
  12. Aggregator maven build
  13. Gather Eclipse Parts
  14. Gather Equinox Parts
  15. Generate Repo reports
  16. Generate API tools reports
  17. Export environment variables stage 2
  18. Archive artifacts
  19. Promote Eclipse platform
  20. Promote Equinox
  21. Promote Update Site
  22. Trigger tests

 

What I am listing here are for build stages written in shell.

We can run some these stages in parallel with others. For example Promote Eclipse platform, Promote Equinox, Promote Update Site can run in parallel also Gather Eclipse Parts and Gather Equinox Parts can run in parallel. (approximately we will get 5 minutes improvement with this)

SWT Build Input stage can start separately but should complete before clone repositories stage(with this we will achieve 3 minutes improvement). Similarly Create Source Bundles stage should start after tagging stage but should complete before Gather Eclipse Part(this will improve by 6-8 minutes)

 

This is for the maven stage.

Build approximately spends 50% of time Aggregator maven build stage. Can we use multiple threads for maven here? This can speed up this stage. Changes might be required in Tycho and CBI here.

 

These are some of the ideas that will help.

 

Hope I haven’t overwhelmed you with this.

 

Thanks

Sravan

 

 

From: Mickael Istria <mistria@xxxxxxxxxx>
Sent: 19 March 2021 13:14
To: Eclipse platform release engineering list. <platform-releng-dev@xxxxxxxxxxx>
Subject: [EXTERNAL] [platform-releng-dev] Ideas for build optimizations?

 

Hi all,

 

I currently have some time I can dedicate to improving Platform build. Are there some identified tasks where I can contribute to? Or some ideas to try maybe?

 

Cheers

--

Mickael Istria

Eclipse IDE developer, for Red Hat Developers


Back to the top