Bug 266374 - design process for publishing builds from Hudson to download.eclipse.org
Summary: design process for publishing builds from Hudson to download.eclipse.org
Status: RESOLVED FIXED
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: Dash Athena (show other bugs)
Version: unspecified   Edit
Hardware: PC Linux
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: Common Build Inbox CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on: 273299 273302
Blocks: 264851 270849 272109
  Show dependency tree
 
Reported: 2009-02-26 15:24 EST by Nick Boldt CLA
Modified: 2012-01-30 11:32 EST (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Nick Boldt CLA 2009-02-26 15:24:57 EST
Need something like a crontab that runs every couple hours, as a given committer w/ write perms and shell access to dev.eclipse, to rsync the last successful or last stable build to dev.eclipse.org:

rsync -ar /opt/users/hudsonbuild/.hudson/jobs/cbi-gef-3.4.x-nightly/lastSuccessful/archive/build/?20* /home/data/httpd/download.eclipse.org/tools/gef/downloads/drops/3.4.0/

rsync -ar /opt/users/hudsonbuild/.hudson/jobs/cbi-gef-3.4.x-nightly/lastStable/archive/build//?20 /home/data/httpd/download.eclipse.org/tools/gef/downloads/drops/3.4.0/

Nice thing about build.eclipse.org sharing nfs mounts w/ dev.eclipse.org is that you can do this as a straight copy w/o having to go out over ssh.
Comment 1 Andrew Overholt CLA 2009-02-27 11:20:23 EST
I was thinking about also having symlinks or something to the latest zip to avoid having to wget on a glob.  Maybe that's unnecessary, though.
Comment 2 Mickael Istria CLA 2009-03-09 05:18:28 EDT
IMHO, the easiest solution would be 
* to make build.eclipse.org available via nfs on download.eclipse.org, and 
* to allow symlinks from downloads folders to archives or update-sites that are in Hudson workspace.

What do webmasters think about that?
Comment 3 Nick Boldt CLA 2009-04-08 18:49:26 EDT
Note that permissions must be set too, eg:

16 18 * * 3 rsync -a /opt/users/hudsonbuild/.hudson/jobs/cbi-ve-1.4.x-Ganymede/lastSuccessful/archive/build/I* /home/data/httpd/download.eclipse.org/tools/ve/downloads/drops/1.4.0/; chmod -R 755 /home/data/httpd/download.eclipse.org/tools/ve/downloads/drops/1.4.0/
Comment 4 Nick Boldt CLA 2009-04-09 15:12:16 EDT
Additional requirements (candidate for testing is VE 1.4):

+ Need to adopt some web UI for exposing new builds (eg., from PDT/GEF)

+ Need to include an index.php in testresults/ that links to the HTML pages & consolelogs
  + could zip up the logs instead

+ Need to link within compilelogs/ recursively so files can be found
  + could zip up the logs instead
Comment 5 Nick Boldt CLA 2009-04-22 12:33:22 EDT
> could zip up the logs instead

No, because files need to be unpacked for Hudson to scrape them.

> Need to include an index.php in testresults/ that links to the HTML pages & consolelogs
> Need to link within compilelogs/ recursively so files can be found

Done.

> Need to adopt some web UI for exposing new builds (eg., from PDT/GEF)

Moved to bug 273299.

> Also need shell script for rsync/copy, fix perms, and unpack update zip.

Moved to bug 273302.