Fwd: Announcement: Finnish Eclipse mirror (was: RE: [eclipse-mirrors] Si

["Mikko Jaaskelainen" <mikko.jaaskelainen@xxxxxxxxxx>]

 -----Original Message-----
> From: eclipse-mirrors-bounces@xxxxxxxxxxx [mailto:eclipse-mirrors-
> bounces@xxxxxxxxxxx] On Behalf Of Gábriel Ákos
> Sent: 5. heinäkuuta 2010 20:35
> To: tsmets@xxxxxxxxxxxx; Eclipse download mirror administrators
> discussion and announcements
> Subject: Re: [eclipse-mirrors] Size of a full Eclipse mirror?
>
> On Sat, 2010-07-03 at 09:42 +0200, Thomas SMETS - Work wrote:
> >
> > Hello every body,
> >
> >
> > A couple of weeks ago we hit that problem too...
> > After discussing with eclipse-webmaster, it was suggest to do a clean
> first
> > and let it run even when there are errors :
> >
> >
> > <snip>
> >
> > # path to your RSYNC binary
> > # RSYNC=/usr/bin/rsync
> > # Adapted the RSYNC definition based on the advise from the
> administrators
> > # mailing list
> > # RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/I*
> > --exclude=drops/N* "i
> > # MODIFIED based on recommendation of eclipse server admin
> > RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N*
> > --exclude=drops/I* --exclude=nightly/* --exclude=drops/\d+.\d+.\d+/N*
> > --delete  --ignore-errors "
> >
> > </snip>
> >
> > What was detected :
> > _ rsync failed during clean up --> clean up was not completed
> successfully
> > (continued to grow)
> > _ Right before the latest release there were many many builds
> produced => a
> > lot of changes on the master server generating waves of updates
> (making the
> > process less stable).
> > _ deletion & updates generated jobs that were extremely long so
> putting the
> > "--ignore-errors" allowed to have each run to be as best as possible
> >
> > I dunno why I put 3 points while there is in fact 2 major problems
> ...
> > I hope this helps ...
>
> Hi,
>
> Are you sure your "patterns" are right?
> Are they expanded in a right way?
> I'd recommend using --exclude-from and a file for putting patterns
> into.
> I am using
>
> helios/M*
> helios/RC*
>
> now.
>
> Best,
> Akos

Hi,

Thank you everybody for your advice. Following Thomas's and Akos's
suggestions, we ended up with following rsync options:

RSYNC="$RSYNC_CMD -rtlvp --delete-excluded --exclude=drops/N*
--exclude=drops/I* --exclude=nightly/* --exclude=drops/\d+.\d+/N*
--exclude=helios/M* --exclude=helios/RC* --ignore-errors "

This way we ended up with total size of 432 GB, which is a size we can
live with.


And while we're on it, I'm happy to announce that we have a public
Finnish Eclipse mirror all synced and ready for action. The FQDN is
eclipse-mirror.nordnet.fi. Currently we offer only http access, but ftp
will be available later this week, as soon as the network admins have
time to update the access-lists.

Regards,

	Mikko Jaaskelainen
	Nordnet