eclipse-mirrors http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/maillist.html eclipse-mirrors en-us Sat, 21 Nov 2009 10:00:04 GMT Sat, 21 Nov 2009 10:00:04 GMT http://blogs.law.harvard.edu/tech/rss MHonArc RSS 2.0 RCFile webmaster@eclipse.org (Webmaster) webmaster@eclipse.org (Webmaster) eclipse-mirrors http://www.eclipse.org/eclipse.org-common/themes/Phoenix/images/eclipse_home_header.jpg http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/maillist.html [eclipse-mirrors] Alternative European Full Mirror http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00516.html We are currently doing mirroring for Italy and are synching with this suggested server: rsync.mirrorservice.org anyway we see that many downloads are not available here, for instance these: - Eclipse 3.6M3 or - Eclipse e4 Stable Build: 1.0M2 we tried to s... We are currently doing mirroring for Italy and are synching with this suggested server: rsync.mirrorservice.org anyway we see that many downloads are not available here, for instance these: - Eclipse 3.6M3 or - Eclipse e4 Stable Build: 1.0M2 we tried to synch with the main server (download.eclipse.org), but it takes too much time. Do we have an alternative european full server? Can we synch with another european simple mirror? Thank you very much Vincenzo Caselli RCP Vision -- View this message in context: http://old.nabble.com/Alternative-European-Full-Mirror-tp26454686p26454686.html Sent from the Eclipse - Mirrors mailing list archive at Nabble.com. ]]> Sat, 21 Nov 2009 09:55:25 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00516.html info@xxxxxxx (RCP Vision) RE: [eclipse-mirrors] Limiting the amount mirrored http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00515.html For various reasons, we want to mirror the ENTIRE Eclipse repo, EXCEPT for nightly builds. In working things out a year or so ago, we came up with this command (in our local copy of eclipse.org-rsync.sh): RSYNC="/usr/bin/rsync --delete-excluded --exclude=...

Yes, it is an internal mirror, and yes we use eclipseFullMirror… we wanted the web pages themselves, as well as the plugins, etc., to be internal, and using FullMirror was the only way to get that.  We had some errors on the internal mirror (due to missing pieces) when we tried going with just Mirror.

 

Thanks – I will copy some of the extra patterns you have given below.

 

From: eclipse-mirrors-bounces@xxxxxxxxxxx [mailto:eclipse-mirrors-bounces@xxxxxxxxxxx] On Behalf Of Eclipse Webmaster (Denis Roy)
Sent: Thursday, November 19, 2009 10:23
To: eclipse-mirrors@xxxxxxxxxxx
Subject: Re: [eclipse-mirrors] Limiting the amount mirrored

 

Jim,

Can you confirm if you're using the eclipseMirror or eclipseFullMirror stanza?  If memory serves me correctly, you are hosting an internal mirror, and when it was set up many moons ago you told us you wanted everything, which would qualify for using our restricted, but complete eclipseFullMirror.

On the other hand, eclipseMirror already has an exclusion list to filter out all the nightly builds we can think of.  Currently it is this, but we update it as we discover new stuff:

exclude = drops/I* drops/N* drops/M* *.jpg *.gif callisto/staging/ callisto/testUpdates/ eclipse/testUpdates/ eclipse/updates/3.2milestones dev/TPTP* tools/cdt/builds/* modeling/gmf/downloads/drops/B* *drops/*/N* *drops/*/I* linuxtools/N* nightly /webtools/downloads/drops/*/M* /releases/staging  /tools/orbit/committers

Feel free to keep using eclipseFullMirror and tweak your exclude list, or switch over to using eclipseMirror.

Denis

 

On 11/18/2009 03:10 PM, Jim Cooper wrote: 

For various reasons, we want to mirror the ENTIRE Eclipse repo, EXCEPT for nightly builds.
 
In working things out a year or so ago, we came up with this command (in our local copy of eclipse.org-rsync.sh):
 
RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* "
 
However, not all Eclipse projects have been following the 'standard' naming scheme.  I recently had to change the command to the following:
 
RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* --exclude=nightly/* --exclude=drops/\d+.\d+.\d+/N* "
 
which appears to avoid _most_ nightly build stuff.
 
Thought it was time to share this, in case anyone else has similar requirements... and maybe other patterns which do a better job.  I may not have these patterns correct, etc., though they seem to be working alright.
 
 
_______________________________________________
eclipse-mirrors mailing list
eclipse-mirrors@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
 
]]> Thu, 19 Nov 2009 15:33:51 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00515.html Jim.Cooper@xxxxxxx (Jim Cooper) Re: [eclipse-mirrors] Limiting the amount mirrored http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00514.html Jim,

Can you confirm if you're using the eclipseMirror or eclipseFullMirror stanza?  If memory serves me correctly, you are hosting an internal mirror, and when it was set up many moons ago you told us you wanted everything, which would qualify for using our restricted, but complete eclipseFullMirror.

On the other hand, eclipseMirror already has an exclusion list to filter out all the nightly builds we can think of.  Currently it is this, but we update it as we discover new stuff:

exclude = drops/I* drops/N* drops/M* *.jpg *.gif callisto/staging/ callisto/testUpdates/ eclipse/testUpdates/ eclipse/updates/3.2milestones dev/TPTP* tools/cdt/builds/* modeling/gmf/downloads/drops/B* *drops/*/N* *drops/*/I* linuxtools/N* nightly /webtools/downloads/drops/*/M* /releases/staging  /tools/orbit/committers

Feel free to keep using eclipseFullMirror and tweak your exclude list, or switch over to using eclipseMirror.

Denis

 

On 11/18/2009 03:10 PM, Jim Cooper wrote: 
For various reasons, we want to mirror the ENTIRE Eclipse repo, EXCEPT for nightly builds.

In working things out a year or so ago, we came up with this command (in our local copy of eclipse.org-rsync.sh):

RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* "

However, not all Eclipse projects have been following the 'standard' naming scheme.  I recently had to change the command to the following:

RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* --exclude=nightly/* --exclude=drops/\d+.\d+.\d+/N* "

which appears to avoid _most_ nightly build stuff.

Thought it was time to share this, in case anyone else has similar requirements... and maybe other patterns which do a better job.  I may not have these patterns correct, etc., though they seem to be working alright.


_______________________________________________
eclipse-mirrors mailing list
eclipse-mirrors@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/eclipse-mirrors
]]> Thu, 19 Nov 2009 15:23:19 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00514.html webmaster@xxxxxxx (Eclipse Webmaster (Denis Roy)) Re: [eclipse-mirrors] rsync.osuosl.org error http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00513.html >> I'm getting >> >> @ERROR: invalid uid rsync >> rsync error: error starting client-server protocol (code 5) >> >> from rsync.osuosl.org. This is not specific to eclipse, it's >> happening with other mirrors at rsync.osuosl.org. >> >It works fine for me.... Eclipse Webmaster (Denis Roy) (webmaster@xxxxxxxxxxx) wrote on 18 November 2009 11:03: >On 11/17/2009 07:17 AM, Carlos Carvalho wrote: >> I'm getting >> >> @ERROR: invalid uid rsync >> rsync error: error starting client-server protocol (code 5) >> >> from rsync.osuosl.org. This is not specific to eclipse, it's >> happening with other mirrors at rsync.osuosl.org. >> >It works fine for me. It's already fixed. ]]> Wed, 18 Nov 2009 21:00:09 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00513.html carlos@xxxxxxx (Carlos Carvalho) [eclipse-mirrors] Limiting the amount mirrored http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00512.html For various reasons, we want to mirror the ENTIRE Eclipse repo, EXCEPT for nightly builds. In working things out a year or so ago, we came up with this command (in our local copy of eclipse.org-rsync.sh): RSYNC="/usr/bin/rsync --delete-excluded --exclude=d... For various reasons, we want to mirror the ENTIRE Eclipse repo, EXCEPT for nightly builds. In working things out a year or so ago, we came up with this command (in our local copy of eclipse.org-rsync.sh): RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* " However, not all Eclipse projects have been following the 'standard' naming scheme. I recently had to change the command to the following: RSYNC="/usr/bin/rsync --delete-excluded --exclude=drops/N* --exclude=drops/I* --exclude=nightly/* --exclude=drops/\d+.\d+.\d+/N* " which appears to avoid _most_ nightly build stuff. Thought it was time to share this, in case anyone else has similar requirements... and maybe other patterns which do a better job. I may not have these patterns correct, etc., though they seem to be working alright. ]]> Wed, 18 Nov 2009 20:10:45 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00512.html Jim.Cooper@xxxxxxx (Jim Cooper) Re: [eclipse-mirrors] rsync.osuosl.org error http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00511.html It works fine for me. On 11/17/2009 07:17 AM, Carlos Carvalho wrote: 
I'm getting

@ERROR: invalid uid rsync
rsync error: error starting client-server protocol (code 5)

from rsync.osuosl.org. This is not specific to eclipse, it's
happening with other mirrors at rsync.osuosl.org.
It works fine for me.
]]> Wed, 18 Nov 2009 16:03:45 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00511.html webmaster@xxxxxxx (Eclipse Webmaster (Denis Roy)) [eclipse-mirrors] rsync.osuosl.org error http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00510.html I'm getting @ERROR: invalid uid rsync rsync error: error starting client-server protocol (code 5) from rsync.osuosl.org. This is not specific to eclipse, it's happening with other mirrors at rsync.osuosl.org. I'm getting @ERROR: invalid uid rsync rsync error: error starting client-server protocol (code 5) from rsync.osuosl.org. This is not specific to eclipse, it's happening with other mirrors at rsync.osuosl.org. ]]> Tue, 17 Nov 2009 12:17:11 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00510.html carlos@xxxxxxx (Carlos Carvalho) [eclipse-mirrors] IP change http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00509.html Hello, After some troubles with SSD storage on our new server we had to change mirror IP address. New IP of Code-House mirror is 87.98.236.20. Best regards, Luke Dywicki -- Owner and Principal of Code-House Do you saw our new website? Try out: http://code-... Hello, After some troubles with SSD storage on our new server we had to change mirror IP address. New IP of Code-House mirror is 87.98.236.20. Best regards, Luke Dywicki -- Owner and Principal of Code-House Do you saw our new website? Try out: http://code-house.org/ ]]> Mon, 02 Nov 2009 13:20:44 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00509.html luke@xxxxxxx (Łukasz Dywicki) Re: [eclipse-mirrors] Rsync process stopped with message "file has vanished" http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00508.html We launched the script with bash explicitly (we have Ubuntu): bash eclipse.org-rsync.sh and, in the end, we were able to have the rsynch process end successfully! Thank you Vincenzo Caselli RCP Vision wrote: > > Sorry, > we really do not intend to spam the newsgroup. > But with the script > http://www.eclipse.org/downloads/eclipse.org-rsync.sh.txt > we had lots of error like the following: > [: 128: ==: unexpected operator > Removing the "/*" characters in lines like > $RSYNC -rtlvp --delete $RSYNC_HOST::$RSYNC_PATH/eclipse/* > $mirror_path/eclipse/ > solved the "unexpected operator" errors. > > Still, the "file has vanished" warning/error does indeed stop the processs > ("ps -ef" command does not list rsync process anymore and the log messages > stops). > Our linux distro is Ubuntu 8.04, does this can be of help? > We are asking this because we googled into the following post: > http://www.jackbe.com/enterprise-mashup/forum/installation-problem-175-unexpected-operator > where a user writes: > "(On Ubuntu /bin/sh does not point to bash like on other Linuxes but to > dash)." > > Thank you very much > Vincenzo Caselli > > > > > > Denis Roy wrote: >> >> Your rsync should not have terminated, though, since this is not an error >> -- just a >> warning. I suggest you simply redirect your Eclipse-related errors to >> /dev/null to avoid this unnecessary SPAM. >> > > -- View this message in context: http://www.nabble.com/Rsync-process-stopped-with-message-%22file-has-vanished%22-tp25935651p26012302.html Sent from the Eclipse - Mirrors mailing list archive at Nabble.com. ]]> Thu, 22 Oct 2009 15:40:37 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00508.html info@xxxxxxx (RCP Vision) Re: [eclipse-mirrors] permission denied in directories causes removal on mirrors http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00507.html Yikes, linuxtools does contain 355,000 files... Most of those are Nightly builds. I'll tweak our exclude lists and work with projects to make sure we're only mirroring what we need. By the time I'm done, your RSYNC will be so fast, you'll almost be conv... On 10/20/2009 10:42 PM, Carlos Carvalho wrote: 
 >> rsync: opendir "/technology/linuxtools" (in eclipseMirror) failed: Permission denied (13)
it's just a few ones nobody cares but in the event above about 330,000

Yikes, linuxtools does contain 355,000 files...  Most of those are Nightly builds.

I'll tweak our exclude lists and work with projects to make sure we're only mirroring what we need.  By the time I'm done, your RSYNC will be so fast, you'll almost be convinced they hired someone competent to run this show  :)

Denis

]]> Wed, 21 Oct 2009 15:45:14 GMT http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00507.html denis.roy@xxxxxxx (Denis Roy)