cross-project-issues-dev http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/maillist.html cross-project-issues-dev en-us Thu, 22 Oct 2009 18:10:16 GMT Thu, 22 Oct 2009 18:10:16 GMT http://blogs.law.harvard.edu/tech/rss MHonArc RSS 2.0 RCFile webmaster@eclipse.org (Webmaster) webmaster@eclipse.org (Webmaster) cross-project-issues-dev http://www.eclipse.org/eclipse.org-common/themes/Phoenix/images/eclipse_home_header.jpg http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/maillist.html Re: [cross-project-issues-dev] Permissions problems on download.eclipse.org http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03726.html an eye open. I'd say if you hear no objections by, say, next Wednesday morning, now would be a good time to do it ... no widespread pending releases or other sensitive timing that I know of. Done. You're now all responsible for ensuring the permissions a... On 10/22/2009 01:45 PM, David M Williams wrote: 
With that in mind, I'd rather just turn it off and tell everyone to keep 
    
an eye open.

I'd say if you hear no objections by, say, next Wednesday morning, now 
would be a good time to do it ... no widespread pending releases or other 
sensitive timing that I know of.
Done.  You're now all responsible for ensuring the permissions are correct on your downloads folders.
Is there a wiki yet for "how to put code on eclipse download server". 
Maybe that should be updated or if not one yet ... any volunteers?
http://wiki.eclipse.org/IT_Infrastructure_Doc

There is already a blurb for permissions, but it would be nice if someone else were to review all those words to make sure they make sense.  In my mind, it's all perfectly clear.
]]> Thu, 22 Oct 2009 18:00:57 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03726.html denis.roy@xxxxxxx (Denis Roy) Re: [cross-project-issues-dev] Permissions problems on download.eclipse.org http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03725.html an eye open. I'd say if you hear no objections by, say, next Wednesday morning, now would be a good time to do it ... no widespread pending releases or other sensitive timing that I know of. In the mean time, if any "release engineers" don't know what we ... > With that in mind, I'd rather just turn it off and tell everyone to keep an eye open. I'd say if you hear no objections by, say, next Wednesday morning, now would be a good time to do it ... no widespread pending releases or other sensitive timing that I know of. In the mean time, if any "release engineers" don't know what we are talking about, better ask now! :) Is there a wiki yet for "how to put code on eclipse download server". Maybe that should be updated or if not one yet ... any volunteers? ]]> Thu, 22 Oct 2009 17:45:47 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03725.html david_williams@xxxxxxx (David M Williams) Re: [cross-project-issues-dev] Permissions problems on download.eclipse.org http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03724.html You know, not a day goes by where I don't ask myself that same question! On some days, that is practically the case. It's currently set up to run only twice a day, and that's only when it is allowed to run. Heavy server load often causes this job to be ... On 10/21/2009 11:39 PM, David M Williams wrote: 
I wonder ... Are you being too helpful?

You know, not a day goes by where I don't ask myself that same question!


What if the fix-permissions script never ran, and we slowly
transitioned to expecting everyone to do it right from the
beginning.

On some days, that is practically the case.  It's currently set up to run only twice a day, and that's only when it is allowed to run.  Heavy server load often causes this job to be paused or terminated.  We've seen previously some cases where it hadn't run in days.

With that in mind, I'd rather just turn it off and tell everyone to keep an eye open.

Denis



]]> Thu, 22 Oct 2009 17:21:37 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03724.html denis.roy@xxxxxxx (Denis Roy) Re: [cross-project-issues-dev] Permissions problems on download.eclipse.org http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03723.html I wonder ... Are you being too helpful? What if the fix-permissions script never ran, and we slowly transitioned to expecting everyone to do it right from the beginning. As it is, someone may be uploading it &quot;wrong&quot;, its auto-fixed for them, and this works... I wonder ... Are you being too helpful? What if the fix-permissions script never ran, and we slowly transitioned to expecting everyone to do it right from the beginning. As it is, someone may be uploading it "wrong", its auto-fixed for them, and this works fine for a long long time, they don't even realize its not done right, but instead cleaned up for them, but then when once not auto-fixed (due to server overload) that is when the "problem suddenly appears" ... and the releng teams shout "we didn't change a thing, and it used to work just fine, what changed in the infrastructure". And by the time the shouting has died down, and the explanations given, several hundred gigabytes have been wasted copying, deleting, and then copying again full directories to the 70 mirrors. But, by then, everything is working again, so (some) teams decide since its not raining right now that they will fix the roof later. This could be "rolled out" slowly, so first, say, webtools wouldn't be auto-fixed up, then we (yes, you and me) would work to inspect things, make sure I'm setting thing right, etc. And then move on .... to modeling? Or who ever. This, or similar plan, would "force" teams to code things correctly (and set their umask bits correctly, which I'm now an expert on (ha ha)). I would seem to end up in a better infrastructure in several months (and then stay that way over the years as we grow to 10 million files! :) Naturally, you could still be helpful on request, both in education and if someone "messed up" (or, just give them a safe script to run for "post fix-up"). Perhaps the "auto-fix-permissions" script could be changed as a sort of "audit" tool (and would not have to run very often at all to spot teams not doing it correctly). There's probably even other rsync "tips" we should codify ... such as do NOT use -t when rsyncing to 'downloads'! As "smart" as that sometimes is, it is contradicted by our mirroring system ... since "old" files will "appear" to have been there the last time a mirror synched up, but won't be, so users get 404 errors from mirrors ... and I didn't learn that until just this year! What do you think? From: "Eclipse Webmaster (Denis Roy)" <webmaster@xxxxxxxxxxx> To: Cross project issues <cross-project-issues-dev@xxxxxxxxxxx> Date: 10/19/2009 09:35 AM Subject: [cross-project-issues-dev] Permissions problems on download.eclipse.org Sent by: cross-project-issues-dev-bounces@xxxxxxxxxxx Greetings, We've been getting complaints [1] from our mirror sites that many Permission Denied errors are occurring when syncing with download.eclipse.org. When you upload your files, please ensure that they are world-readable (rw-rw-r), and that directories are world-readable and executable (rwxrwxr-x). If you use RSYNC, you can simply set your permissions correctly prior to rsync, and use the -p option with rsync. Please note that it is not acceptable to remove file permissions to 'hide' content on download.eclipse.org. If it's there, it should be open to all. We have automated scripts to fix such anomalies, but since download.eclipse.org now has over 1 million files, these scripts cannot run as often as they used to. Thanks for your help! Denis [1] http://dev.eclipse.org/mhonarc/lists/eclipse-mirrors/msg00496.html _______________________________________________ cross-project-issues-dev mailing list cross-project-issues-dev@xxxxxxxxxxx https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev ]]> Thu, 22 Oct 2009 03:39:33 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03723.html david_williams@xxxxxxx (David M Williams) Re: [cross-project-issues-dev] Nightly builds - naming schemes http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03722.html Doesn't this pattern exclude the once-a-week I builds and M builds as well? PW Yup On 10/21/2009 09:29 AM, Paul Webster wrote: 
On Wed, Oct 21, 2009 at 9:25 AM, Denis Roy <denis.roy@xxxxxxxxxxx> wrote:
  
drops/I*
drops/M*
    
Doesn't this pattern exclude the once-a-week I builds and M builds as well?

PW
Yup
]]> Wed, 21 Oct 2009 13:31:20 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03722.html denis.roy@xxxxxxx (Denis Roy) Re: [cross-project-issues-dev] Nightly builds - naming schemes http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03721.html Doesn't this pattern exclude the once-a-week I builds and M builds as well? PW On Wed, Oct 21, 2009 at 9:25 AM, Denis Roy <denis.roy@xxxxxxxxxxx> wrote: > > drops/I* > drops/M* Doesn't this pattern exclude the once-a-week I builds and M builds as well? PW -- Paul Webster Hi floor. Make me a sammich! - GIR ]]> Wed, 21 Oct 2009 13:29:14 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03721.html pwebster@xxxxxxx (Paul Webster) [cross-project-issues-dev] Nightly builds - naming schemes http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03720.html Greetings, We try to avoid replicating Nightly builds to our mirrors, since they are short-lived and generate few downloads*. To do this, we have an exclusion list based on a specific set of directory patterns. Below is the current list...p; If you are ... Greetings,

We try to avoid replicating Nightly builds to our mirrors, since they are short-lived and generate few downloads*.  To do this, we have an exclusion list based on a specific set of directory patterns.  Below is the current list...  If you are producing Nightly builds, please ensure that the directory naming scheme matches one of the excluded patterns below, or let us know what your pattern is.  Our mirrors will thank you.

drops/I*
drops/N*
drops/M*
webtools/committers/
callisto/staging/
callisto/testUpdates/
eclipse/testUpdates/
eclipse/updates/3.2milestones
dev/TPTP*
tools/cdt/builds/*
modeling/gmf/downloads/drops/B*
*drops/*/N*
*drops/*/I*

Thanks,

Denis

* We do replicate _everything_ to our Amazon mirror so that you can still get speedy downloads for excluded files.

]]> Wed, 21 Oct 2009 13:25:22 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03720.html denis.roy@xxxxxxx (Denis Roy) Re: [cross-project-issues-dev] p2 API changes in Helios http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03719.html Hi Eric,

The command line tools will not be affected.
If they were, I would send a note on the cross-project ML.

PaScaL

Inactive hide details for Eric Gwin ---10/19/2009 02:30:19 PM---Pascal,Eric Gwin ---10/19/2009 02:30:19 PM---Pascal,


From:
Eric Gwin <eric.gwin@xxxxxxxxxx>

To:
Pascal Rapicault/Ottawa/IBM@IBMCA

Cc:
Cross project issues <cross-project-issues-dev@xxxxxxxxxxx>

Date:
10/19/2009 02:30 PM

Subject:
Re: [cross-project-issues-dev] p2 API changes in Helios



Pascal,

I just want to clarify before I open a bug. Our build (ant
command-line), utilizes the p2 tools directly. So I'm potentially
affected by changes, but do not directly call upon the API. If the
command-line interface will remain unchanged I'm likely unaffected.

Do you still want me open a bug?

-Eric

Pascal Rapicault wrote:
>
> If you are a user of the p2 API, please make sure to open a bug
> against p2 as indicated in
> http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03703.html
>
> Thx
>
> PaScaL
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> cross-project-issues-dev mailing list
> cross-project-issues-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
>  


GIF image

GIF image

]]> Mon, 19 Oct 2009 20:31:19 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03719.html Pascal_Rapicault@xxxxxxx (Pascal Rapicault) Re: [cross-project-issues-dev] p2 API changes in Helios http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03718.html Pascal,
I just want to clarify before I open a bug. Our build (ant command-line), utilizes the p2 tools directly. So I'm potentially affected by changes, but do not directly call upon the API. If the command-line interface will remain unchanged I'm likely unaffected.

Do you still want me open a bug?

-Eric

Pascal Rapicault wrote:

If you are a user of the p2 API, please make sure to open a bug against p2 as indicated in
http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03703.html

Thx

PaScaL

------------------------------------------------------------------------

_______________________________________________
cross-project-issues-dev mailing list
cross-project-issues-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

]]> Mon, 19 Oct 2009 18:29:53 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03718.html eric.gwin@xxxxxxx (Eric Gwin) [cross-project-issues-dev] p2 API changes in Helios http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03717.html If you are a user of the p2 API, please make sure to open a bug against p2 as indicated in http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03703.html Thx PaScaL If you are a user of the p2 API, please make sure to open a bug against p2 as indicated in
http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03703.html

Thx

PaScaL]]> Mon, 19 Oct 2009 17:45:22 GMT http://dev.eclipse.org/mhonarc/lists/cross-project-issues-dev/msg03717.html Pascal_Rapicault@xxxxxxx (Pascal Rapicault)