A WebMaster’s view of Eclipse.org

Rants, praise and observations related to the technical and psychological challenges of running servers for a pretty busy site.

Mirror, mirror on the … list

I got a message from one of our mirrors this morning:

I’m disabling I-* and R-* [builds]. September was the 2nd month at over 7TB transfer, which is significantly over my transfer limit. I’ll continue to mirror S-* [builds].

Was fun while it lasted… certainly the biggest webalizer numbers I’ve ever seen.


Seven Terabytes. 7,168 gigabytes. Seven million megabytes. That’s 1500 DVDs, full to the brim. And this is only one mirror out of 35.

Eclipse is gaining in popularity, and fast. Note that this particular mirror isn’t even an Update Manager mirror - meaning they only provide the zip files. Eclipse.org wasn’t saturated until the Update JARs made it to the update site on tuesday morning. Since then, our bandwidth has been pretty much maxed out, despite adding an extra 10 megabits to our permanent link AND despite waiting for Update mirrors to fetch the Update JARs before making them publicly available.


As a side note, I’ve observed that even in a tech-savvy community like Eclipse, the vast majority of downloaders keep fetching the SDK through plain old http as opposed to using the Bittorrent links. iBiblio reports about 1332 completed downloads for the Win32 SDK, whereas our download stats amount to 145,558 http downloads for the same file.

Posted October 7th, 2005 by Denis Roy in category: Uncategorized
You can skip to the end and leave a response. Pinging is currently not allowed.

5 Responses to “Mirror, mirror on the … list”


  1. Kim Moir Says:

    In an effort to reduce some of the bandwidth utilization, why doesn’t the foundation ask Strategic developers to provide an internal/external mirror? Traffic could then be redirected to the appropriate mirror for that domain.

    Also, I notice that there are not very many large US mirrors. Given that the bulk of eclipse downloads originate in the US, perhaps a marketing campaign is in order :-) Sign up as an eclipse mirror, win some eclipse swag…or something.
    A recognition page for the mirrors might also be helpful. Send an email to mirrors that provide popular large files such as Linux distro ISOs inviting them to become a mirror.

    It seems that increasing the number of mirrors to spread the load and encouraging the use of bittorrent wherever possible will help alleviate our popularity problems :-)


  2. Denis Roy Says:

    I did solicit many US mirrors and some European ones back in April. I got great response for Europe, not so much from the US.

    I agree that a mirrors appreciation page would be great, though.

    I’ll see what I can do for the SD mirrors.


  3. Denis Roy Says:

    Actually, I hope my blog posting didn’t come off as negative. We’re currently just at the brink of saturation - good saturation; nothing crazy like what happened for 3.1.

    3.1.1 went smooth as silk in my book, and I hope the next big release goes as well as this.


  4. Yeroc Says:

    The problem with BitTorrent is that it doesn’t work for us behind the firewall at work… I suspect this is the case for many people.


  5. RefuX Says:

    Make the BitTorrent link easy to find.
    Make the other links harder to find :)

Leave a Reply

You must be logged in using your Eclipse Bugzilla account to post a comment.

Recent Posts

Archives

Categories

Meta