Bug 131031 - some mirrors contain corrupted data at jar file addresses
Summary: some mirrors contain corrupted data at jar file addresses
Status: RESOLVED FIXED
Alias: None
Product: Community
Classification: Eclipse Foundation
Component: Website (show other bugs)
Version: unspecified   Edit
Hardware: PC Windows XP
: P3 normal (vote)
Target Milestone: ---   Edit
Assignee: phoenix.ui CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on: 131956
Blocks:
  Show dependency tree
 
Reported: 2006-03-08 23:48 EST by David Williams CLA
Modified: 2006-03-17 14:44 EST (History)
6 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description David Williams CLA 2006-03-08 23:48:28 EST
The problem first showed up using update manager in eclipse, and while investigating that, I just tried access from a browsers address field with following results. 

These two examples show corrupt content: 

http://mirror.switch.ch/eclipse/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://fullmoon.ottawa.ibm.com/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://fullmoon.rtp.raleigh.ibm.com/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar


They reply with: 

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<html><head>
<title>Menu for /callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar</title>
</head><body>
<h1>Menu for /callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar</h1>
<hr />



[an internal server error occured]


</body>
</html>


Where as these URL's correctly reply with a jar file: 
(I did not check if correct jar file!) 

http://www.eclipse.org/downloads/download.php?file=callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar&format=xml&protocol=http"
http://www.mirrorservice.org/sites/download.eclipse.org/eclipseMirror/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://rm.mirror.garr.it/mirrors/eclipse//callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://mirror.yoxos-eclipse-distribution.de/eclipse.org/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://ftp.osuosl.org/pub/eclipse//callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://ftp.sh.cvut.cz/MIRRORS/eclipse//callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
http://ftp.ntua.gr/mirror/eclipse/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
Comment 1 David Williams CLA 2006-03-13 15:09:56 EST
on 3/13, at approx. 3 pm eastern, I "touched" all the files in /releases ... 

we should check again in a day or two and see if that corrected things. 

Comment 2 David Williams CLA 2006-03-15 00:11:32 EST
Just to record results ... mirrors still show error ... as of 3/15 0010 (midnight of 14th). Roughly 30 hours after 'touch'. 

Apparently a "touch" is not enough to force refresh? 

I did check that the "touch" was effective ... ugh, well, ll does list 'modified' date, right? 

-rwxrwxrwx+ 1 david_williams callistoadmin 136555 2006-03-13 15:06 org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar

As of this writing, the 'TIME' file in /callisto says
1142398801 
if anyone knows how to read that. Does *that* need to be updated, somehow? To force a refresh? 


Comment 3 Eclipse Webmaster CLA 2006-03-15 08:30:09 EST
(In reply to comment #0)
http://mirror.switch.ch/eclipse/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar

I will contact the mirror admin, so they can add a default mime-type for jar files.  Barring that, we can remove this one from the mirroring system.

>http://fullmoon.ottawa.ibm.com/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar http://fullmoon.rtp.raleigh.ibm.com/callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar

These are IBM internal mirrors.  I can't even "see" that stuff.  You would need to open a ticket with the IBM support teams.

> Apparently a "touch" is not enough to force refresh? 

File metadata (permissions, timestamps) won't force a file transfer.

 
> -rwxrwxrwx+ 1 david_williams callistoadmin 136555 2006-03-13 15:06
> org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar

Please don't set files world-writable on our servers.


> As of this writing, the 'TIME' file in /callisto says
> 1142398801 
> if anyone knows how to read that. Does *that* need to be updated, somehow? To
> force a refresh? 

You've had a TIME file in webtools since 2004. It works the same way ;)

D.
Comment 4 Mark Martin CLA 2006-03-15 11:39:38 EST
In reply to comment 3

Denis, can you tell me what mime types you have added to resolve this? I have added application/x-java-archive jar, but no joy.
Comment 5 Eclipse Webmaster CLA 2006-03-15 11:50:57 EST
I don't have a specific mime-type for JAR files, and the servers' default is text/plain.  I would assume that using text/plain, or perhaps application/octet-stream would also work for you.

telnet download.eclipse.org 80
Trying 206.191.52.47...
Connected to download.eclipse.org (206.191.52.47).
Escape character is '^]'.
HEAD /callisto/releases/plugins/org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar HTTP/1.1
HOST: download.eclipse.org

HTTP/1.1 200 OK
Date: Wed, 15 Mar 2006 16:48:57 GMT
Server: Apache
Last-Modified: Mon, 13 Mar 2006 20:06:15 GMT
ETag: "b5c88-2156b-40ee5dffc5bc0"
Accept-Ranges: bytes
Content-Length: 136555
Content-Type: text/plain; charset=ISO-8859-1
Comment 6 Mark Martin CLA 2006-03-15 14:00:17 EST
The problem file has the word "map" in the file name. The version of Apache I am running has an entry "AddHandler imap-file map", for serve parsed imagemap files. Commenting out this entry fixes the file download problem.

Server version: Apache/2.0.46
Server built:   Dec 15 2005 04:19:10
httpd-2.0.46-56.ent
Red Hat Enterprise Linux ES release 3 (Taroon Update 6)
Comment 7 Eclipse Webmaster CLA 2006-03-15 14:09:13 EST
(In reply to comment #6)
> The problem file has the word "map" in the file name. The version of Apache I
> am running has an entry "AddHandler imap-file map", for serve parsed imagemap
> files. Commenting out this entry fixes the file download problem.

Interesting observation, thanks.  I don't have that Apache handler.

D.

Comment 8 Pascal Rapicault CLA 2006-03-15 14:10:49 EST
It seems that a bug report should be opened against apache :-)
Comment 9 Eclipse Webmaster CLA 2006-03-15 14:15:33 EST
Here it is:

http://issues.apache.org/bugzilla/show_bug.cgi?id=13290

Apparently not a bug, but a "feature".
Comment 10 David Williams CLA 2006-03-15 14:38:54 EST
(In reply to comment #3)
> (In reply to comment #0)
> 
> > Apparently a "touch" is not enough to force refresh? 
> 
> File metadata (permissions, timestamps) won't force a file transfer.
> 

Ok, so, I assume the file just has be to replaced, and even if exact same contents and same size, that the OS (or mirrors) figures out it changed. 
Seems like magic to me :) 

> 
> > -rwxrwxrwx+ 1 david_williams callistoadmin 136555 2006-03-13 15:06
> > org.eclipse.gmf.map.edit_1.0.0.v200603031600.jar
> 
> Please don't set files world-writable on our servers.
> 

Ok, thanks. 

> 
> > As of this writing, the 'TIME' file in /callisto says
> > 1142398801 
> > if anyone knows how to read that. Does *that* need to be updated, somehow? To
> > force a refresh? 
> 
> You've had a TIME file in webtools since 2004. It works the same way ;)
> 


"Works the same way", eh .... so, 100 times 0 is still zero :) 
Meaning, I dont' understand how they work there either, other than what you taught me before, which was "they are used by mirrors sites to know if they are in synch". (and maybe that's all I should know :) 

Comment 11 David Williams CLA 2006-03-15 14:42:34 EST
(In reply to comment #6)
> The problem file has the word "map" in the file name. The version of Apache I
> am running has an entry "AddHandler imap-file map", for serve parsed imagemap
> files. Commenting out this entry fixes the file download problem.
> 
> Server version: Apache/2.0.46
> Server built:   Dec 15 2005 04:19:10
> httpd-2.0.46-56.ent
> Red Hat Enterprise Linux ES release 3 (Taroon Update 6)
> 


Thanks for tracking this down this odd "bug", Mark. Restores my trust in Eclipse servers, even though reinforces my view that servers in general are never to be trusted :) 

Comment 12 Eclipse Webmaster CLA 2006-03-15 14:43:26 EST
> Ok, so, I assume the file just has be to replaced, and even if exact same
> contents and same size

I'm not sure how rsync will handle this.  One would have to test.


> "Works the same way", eh .... so, 100 times 0 is still zero :) 
> Meaning, I dont' understand how they work there either, other than what you
> taught me before, which was "they are used by mirrors sites to know if they are
> in synch". (and maybe that's all I should know :) 
> 

Ask me at EclipseCON, over a nice cold beer.  ;)

D.
Comment 13 Eclipse Webmaster CLA 2006-03-17 14:43:59 EST
Closing as WHATAFREAKBUG

I sent an e-mail to the offending public mirror.

Looking back, it was a good catch, thanks David.

D.
Comment 14 Eclipse Webmaster CLA 2006-03-17 14:44:13 EST
.