Bug 244238 - [releng] WikiText packages are only available for download via an eclipse update site
Summary: [releng] WikiText packages are only available for download via an eclipse upd...
Status: RESOLVED FIXED
Alias: None
Product: z_Archived
Classification: Eclipse Foundation
Component: Mylyn (show other bugs)
Version: unspecified   Edit
Hardware: All All
: P2 normal (vote)
Target Milestone: 1.0.0   Edit
Assignee: David Green CLA
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on: 243202
Blocks: 244650
  Show dependency tree
 
Reported: 2008-08-14 16:41 EDT by David Green CLA
Modified: 2011-01-05 10:55 EST (History)
4 users (show)

See Also:


Attachments
patch to build system (2.08 KB, patch)
2008-11-03 18:14 EST, David Green CLA
no flags Details | Diff
patch to build that produces standalone zip (3.88 KB, patch)
2008-11-04 12:02 EST, David Green CLA
no flags Details | Diff
mylyn/context/zip (1.48 KB, application/octet-stream)
2008-11-04 12:02 EST, David Green CLA
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description David Green CLA 2008-08-14 16:41:47 EDT
While WikiText is packaged as Eclipse plug-ins, stand-alone usage is also possible (for example as Ant tasks or in a server product not using the Eclipse runtime).

The WikiText jars should be available for download from a web browser.
Comment 1 David Green CLA 2008-11-03 15:39:23 EST
What's the best way of moving this one forward?  

Ideally there would be an area on the "Mylyn Downloads":http://www.eclipse.org/mylyn/downloads/ page that would facilitate downloading specific WikiText jars using a web browser.

With recent support for DITA added to WikiText the demand for easy access to jar files is increasing.  Also I would like to help users of Textile-J migrate to WikiText now that WikiText is nearing readiness to move out of incubation.
Comment 2 Steffen Pingel CLA 2008-11-03 16:03:22 EST
If you can create an ant file that packages zip or jar files we can invoke that from the build scripts and copy the artifacts to the download area on the eclipse servers. The current upload script creates a tar ball that is copied using scp so it should be no problem to add additional files to the process.
Comment 3 David Green CLA 2008-11-03 16:16:44 EST
(In reply to comment #2)
> If you can create an ant file that packages zip or jar files we can invoke that
> from the build scripts and copy the artifacts to the download area on the
> eclipse servers. The current upload script creates a tar ball that is copied
> using scp so it should be no problem to add additional files to the process.

awesome.  where's the best place to put this Ant script?
Comment 4 Steffen Pingel CLA 2008-11-03 17:52:24 EST
All build related stuff is in org.eclipse.mylyn.releng. You could also consider puting it into one of the wikitext plug-ins in case users want to rebuild the jars without getting other Mylyn plug-ins.
Comment 5 David Green CLA 2008-11-03 18:14:32 EST
Created attachment 116885 [details]
patch to build system

here's a patch that alters the build system to create an archive containing relevant jar files.

I'm having troubles testing it because of bug 243202
Comment 6 David Green CLA 2008-11-04 12:02:23 EST
Created attachment 116967 [details]
patch to build that produces standalone zip

this patch produces a standalone zip file for downloading WikiText

After running the build locally I have the following:

bc. 
dgreen:build dgreen$ pwd
/Users/dgreen/Documents/workspace-mylyn.wikitext/org.eclipse.mylyn.releng/3.4/build
dgreen:build dgreen$ ls -al *.zip
-rw-r--r--  1 dgreen  dgreen  11045839  4 Nov 08:53 mylyn-3.1.0.I20080926-0300-all.zip
-rw-r--r--  1 dgreen  dgreen   4142363  4 Nov 08:52 mylyn-3.1.0.I20080926-0300-e3.4.zip
-rw-r--r--  1 dgreen  dgreen   3259010  4 Nov 08:52 mylyn-3.1.0.I20080926-0300-extras.zip
-rw-r--r--  1 dgreen  dgreen   4584400  4 Nov 08:52 mylyn-3.1.0.I20080926-0300-incubator.zip
-rw-r--r--  1 dgreen  dgreen    831421  4 Nov 08:52 mylyn-wikitext-standalone-3.1.0.I20080926-0300.zip
Comment 7 David Green CLA 2008-11-04 12:02:27 EST
Created attachment 116968 [details]
mylyn/context/zip
Comment 8 David Green CLA 2008-11-04 12:03:23 EST
Steffen, can you integrate the latest patch into the build process?  I'm not sure how the uploading part should work.
Comment 9 David Green CLA 2008-11-04 12:05:10 EST
the contents of the zip archive are as follows:

bc. 
drwxr-xr-x   13 dgreen  dgreen     442  4 Nov 08:52 docs
-rw-r--r--    1 dgreen  dgreen    6585 31 Jul 10:58 license.html
-rw-r--r--    1 dgreen  dgreen   35902  4 Nov 08:52 org.eclipse.mylyn.wikitext.confluence.core_0.9.0.I20080926-0300-e3x.jar
-rw-r--r--    1 dgreen  dgreen  189055  4 Nov 08:52 org.eclipse.mylyn.wikitext.core_0.9.0.I20080926-0300-e3x.jar
-rw-r--r--    1 dgreen  dgreen   41747  4 Nov 08:52 org.eclipse.mylyn.wikitext.mediawiki.core_0.9.0.I20080926-0300-e3x.jar
-rw-r--r--    1 dgreen  dgreen   48925  4 Nov 08:52 org.eclipse.mylyn.wikitext.textile.core_0.9.0.I20080926-0300-e3x.jar
-rw-r--r--    1 dgreen  dgreen   29337  4 Nov 08:52 org.eclipse.mylyn.wikitext.tracwiki.core_0.9.0.I20080926-0300-e3x.jar
-rw-r--r--    1 dgreen  dgreen   35660  4 Nov 08:52 org.eclipse.mylyn.wikitext.twiki.core_0.9.0.I20080926-0300-e3x.jar
Comment 10 David Green CLA 2008-11-04 13:21:29 EST
Mik,

Is a release review required prior to making these available?  Steffen expressed some concerns about this.  These jars are already available via the Mylyn incubator update site.
Comment 11 Steffen Pingel CLA 2008-11-04 21:28:25 EST
I have applied the patch with a minor modification. The zip archive is now called: mylyn-wikitext-standalone-${majorVersion}.${mylynQualifier}_incubation.zip. 

Mik, is this okay to release on the download page?
Comment 12 Mik Kersten CLA 2008-11-05 12:32:17 EST
Yes.
Comment 13 Steffen Pingel CLA 2008-11-05 17:09:59 EST
The download should become available here soon:

 http://www.eclipse.org/downloads/download.php?file=/tools/mylyn/update-archive/3.1.0/I20081105-1900/mylyn-wikitext-standalone-3.1.0.I20081105-1900_incubation.zip

We'll have to figure out how to integrate that into the download page.
Comment 14 David Green CLA 2008-11-05 18:07:31 EST
(In reply to comment #13)
> We'll have to figure out how to integrate that into the download page.

Awesome!  

Is the issue that we don't want to have to change an URL in the wiki page every time we do a new build -- and the URL has lots of version number in it?
Comment 15 Steffen Pingel CLA 2008-11-05 18:47:52 EST
We could always copy the latest version to here /tools/mylyn/update/mylyn-wikitext-standalone-latest_incubation.zip as part of the upload in addition to linking stable releases.
Comment 16 David Green CLA 2008-11-05 18:49:50 EST
(In reply to comment #15)
> We could always copy the latest version to here
> /tools/mylyn/update/mylyn-wikitext-standalone-latest_incubation.zip as part of
> the upload in addition to linking stable releases.
> 

Sounds good to me!
Comment 17 David Green CLA 2008-11-09 15:15:43 EST
(In reply to comment #13)
> The download should become available here soon:
> 
> http://www.eclipse.org/downloads/download.php?file=/tools/mylyn/update-archive/3.1.0/I20081105-1900/mylyn-wikitext-standalone-3.1.0.I20081105-1900_incubation.zip

Steffen, we're 90% of the way there... what will it take to get a download link on the Mylyn  downloads page?  Is there something that I can do?
Comment 18 Steffen Pingel CLA 2008-11-09 16:46:26 EST
Do you have an idea how you want wikitext to be integrated on the download page? Should there be a new top level section, e.g. above Extensions?
Comment 19 David Green CLA 2008-11-10 00:27:06 EST
(In reply to comment #18)
> Do you have an idea how you want wikitext to be integrated on the download
> page? Should there be a new top level section, e.g. above Extensions?

Yes, a new top-level section sounds good.  Something like this:

h3. WikiText Stand-Alone (Incubation)

The stand-alone distribution of WikiText for use outside of an Eclipse runtime.  Provides Ant tasks and APIs for parsing wiki markup to HTML, Docbook, DITA, and Eclipse Help.

"WikiText Download":http://www.eclipse.org/downloads/download.php?file=/tools/mylyn/update-archive/mylyn-wikitext-standalone-latest_incubation.zip
Comment 20 Steffen Pingel CLA 2008-11-10 02:53:35 EST
Good. I'll look into adding that.
Comment 21 Steffen Pingel CLA 2008-11-10 14:18:31 EST
David, the wikitext version is still 0.9.0 which will prevent recent integration builds to get installed when a 0.9.0 release version is installed. Is it okay if I bump the version of all wikitext plug-ins to 0.9.1?
Comment 22 David Green CLA 2008-11-10 17:46:28 EST
(In reply to comment #21)
> David, the wikitext version is still 0.9.0 which will prevent recent
> integration builds to get installed when a 0.9.0 release version is installed.
> Is it okay if I bump the version of all wikitext plug-ins to 0.9.1?
> 

Steffen, yes, please bump the version number.  

I'm used to this happening automatically by the build (our builds use the SVN revision for the 3rd part of the version number).  How should this be handled in the future?  Am I supposed to increment that number every time there's a change?
Comment 23 Steffen Pingel CLA 2008-11-10 18:00:03 EST
I have added the link to the download page. The file should be available from mirrors within an hour.

> I'm used to this happening automatically by the build (our builds use the SVN
> revision for the 3rd part of the version number).  How should this be handled in
> the future?  Am I supposed to increment that number every time there's a change?

So far we have been using a script that increases version numbers for all plug-ins after a release. This is simple but sub-optimal since it will also affect plug-ins that do not have actually changed. I am afraid that a manual process would be very fragile as it could be easily forgotten that a version number needs be increased. Ideally there would be tools for doing this but I don't know of any. 

Maybe we could build a script that checks if there have been changes for a plug-in and bumps the version number in that case?

Note that the fourth version segment is calculated from the current date, so every new build will automatically get a higher number. This only "breaks" when we do release builds which start with a 'v' instead of 'I', e.g.: 0.9.0.v20081015-1500 is higher than 0.9.0.I20081108-0000 .
Comment 24 David Green CLA 2008-11-10 19:07:08 EST
nice work!  Marking as fixed.