[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [p2-dev] Problems mirroring latest Ganymede repositoryusingp2mirror apps


I looked into this, and there are two problems:

1) You are passing in a local file system path rather than a URL as the destination.
2) Our error handling is atrocious.

You'll need to fix 1) by providing a file: URL for the destination, but I have entered the following bugs for 2):

https://bugs.eclipse.org/bugs/show_bug.cgi?id=268165
https://bugs.eclipse.org/bugs/show_bug.cgi?id=268168

John



Terry Parker <tparker@xxxxxxxxxx>
Sent by: p2-dev-bounces@xxxxxxxxxxx

03/05/2009 12:29 PM

Please respond to
P2 developer discussions <p2-dev@xxxxxxxxxxx>

To
P2 developer discussions <p2-dev@xxxxxxxxxxx>
cc
Subject
Re: [p2-dev] Problems mirroring latest Ganymede        repositoryusingp2mirror apps





Thanks Martin.

Initially I tried mirroring with 3.5 M4.  I just retried with 3.5 M5.
(eclipse.buildId=I20090202-1535)

Unfortunately when I try the above commands I get an NPE with the
metadata mirroring:

java.lang.NullPointerException
       at org.eclipse.equinox.internal.provisional.spi.p2.metadata.repository.SimpleMetadataRepositoryFactory.create(SimpleMetadataRepositoryFactory.java:32)
       at org.eclipse.equinox.internal.p2.metadata.repository.MetadataRepositoryManager.factoryCreate(MetadataRepositoryManager.java:47)
       at org.eclipse.equinox.internal.p2.core.helpers.AbstractRepositoryManager.doCreateRepository(AbstractRepositoryManager.java:259)
       at org.eclipse.equinox.internal.p2.metadata.repository.MetadataRepositoryManager.createRepository(MetadataRepositoryManager.java:40)
       at org.eclipse.equinox.internal.p2.metadata.mirror.MirrorApplication.initializeDestination(MirrorApplication.java:126)
       at org.eclipse.equinox.internal.p2.metadata.mirror.MirrorApplication.setupRepositories(MirrorApplication.java:90)

and an USE with artifiact mirroring:
java.lang.UnsupportedOperationException: Repository not modifiable: /tmp/342_a/
       at org.eclipse.equinox.internal.provisional.spi.p2.core.repository.AbstractRepository.assertModifiable(AbstractRepository.java:53)
       at org.eclipse.equinox.internal.p2.artifact.repository.simple.SimpleArtifactRepository.save(SimpleArtifactRepository.java:842)
       at org.eclipse.equinox.internal.p2.artifact.repository.simple.SimpleArtifactRepository.save(SimpleArtifactRepository.java:838)
       at org.eclipse.equinox.internal.p2.artifact.repository.simple.SimpleArtifactRepository.<init>(SimpleArtifactRepository.java:292)
       at org.eclipse.equinox.internal.provisional.spi.p2.artifact.repository.SimpleArtifactRepositoryFactory.create(SimpleArtifactRepositoryFactory.java:110)
       at org.eclipse.equinox.internal.p2.artifact.repository.ArtifactRepositoryManager.factoryCreate(ArtifactRepositoryManager.java:52)
       at org.eclipse.equinox.internal.p2.core.helpers.AbstractRepositoryManager.doCreateRepository(AbstractRepositoryManager.java:259)
       at org.eclipse.equinox.internal.p2.artifact.repository.ArtifactRepositoryManager.createRepository(ArtifactRepositoryManager.java:45)
       at org.eclipse.equinox.internal.p2.artifact.mirror.MirrorApplication.initializeDestination(MirrorApplication.java:137)
       at org.eclipse.equinox.internal.p2.artifact.mirror.MirrorApplication.setupRepositories(MirrorApplication.java:113)

Known bugs?  I'll try rebuilding at head today and see if I have any
better luck.

--Terry

On Thu, Mar 5, 2009 at 3:17 AM, Daffin, Miles (IDEAS)
<Miles.Daffin@xxxxxxxxxxxxxxxxx> wrote:
> I notice that the agent download is available on the 3.5 integration and nightly builds. However, I would prefer a stable 3.5M5 version.
>
> Thanks,
>
> Miles Daffin
> Morgan Stanley | IDEAS Practice Areas
> 20 Cabot Square | Canary Wharf | Floor 01
> London, E14 4QW
> Phone: +44 20 7677-5119
> Fax: +44 20 7056-4572
> Miles.Daffin@xxxxxxxxxxxxxxxxx
>
> -----Original Message-----
> From: p2-dev-bounces@xxxxxxxxxxx [mailto:p2-dev-bounces@xxxxxxxxxxx] On Behalf Of Daffin, Miles (IDEAS)
> Sent: 05 March 2009 11:12
> To: P2 developer discussions
> Cc: Yu, Aaron (IDEAS)
> Subject: RE: [p2-dev] Problems mirroring latest Ganymede repository usingp2mirror apps
>
> Just went browsing for the 3.5M5 agent download. It is missing from the Provisioning section of the downloads page:
>
> http://download.eclipse.org/equinox/drops/S-3.5M5-200902021535/index.php
>
> Are the apps now disted in a different download?
>
> Thanks,
>
> Miles Daffin
> Morgan Stanley | IDEAS Practice Areas
> 20 Cabot Square | Canary Wharf | Floor 01 London, E14 4QW
> Phone: +44 20 7677-5119
> Fax: +44 20 7056-4572
> Miles.Daffin@xxxxxxxxxxxxxxxxx
>
> -----Original Message-----
> From: p2-dev-bounces@xxxxxxxxxxx [mailto:p2-dev-bounces@xxxxxxxxxxx] On Behalf Of Daffin, Miles (IDEAS)
> Sent: 05 March 2009 10:43
> To: P2 developer discussions
> Cc: Yu, Aaron (IDEAS)
> Subject: RE: [p2-dev] Problems mirroring latest Ganymede repository using p2mirror apps
>
> Hi Martin,
>
> I am using the mirror tools from the 3.5M3 release. I used these to mirror the 3.4.0 and 3.4.1 Ganymede repositories with apparent success. I will see if the 3.5M5 versions work any better and let you know.
>
> As an experiment, I used a mirroring tool based on the old standalone update manager to mirror the Ganymede site and ended up with many more features and plugins than when using the 3.5M3 p2 mirror apps. How can 2 technologies have such different results when mirroring the same repository? It leads me to believe that something, somewhere, is very broken...
>
> Regards,
>
> Miles Daffin
> Morgan Stanley | IDEAS Practice Areas
> 20 Cabot Square | Canary Wharf | Floor 01 London, E14 4QW
> Phone: +44 20 7677-5119
> Fax: +44 20 7056-4572
> Miles.Daffin@xxxxxxxxxxxxxxxxx
>
> -----Original Message-----
> From: p2-dev-bounces@xxxxxxxxxxx [mailto:p2-dev-bounces@xxxxxxxxxxx] On Behalf Of Oberhuber, Martin
> Sent: 05 March 2009 09:30
> To: P2 developer discussions
> Cc: Yu, Aaron (IDEAS)
> Subject: RE: [p2-dev] Problems mirroring latest Ganymede repository using p2 mirror apps
>
> Hi Terry,
>
> what version of the mirroring tools did you use? I know that some changes went into 3.5m5 due to issues with packed contents, and for improving retry behavior in case of download errors:
>  https://bugs.eclipse.org/bugs/show_bug.cgi?id=257230
>  https://bugs.eclipse.org/bugs/show_bug.cgi?id=258680#c10
>
> In another case, a single incorrect bundle in the metadata caused problems when mirroring:
>  https://bugs.eclipse.org/bugs/show_bug.cgi?id=258683
>
> Did you try the p2 mirroring app with an earlier Ganymede release and did it work then (Same question goes to Miles)?
>
> Cheers,
> --
> Martin Oberhuber, Senior Member of Technical Staff, Wind River Target Management Project Lead, DSDP PMC Member http://www.eclipse.org/dsdp/tm
>
>
>
>> -----Original Message-----
>> From: p2-dev-bounces@xxxxxxxxxxx
>> [mailto:p2-dev-bounces@xxxxxxxxxxx] On Behalf Of Terry Parker
>> Sent: Mittwoch, 04. März 2009 23:40
>> To: P2 developer discussions
>> Cc: Yu, Aaron (IDEAS)
>> Subject: Re: [p2-dev] Problems mirroring latest Ganymede repository
>> using p2 mirror apps
>>
>> I'm having the same issue.  I tried to mirror the 3.4.2 IUs using the
>> 3.4 update site, but while metadata for 3.4.2 artifacts show up, the
>> artifacts themselves do not:
>>
>> eclipse \
>>     -nosplash \
>>     -application
>> org.eclipse.equinox.p2.metadata.repository.mirrorApplication \
>>     -source http://download.eclipse.org/eclipse/updates/3.4/ \
>>     -destination /tmp/342
>>
>> eclipse \
>>     -nosplash \
>>     -application
>> org.eclipse.equinox.p2.artifact.repository.mirrorApplication \
>>     -source http://download.eclipse.org/eclipse/updates/3.4/ \
>>     -destination /tmp/342
>>
>> $ cd /tmp/342
>> $ unzip content.jar
>> $ unzip artifacts.jar
>> $ grep "<unit id.*version='3.4.2.M20090211-1700'" content.xml | wc -l
>> 173
>> $ grep "<artifact.*version='3.4.2.M20090211-1700'" content.xml | wc -l
>> 34
>>
>> Only the binary artifacts seem to get mirrored, and when I try to do
>> an install from the mirrored repository I get ~100 messages like:
>>
>> !MESSAGE No repository found containing:
>> org.eclipse.core.resources/osgi.bundle/3.4.2.R34x_v20090126
>>
>> Where are the artifacts being stored and how can I mirror them?
>>
>> --Terry Parker
>>
>> On Wed, Mar 4, 2009 at 12:33 PM, Daffin, Miles (IDEAS)
>> <Miles.Daffin@xxxxxxxxxxxxxxxxx> wrote:
>> > Hi Folks,
>> >
>> > 3.4.2 is just out and I am trying to bring it in house. As
>> ever this is
>> > proving difficult.
>> >
>> > The Eclipse platform repo apparently mirrored OK. There
>> were errors, so I
>> > had to use the -ignoreerrors flag, but I could install all
>> IUs from the
>> > mirror into a 3.4.1 install, except one: come.ibm.base.feature.group
>> > (reported in email yesterday). However, testing of my
>> Ganymede mirror
>> > failed.
>> >
>> > I started by trying to install all the C and C++
>> Development IUs. The
>> > selection was validated and I pressed the Finish button on
>> the Install
>> > dialog. Things progressed for a while then I got this error:
>> >
>> > An error occurred while collecting items to be installed
>> >   No repository found containing:
>> > org.eclipse.datatools.connectivity/osgi.bundle/1.1.2.v200901090028
>> >   No repository found containing:
>> >
>> org.eclipse.datatools.connectivity.sqm.core/osgi.bundle/1.0.7.
>> v200902180551
>> >   No repository found containing:
>> >
>> org.eclipse.datatools.connectivity.sqm.server.ui/osgi.bundle/1
>> .1.3.v200902120834
>> >   No repository found containing:
>> > org.eclipse.datatools.modelbase.sql/osgi.bundle/1.0.1.v200812031125
>> >   No repository found containing:
>> > org.eclipse.jpt.core/osgi.bundle/2.0.102.v200901160200
>> >   No repository found containing:
>> > org.eclipse.mylyn.ide.ui/osgi.bundle/3.0.5.v20090218-1800-e3x
>> >   No repository found containing:
>> > org.eclipse.mylyn.monitor.ui/osgi.bundle/3.0.5.v20090218-1800-e3x
>> >   No repository found containing:
>> > org.eclipse.mylyn.resources.ui/osgi.bundle/3.0.5.v20090218-1800-e3x
>> >   No repository found containing:
>> > org.eclipse.net4j/osgi.bundle/1.0.8.v200902231136
>> >   No repository found containing:
>> > org.eclipse.net4j.jms.api/osgi.bundle/1.0.8.v200902231136
>> >   No repository found containing:
>> >
>> org.eclipse.tptp.platform.iac.administrator/osgi.bundle/4.4.20
>> 1.v200901100100
>> >   No repository found containing:
>> > org.eclipse.cdt.core/osgi.bundle/5.0.2.200902130801
>> >   No repository found containing:
>> > org.eclipse.cdt.core.win32/osgi.bundle/5.0.0.200902130801
>> >   No repository found containing:
>> > org.eclipse.cdt.debug.mi.core/osgi.bundle/5.0.1.200902130801
>> >   No repository found containing:
>> > org.eclipse.cdt.managedbuilder.core/osgi.bundle/5.0.2.200902130801
>> >   No repository found containing:
>> > org.eclipse.cdt.managedbuilder.ui/osgi.bundle/5.0.2.200902130801
>> >   No repository found containing:
>> >
>> org.eclipse.cdt.platform/org.eclipse.update.feature/5.0.2.200902130801
>> > I tried installing the same list of IUs from the external
>> Ganymede site, and
>> > was successful. So, somehow, even though there were no
>> errors during the
>> > mirroring process, my Ganymede mirror seems broken. I am
>> using the p2 mirror
>> > apps from the 3.5M3 release.
>> >
>> > About 1500 people at my company are currently tapping their
>> feet, waiting
>> > for me to make 3.4.2 available internally. I would really
>> appreciate some
>> > advice/help.
>> >
>> > Regards,
>> >
>> > Miles Daffin
>> > Morgan Stanley | IDEAS Practice Areas 20 Cabot Square | Canary Wharf
>> > | Floor 01 London, E14 4QW
>> > Phone: +44 20 7677-5119
>> > Fax: +44 20 7056-4572
>> > Miles.Daffin@xxxxxxxxxxxxxxxxx
>> >
>> > ________________________________
>> >
>> > NOTICE: If received in error, please destroy and notify
>> sender. Sender does
>> > not intend to waive confidentiality or privilege. Use of
>> this email is
>> > prohibited when received in error.
>> >
>> > _______________________________________________
>> > p2-dev mailing list
>> > p2-dev@xxxxxxxxxxx
>> > https://dev.eclipse.org/mailman/listinfo/p2-dev
>> >
>> >
>> _______________________________________________
>> p2-dev mailing list
>> p2-dev@xxxxxxxxxxx
>> https://dev.eclipse.org/mailman/listinfo/p2-dev
>>
> _______________________________________________
> p2-dev mailing list
> p2-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/p2-dev
>
> --------------------------------------------------------------------------
> NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error.
> _______________________________________________
> p2-dev mailing list
> p2-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/p2-dev
>
> --------------------------------------------------------------------------
> NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error.
> _______________________________________________
> p2-dev mailing list
> p2-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/p2-dev
>
> --------------------------------------------------------------------------
> NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error.
> _______________________________________________
> p2-dev mailing list
> p2-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/p2-dev
>
_______________________________________________
p2-dev mailing list
p2-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/p2-dev