Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [tycho-user] 0.23.0: Problem creating zip

Hello,
I confirm that 0.23.1 version of Tycho resolve the (org.codehaus.plexus.archiver.ArchiverException: Problem creating zip) problem on linux/windows.
Thanks for your work.

Regards
Vincent

-----Message d'origine-----
De : tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx] De la part de SCHREIBER.Martin
Envoyé : mercredi 17 juin 2015 08:10
À : Tycho user list
Objet : Re: [tycho-user] 0.23.0: Problem creating zip

Looks like the plexus-archiver version which is used in Tycho 0.23.0 does have a bug which cases "Too many open files" Exceptions:
https://github.com/codehaus-plexus/plexus-archiver/issues/6

Also the memory issue seems to be related:
https://github.com/codehaus-plexus/plexus-archiver/issues/5 

I am working on getting a plexus-archiver version into tycho which does not have thoses issues (See also: https://bugs.eclipse.org/bugs/show_bug.cgi?id=470074)

Regards
Martin


-----Ursprüngliche Nachricht-----
Von: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx] Im Auftrag von Sievers, Jan
Gesendet: Mittwoch, 10. Juni 2015 09:32
An: Tycho user list
Betreff: Re: [tycho-user] 0.23.0: Problem creating zip

this doesn't sound good.

IMHO creating an archive should be stream-based so should not require more heap when creating bigger archives...

If you can isolate a sample project, open a Tycho bug.

Regards
Jan

From: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx] On Behalf Of SCHREIBER.Martin
Sent: Mittwoch, 10. Juni 2015 07:55
To: Tycho user list
Subject: Re: [tycho-user] 0.23.0: Problem creating zip

Somehow related to Vincent's issue or at least to the update of the plexus archiver:

After switching to 0.23.0 we had Java heap space issues building our products (which contain large zip files): 

Error packing p2 repository: Problem creating zip: Execution exception (and the archive is probably corrupt but I could not delete it): Java heap space 

Increasing the heap space from 1024m to 2048m solved the problem.
So the new version of the plexus-archiver might need more memory and more file handles as before. 
Is this something we should report to them?

-martin




Von: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx] Im Auftrag von David M Williams
Gesendet: Dienstag, 09. Juni 2015 20:27
An: Tycho user list
Betreff: Re: [tycho-user] 0.23.0: Problem creating zip

I've seen this "Too many open files" error twice, in my local builds (non NFS file system) -- out of several scores of test builds -- and each time it occurred, I'd re-build, and then would not occur. 
(So, I suspect a bug somewhere ... but, may be hard to isolate, since occurs so rarely, for me.) 




From:        "Sievers, Jan" <jan.sievers@xxxxxxx>
To:        Tycho user list <tycho-user@xxxxxxxxxxx>,
Date:        06/09/2015 11:44 AM
Subject:        Re: [tycho-user] 0.23.0:  Problem creating zip Sent by:        tycho-user-bounces@xxxxxxxxxxx ________________________________________



might be caused by new plexus-archiver

https://bugs.eclipse.org/bugs/show_bug.cgi?id=461974

not sure if it's a bug.
It could be simply that you were always near the file handle limit and the algorithm changed slightly so you now exceed the limit.

on Linux, you can monitor open files with lsof, e.g.

watch 'lsof | wc -l'

you may want to check the limit

sysctl -a | grep fs.file-max

and increase it using sysctl -w

Regards
Jan






From: tycho-user-bounces@xxxxxxxxxxx [mailto:tycho-user-bounces@xxxxxxxxxxx] On Behalf Of Vincent GUIGNOT
Sent: Dienstag, 9. Juni 2015 17:02
To: Tycho user list
Subject: [tycho-user] 0.23.0: Problem creating zip

Hello,
I'm trying to pass from tycho 0.22.0 to 0.23.0. The build fails with 0.23.0 on the archive-product goal from org.eclipse.tycho:tycho-p2-director-plugin:0.23.0:archive-products with error Too many open files.
It works when using 0.22.0 tycho version.


The files to be zipped are an Arm toolchain hosted on a fragment. The toolchain contains many files with many directories.


Error code are :
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.eclipse.tycho:tycho-p2-director-plugin:0.23.0:archive-products (archive-products) on project com.ingenico.ingedev.product.ui: Error packing product
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
        at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:355)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:155)
        at org.apache.maven.cli.MavenCli.execute(MavenCli.java:584)
        at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:216)
        at org.apache.maven.cli.MavenCli.main(MavenCli.java:160)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
        at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
        at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Error packing product
        at org.eclipse.tycho.plugins.p2.director.ProductArchiverMojo.execute(ProductArchiverMojo.java:142)
        at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
        ... 19 more
Caused by: org.codehaus.plexus.archiver.ArchiverException: Problem creating zip: /home/vguignot/git/xxxx/Products/xxxx/target/products/xxxx/win32/win32/x86/plugins/xxxx.bin.win32.tools_7.28.0.20150609/os/win32/tools/lib/sre_parse.py (Too many open files)
        at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:1007)
        at org.eclipse.tycho.plugins.p2.director.ProductArchiverMojo.execute(ProductArchiverMojo.java:139)
        ... 21 more
Caused by: java.io.FileNotFoundException: /home/vguignot/git/xxxx/Products/xxxx/target/products/xxxx/win32/win32/x86/plugins/xxxx.bin.win32.tools_7.28.0.20150609/os/win32/tools/lib/sre_parse.py (Too many open files)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:146)
        at org.codehaus.plexus.components.io.resources.PlexusIoFileResource$1.getContents(PlexusIoFileResource.java:99)
        at org.codehaus.plexus.components.io.resources.PlexusIoFileResource.getContents(PlexusIoFileResource.java:124)
        at org.codehaus.plexus.archiver.ArchiveEntry.getInputStream(ArchiveEntry.java:126)
        at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.zipFile(AbstractZipArchiver.java:491)
        at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.addResources(AbstractZipArchiver.java:365)
        at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.createArchiveMain(AbstractZipArchiver.java:321)
        at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.execute(AbstractZipArchiver.java:222)
        at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:990)
        ... 22 more
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/tycho-user
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/tycho-user
_______________________________________________
tycho-user mailing list
tycho-user@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/tycho-user


Back to the top