Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [epp-dev] Oygen EPP builds hanging in package-dmg or macsigner-sign

The current job might time out in the 6 hours window even though it is not stuck. Just really, really slow…

https://hudson.eclipse.org/packaging/job/oxygen.epp-tycho-build/312

Any idea what is slowing down the build so much?

 

Regards,

Arthur

 

Von: epp-dev-bounces@xxxxxxxxxxx [mailto:epp-dev-bounces@xxxxxxxxxxx] Im Auftrag von Markus Knauer
Gesendet: Freitag, 9. Juni 2017 07:44
An: Eclipse Packaging Project
Betreff: Re: [epp-dev] Oygen EPP builds hanging in package-dmg or macsigner-sign

 

Success... the last build finished some time this night!

Thanks,

Markus

 

On 8 June 2017 at 23:23, Markus Knauer <mknauer23@xxxxxxxxx> wrote:

I'm crossing fingers!

Thanks, Markus

On Thu 8. Jun 2017 at 22:06, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

I just aborted it because it was stuck and my previous patch to the CBI maven plugins was incomplete. I've started a new build and wait for the output. It will probably be the last try I can do tonight. If it does not work, let's talk tomorrow morning about plan B. 

 

Cheers

 

Le jeu. 8 juin 2017 à 22:02, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

Can you see anything in the logs that would help to find the problem?

Thanks,

Markus

 

 

On 8 June 2017 at 19:51, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Thanks Markus. I've god mode on all HIPPs but never touch anything without being asked or asking permission first. I don't think I will need to tweak it anymore than it is now, but will let you know.

 

Thanks.

Mikael

 

 

Le 8 juin 2017 à 19:41, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

 

Done.

- Build #299 manually stopped

- Build #300 started: https://hudson.eclipse.org/packaging/job/oxygen.epp-tycho-build/300/

Mikael, I've added your user ID to the Hudson job configuration... maybe that makes it easier for you to look at it.

Thanks,

Markus

 

 

On 8 June 2017 at 19:28, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Build seems to be hanging once again. The request on which the hanging occur never reached the server... Could you please try another build with full maven debug output (Verbosity=DEBUG)? 

 

FYI, I've re-published a new 1.1.5-SNAPSHOT of the maven plugins with additional debug logging

 

Thanks.

 

 

Le 8 juin 2017 à 17:45, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

 

I've merged the change and triggered a new build https://hudson.eclipse.org/packaging/job/oxygen.epp-tycho-build/299/

Thanks,

Markus

 

On 8 June 2017 at 17:06, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Seems to be new problem :( 

 

Le 8 juin 2017 à 17:02, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

 

I'd immediately +2 the change, but now I see a lot of other errors like this in the verification build https://hudson.eclipse.org/packaging/job/epp-tycho-build.gerrit/541/consoleFull


[INFO] --- eclipse-dmg-packager:1.1.5-SNAPSHOT:package-dmg (default) @ epp.package.cpp ---
Downloading: https://oss.sonatype.org/content/repositories/public/org/apache/maven/maven-plugin-api/3.1.0/maven-plugin-api-3.1.0.pom
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: I/O exception (java.net.SocketException) caught when processing request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443: Connection reset
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: Retrying request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: I/O exception (java.net.SocketException) caught when processing request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443: Connection reset
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: Retrying request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: I/O exception (java.net.SocketException) caught when processing request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443: Connection reset
Jun 08, 2017 10:45:07 AM org.apache.maven.wagon.providers.http.httpclient.impl.execchain.RetryExec execute
INFO: Retrying request to {tls}->http://proxy.eclipse.org:9898->https://oss.sonatype.org:443

 

Are there additional new problems, or is this magically related?

 

Regards,

Markus

 

On 8 June 2017 at 16:37, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Yes, continueOnFail is false per default. And yes, the build will simply fail faster instead of timing out (from the Hudson timeout). I've also tweak a bit the server side, and should be able to diagnose the issue when it happens again. So far, I have no clue what makes the whole thing hanging :(

 

 

 

Le 8 juin 2017 à 16:32, Arthur van Dorp <Arthur.vanDorp@xxxxxxxxxxxxxxxx> a écrit :

 

Thanks a lot for your efforts. continueOnFail ist false per default as with the jarsigner? So the build would simply fail faster instead of timing out?

 

Regards,

Arthur

 

Von: epp-dev-bounces@xxxxxxxxxxx [mailto:epp-dev-bounces@xxxxxxxxxxx] Im Auftrag von Mikael Barbero
Gesendet: Donnerstag, 8. Juni 2017 16:22
An: Eclipse Packaging Project
Betreff: Re: [epp-dev] Oygen EPP builds hanging in package-dmg or macsigner-sign

 

Done. The change is here https://git.eclipse.org/r/98913

 

Once one or two epp are correctly build in the gerrit job, I think it's safe to interrupt it and merge the change, so you can merge it and try a standard build (which actually sign the dmg, whereas the gerrit build doesn't). Of course, it's up to you if you want to wait for the full gerrit build to be finished ;)

 

Cheers,

Mikael

 

Le 8 juin 2017 à 16:07, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

 

Sure, just ping me.

Seems it could help both of us ;-)

Thanks,

Markus

 

On 8 June 2017 at 16:00, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Hi Markus,

 

I've made the change on the CBI side and I'm about to submit a review to EPP which add the timeout. If we can try one build with these, it would help me a lot!

 

Thanks.

Mikael

 

Le 8 juin 2017 à 15:58, Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx> a écrit :

 

Any progress or new insights?

I've been checking all the builds in the last days: All of them were failing and timed out after about 6 hours.

The currently running build https://hudson.eclipse.org/packaging/job/oxygen.epp-tycho-build/298/console was supposed to be the last one for RC3, but after more than 4 hours it seems to be stuck at a similar position. I'm a bit concerned because at some point we need to decide about alternatives.

Thanks,

Markus

 

 

On 8 June 2017 at 10:09, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

Thanks Gunnar for the link. For macOS artifacts singing, we use the Apple TSA so we are not running into the shutdown of https://timestamp.geotrust.com/tsa (as explained here https://knowledge.symantec.com/support/code-signing-support/index?page=content&id=ALERT2248). We faced this issue for jar signing, but we solved it as part of https://bugs.eclipse.org/bugs/show_bug.cgi?id=515402.

 

However, the Apple TSA may be the weak spot causing the hanging. I will add an option to the macOS signing service to use another TSA (codesign --timestamp)

 

Cheers,

Mikael

 

Le 8 juin 2017 à 09:58, Gunnar Wagenknecht <gunnar@xxxxxxxxxxxxxxx> a écrit :

 

Mikael,

Can you check whether the signing service is running into:
https://stackoverflow.com/questions/43585380/is-http-timestamp-geotrust-com-tsa-not-longer-available-for-signtool

-Gunnar

-- 
Gunnar Wagenknecht
gunnar@xxxxxxxxxxxxxxx, http://guw.io/






On 7. Jun 2017, at 12:59, Mikael Barbero <mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx> wrote:

I've restarted the dmg packaging service with finer grained log as I
did not see anything from the log. Please keep me posted about any new
hanging of the job.

Thanks.

-- 
Mikaël Barbero
_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev



 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Mikaël Barbero
Senior Developer & FEEP Technical Leader
Eclipse Foundation
E: mikael.barbero@xxxxxxxxxxxxxxxxxxxxxx
T: (+33) 642 028 039

 


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

--

Mikaël Barbero

Eclipse Platform Developer & FEEP Technical Leader

Eclipse Foundation

T: (+33) 642 028 039

_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev


_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/epp-dev

 

Attachment: smime.p7s
Description: S/MIME cryptographic signature


Back to the top