Re: [ptp-dev] FIXED: Synchronized project remote build is broken

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]

Re: [ptp-dev] FIXED: Synchronized project remote build is broken - Managed Build project

From: Beth Tibbitts <tibbitts@xxxxxxxxxx>
Date: Fri, 9 Dec 2011 15:31:54 -0500
Delivered-to: ptp-dev@xxxxxxxxxxx
List-archive: <https://dev.eclipse.org/mailman/private/ptp-dev>
List-help: <mailto:ptp-dev-request@eclipse.org?subject=help>
List-subscribe: <https://dev.eclipse.org/mailman/listinfo/ptp-dev>, <mailto:ptp-dev-request@eclipse.org?subject=subscribe>
List-unsubscribe: <https://dev.eclipse.org/mailman/options/ptp-dev>, <mailto:ptp-dev-request@eclipse.org?subject=unsubscribe>

Yes it works for me now too with this afternoon's 5.0.x build from http://wiki.eclipse.org/PTP/builds#PTP_5.0_.28Indigo.29

So either
(1) my installation was messed up
(2) whatever was wrong has since been fixed, or
(3) I was doing something stupid. But I did it consistently, over and over. :)
At any rate, the discussion was interesting and clarified some things.

Thanks, and sorry for the worry.

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform http://eclipse.org/ptp
IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

John Eblen ---12/09/2011 03:27:28 PM---Oops - I forgot about the checkbox... I just tried an Executable XLF Fortran project, and the Remote

From:	John Eblen <jeblen@xxxxxxx>
To:	Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
Date:	12/09/2011 03:27 PM
Subject:	Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
Sent by:	ptp-dev-bounces@xxxxxxxxxxx

Oops - I forgot about the checkbox...

I just tried an Executable XLF Fortran project, and the Remote configuration builds
remotely, so I still can't reproduce the error.

John

On Fri, Dec 9, 2011 at 3:09 PM, Beth Tibbitts <tibbitts@xxxxxxxxxx> wrote:

You have to uncheck "show only what's on my system" (wording not exact) at the bottom of the wizard

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

John Eblen ---12/09/2011 03:06:53 PM---I just tried a managed project: project type: Executable (Intel(R) Fortran)

From:	John Eblen <jeblen@xxxxxxx>
To:	Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
Date:	12/09/2011 03:06 PM
Subject:	Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
Sent by:	ptp-dev-bounces@xxxxxxxxxxx

I just tried a managed project:
project type: Executable (Intel(R) Fortran)
toolchain: Intel(R) Fortran Toolchain on IA-32

and it did build remotely.

I wasn't able to try project type Executable (XLF Fortran on MacOS X) because, for
whatever reason, on my machine it has no toolchains available. So the problem could
be with that particular project type.

John

On Fri, Dec 9, 2011 at 2:55 PM, Beth Tibbitts <

tibbitts@xxxxxxxxxx

> wrote:

Managed.

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

Greg Watson ---12/09/2011 02:49:30 PM---Is this a managed or makefile project? I was able to build using a makefile fine. Greg

From:	Greg Watson <g.watson@xxxxxxxxxxxx>
To:	Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
Date:	12/09/2011 02:49 PM
Subject:	Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
Sent by:	ptp-dev-bounces@xxxxxxxxxxx

Is this a managed or makefile project? I was able to build using a makefile fine.

Greg

On Dec 9, 2011, at 2:38 PM, Beth Tibbitts <

tibbitts@xxxxxxxxxx

> wrote:

The user often needs to change the configuration, including the toolchain, for it to work on the remote system.
>In Beth's case, however, this was not necessary before but now it is.
No, it's not working at all now.

I have a new ptp-master-release build running which is picking up changes in ptp and photran on the ptp_5_0 branch.
We'll see if that fixes anything (or just a fresh download does).

https://hudson.eclipse.org/hudson/user/btibbitts/my-views/view/My%20Jobs%20(PTP)/job/ptp-master-release/

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

<graycol.gif>

John Eblen ---12/09/2011 02:31:17 PM---The new configuration is just a copy of the active configuration. No changes are made to the toolcha

<ecblank.gif> From:	<ecblank.gif> John Eblen <jeblen@xxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 02:31 PM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

The new configuration is just a copy of the active configuration. No changes are made to the toolchain.
This new configuration is associated with the remote site that the user enters.

The user often needs to change the configuration, including the toolchain, for it to work on the remote system.
In Beth's case, however, this was not necessary before but now it is.

John

On Fri, Dec 9, 2011 at 2:02 PM, Chris Recoskie <

recoskie@xxxxxxxxxx

> wrote:

So... converting to a sync project creates a new configuration with a hacked up toolchain that it modifies behind the scenes to use your command launcher?

===========================
Chris Recoskie
Team Lead, IBM CDT and RDT
IBM Toronto

<graycol.gif>

John Eblen ---12/09/2011 01:58:50 PM---For synchronized projects, each build configuration is associated with a location (machine

<ecblank.gif> From:	<ecblank.gif> John Eblen <jeblen@xxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 01:58 PM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

For synchronized projects, each build configuration is associated with a location (machine
and directory) where files are stored and commands are run. The SyncCommandLauncher
creates a remote process builder to run the command at the appropriate location.

John

On Fri, Dec 9, 2011 at 1:50 PM, Beth Tibbitts <

tibbitts@xxxxxxxxxx

> wrote:

From my naive point of view :) it does this:
- it sets up the managed build info to fill in the GUI and sets default compile command etc. (e.g. 'xlf' or 'xlf95') and other options
- it sets the error parser
The sync project just makes the build command (makefile generated by managed build) execute on the remote machine.
- change active build configuration to "Remote (build on remote machin)" and voila, the commands run there.
- build errors use the supplied error parse to put things in the Problems View

That worked in 5.0.4

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

<graycol.gif>

Chris Recoskie ---12/09/2011 01:45:54 PM---Ok... so... we're back to how does it get used if there is no remote toolchain for Fortran?

<ecblank.gif> From:	<ecblank.gif> Chris Recoskie <recoskie@xxxxxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 01:45 PM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

Ok... so... we're back to how does it get used if there is no remote toolchain for Fortran?

===========================
Chris Recoskie
Team Lead, IBM CDT and RDT
IBM Toronto

<graycol.gif>

John Eblen ---12/09/2011 12:48:10 PM---Yes, synchronized projects have their own command launcher: org.eclipse.ptp.rdt.sync.core.remotemake

<ecblank.gif> From:	<ecblank.gif> John Eblen <jeblen@xxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 12:48 PM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

Yes, synchronized projects have their own command launcher:

org.eclipse.ptp.rdt.sync.core.remotemake.SyncCommandLauncher

John

On Fri, Dec 9, 2011 at 12:32 PM, Chris Recoskie <

recoskie@xxxxxxxxxx

> wrote:

I'm not talking about indexing. I'm talking about building. Unless the sync project folks did something special or differently, you can't build a managed build project remotely without supplying a new ICommandLauncher that knows how to launch things remotely, and by default any toolchain that doesn't specify its own command launcher will launch everything locally. So if there is no remote Fortran toolchain, explain to me how this ever would have worked???

===========================
Chris Recoskie
Team Lead, IBM CDT and RDT
IBM Toronto

<graycol.gif>

Beth Tibbitts ---12/09/2011 11:32:34 AM---Yes it works fine (in 5.0.4 anyway, unless I'm doing something wrong in my newer build)

<ecblank.gif> From:	<ecblank.gif> Beth Tibbitts <tibbitts@xxxxxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 11:32 AM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

Yes it works fine (in 5.0.4 anyway, unless I'm doing something wrong in my newer build)

New Fortran project, Executable XLF toolchain (It says Mac OS X but that's a misnomer)
add single source file with two lines "hello.f90" at project root
print *, "Hello"
end project
New>Other... Remote>Convert to sync project
Project>Build Configurations >Set active > Remote
Build

There are no remote toolchains for Fortran. But if i'm not using remote indexing etc. I don't need them.
The sync project does all the indexing locally.

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

<graycol.gif>

Chris Recoskie ---12/09/2011 10:25:00 AM---I'm a bit confused... I don't think there's a Remote Fortran toolchain is there? You can't do remot

<ecblank.gif> From:	<ecblank.gif> Chris Recoskie <recoskie@xxxxxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 10:25 AM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

I'm a bit confused... I don't think there's a Remote Fortran toolchain is there? You can't do remote builds with managed build without a remote toolchain, as without a remote command launcher, the build will try to launch commands locally.

Sounds like user error...

===========================
Chris Recoskie
Team Lead, IBM CDT and RDT
IBM Toronto

<graycol.gif>

John Eblen ---12/09/2011 10:21:01 AM---Hi Beth There were no changes to synchronized projects in that time period. The

<ecblank.gif> From:	<ecblank.gif> John Eblen <jeblen@xxxxxxx>
<ecblank.gif> To:	<ecblank.gif> Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>
<ecblank.gif> Date:	<ecblank.gif> 12/09/2011 10:21 AM
<ecblank.gif> Subject:	<ecblank.gif> Re: [ptp-dev] Synchronized project remote build is broken - Managed Build project
<ecblank.gif> Sent by:	<ecblank.gif> ptp-dev-bounces@xxxxxxxxxxx

Hi Beth

There were no changes to synchronized projects in that time period. The only change that
seems related is "Bug 365665 - multiple problems with remote managed build projects".

I haven't been able to reproduce the error yet. What project type, toolchain, etc. did you use to create the
Fortran project?

Thanks
John

On Thu, Dec 8, 2011 at 6:09 PM, Beth Tibbitts <

tibbitts@xxxxxxxxxx

> wrote:

We did a build of 5.0.4+ today
There are a lot of changes since the last one, which was the 5.0.4 final build on Nov 12.
See

http://wiki.eclipse.org/PTP/builds

for links to download it - we are still working out how to make these available from the hudson builds.
This is build #96 from

https://hudson.eclipse.org/hudson/job/ptp-release

When I create a Fortran Managed Build project and convert it to a synchronized project, change the active build config to Remote, and try to build,
it tries to do something on my local machine. Console output below:

====5.0.4+ build (incorrect)

**** Build of configuration Remote for project fortranXLF_1208b **** make all **** Build Finished **** /bin/sh: line 0: cd: /Applications/ecl/epp-parallel-indigo-SR1-5.0.4+test/eclipse/Eclipse.app/Contents/MacOS/test1208-505build/fortranXLF_1208b/Remote: No such file or directory

Instead of what it did in 5.0.4 which was to build remotely:
====5.0.4 build (correct):

**** Build of configuration Remote for project fortranXLF_1208a **** make all Building file: ../hello.f90 Invoking: IBM XLF Fortran Compiler xlf95 -qsuffix=f=f90 -O0 -g -c -o "hello.o" "../hello.f90" .... Finished building target: fortranXLF_1208a **** Build Finished ****

...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform

http://eclipse.org/ptp

IBM STG - High Performance Computing Tools
Mailing Address: IBM Corp., 745 West New Circle Road, Lexington, KY 40511

_______________________________________________
ptp-dev mailing list

ptp-dev@xxxxxxxxxxx

https://dev.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________ ptp-dev mailing list

ptp-dev@xxxxxxxxxxx

https://dev.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________ ptp-dev mailing list

ptp-dev@xxxxxxxxxxx