| Re: [ptp-user] Does anyone use PTP on the STAMPEDE.TACC mechine? |
|
Chao --
The cluster module loads a compiler and mpi stack (type "module show cluster"). So when you then try to do it again, Lmod protests.
The TACC hierarchical software stack puts unfair pressure on ptp's "Manage Synchronize Configurations". I don't know of a way to pull off what you're trying to do on TACC systems using this mechanism, because the hierarchy requires that you load modules on TACC systems in a specific order. Instead, I recommend one of two approaches:
1. Build a default collection of modules using "module save" (see module help for more info). Then you'll have that collection loaded automatically whenever you ssh to Stampede.
2. Supply your own submission script rather than have ptp build it. In that submission script, manage all modules. With this approach you have access to all of Lmod's commands (e.g. swap). You can start with "module reset" if you want (again, I recommend steering clear of module purge on TACC systems). Or you can load a default collection or named collection with "module restore" (for your personal default) or "module restore mycollection" (where "mycollection" is the name of your favorite collection).
For very subtle technical reasons, you generally should not load modules in startup files on TACC systems.
Regards, Doug
From: ptp-user-bounces@xxxxxxxxxxx [ptp-user-bounces@xxxxxxxxxxx] on behalf of Zhang, Chao [czhang@xxxxxxxxxxxx]
Sent: Monday, April 14, 2014 6:01 PM To: PTP User list Subject: Re: [ptp-user] Does anyone use PTP on the STAMPEDE.TACC mechine? Hi Doug James,
Thanks for your help. It makes me understand why the error comes out.
But I don't understand you by "You can use "module swap" to get a different compiler". How can I type this command "module swap". I want to use inter fortran compiler and impi. If I just Remove mvapich2 and add impi on the page "Manage Synchronize Configurations". It shows that:
make all
So where should I type that command? Another thing is that, on the page "Run Configurations", I have to choose a "Target System Configuration" in the Resources tab. I cannot find something about stampede.tacc. I just find "edu.utexas.tacc.lonestar.sge.bath" and "edu.utexas.tacc.sge.batch". Does it mean I cannot use PTP on Stampede?
Thanks in advance.
Chao
From: ptp-user-bounces@xxxxxxxxxxx <ptp-user-bounces@xxxxxxxxxxx> on behalf of Doug James <djames@xxxxxxxxxxxxxxx>
Sent: Monday, April 14, 2014 5:26 PM To: PTP User list Subject: Re: [ptp-user] Does anyone use PTP on the STAMPEDE.TACC mechine? Chao --
I think the problem is this: you are attempting to load an mpi stack before you load a compiler. On a TACC system, this won't work -- we have a module hierarchy in which the mpi stacks depend on (and require the presence of) an appropriate compiler module.
In general, "module purge" is a bit dangerous on TACC systems. If you use it, load a compiler (e.g. module load gcc) before loading an mpi stack. To see all gcc compilers, try "module spider gcc"; similarly with intel.
A safer approach is to replace module purge with "module reset", which loads the generic default environment. If you do this, you'll have the default intel compiler loaded, and the associated version of mvapich2. You can use "module swap" to get a different compiler.
Regards, Doug James From: ptp-user-bounces@xxxxxxxxxxx [ptp-user-bounces@xxxxxxxxxxx] on behalf of Zhang, Chao [czhang@xxxxxxxxxxxx]
Sent: Monday, April 14, 2014 4:09 PM To: ptp-user@xxxxxxxxxxx Subject: [ptp-user] Does anyone use PTP on the STAMPEDE.TACC mechine? Hi, all:
I am new here. Does anyone use PTP on stampede.tacc.utexas.edu?
I follow the instructions on the <Developing Scientific Application with the IBM Parallel Environment Developer Edition>. But I cannot build my project. There is something wrong with the "Manage Synchronize Configurations".
It shows that:
15:11:01 **** Incremental Build of configuration Default for project shallow3 **** make all **** Environment configuration script temporarily stored in /tmp/ptpscript_8XLs8N **** module purge >/dev/null 2>&1 module load TACC-paths module load cluster-paths module load mvapich2/1.9a2 Lmod has detected the following error: module load TACC The following module(s) are completely unknown: "mvapich2/1.9a2" module load Linux module load intel/13.0.2.146 module load cluster make all ifort -o 2d.exe -O3 -g 2D_grid.f90 > Shell Completed (exit code = 0)
"mvapich2/1.9a2" is in the STAMPEDE. If I change "mvapich2/1.9a2" to "impi". It still shows the same problem.
Another problem is that
I click the run configurations. On the "Resources -> Target System Configuration" , there are lots of choices. But there is no something like "stampede.tacc". Does it mean I cannot use PTP on the stampede cluster?
Best wishes, Chao
|