Re: [ptp-dev] PTP and Parallel Package Juno RC4 build - Need your vote f

[Beth Tibbitts <tibbitts@xxxxxxxxxx>]

Well based on at least one test reported for each of the Linux/Win/Mac platforms,
I'm voting +1 for our epp-parallel package "Eclipse For Parallel Application Developers" for June release day, June 27.
However I believe we're all finding some things that could stand fixing, so please keep testing and
we will most likely go with our plan to release a 6.0.1 on or near June 27, encouraging users to update almost
immediately after downloading.
Please file a bug for things you're fixing, and check into HEAD targeted at 6.0.1 so we have a record of what fixes are in there.



...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform  http://eclipse.org/ptp
IBM STG - High Performance Computing Tools
Mailing Address:  IBM Corp., 745 West New Circle Road, Lexington, KY 40511

"Alameda, Jay" ---06/19/2012 05:00:07 PM---Puzzled no more, the first purge nukes the environment and then effectively prohibits the subsequent

From:	"Alameda, Jay" <alameda@xxxxxxxxxxxx>
To:	Parallel Tools Platform general developers <ptp-dev@xxxxxxxxxxx>,
Date:	06/19/2012 05:00 PM
Subject:	Re: [ptp-dev] PTP and Parallel Package Juno RC4 build - Need your vote for final Parallel Package build!
Sent by:	ptp-dev-bounces@xxxxxxxxxxx

---

Puzzled no more, the first purge nukes the environment and then effectively prohibits the subsequent module attempts:
 
[jalameda@forge ~]$ env
X509_USER_PROXY=/tmp/x509up_p51285.filemJ9iit.1
USER=jalameda
LOGNAME=jalameda
HOME=/uf/ncsa/jalameda
PATH=/usr/lib64/qt-3.3/bin:/usr/apps/tools/tau/2.20.3-forge/x86_64/bin:/usr/apps/tools/papi/4.1.4-
forge/bin:/usr/local/mpi/openmpi/openmpi-1.4.3-intel-12.0.4/bin:/usr/local/tgusage-3.0-r3/bin:/usr
/local/java-1.6.sun/jdk1.6.0_27/bin:/usr/local/java-1.6.sun/jdk1.6.0_27/jre/bin:/usr/local/globus-
5.0.4-r1/bin:/usr/local/globus-5.0.4-r1/sbin:/usr/local/gx-map-0.5.3.3-r1/bin:/usr/local/bin_first
:/usr/local/bin:/usr/X11R6/bin:/usr/local/NCSA-CA/bin:/usr/local/tginfo-1.1.1-r1/bin:/usr/local/sa
veafterjob/bin:/usr/local/uberftp-client-2.6/bin:/usr/local/mssftp-client-2.9/bin:/usr/local/intel
/bin:/usr/local/cuda_4.0.17/cuda/bin:/usr/local/cuda_4.0.17/cuda/open64/bin:/usr/local/cuda_4.0.17
/cuda/computeprof/bin:/usr/local/moab/bin:/usr/local/moab/sbin:/usr/local/torque/bin:/usr/local/to
rque/sbin:/uf/ncsa/jalameda/bin:.:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/lpp/mmfs/bin/:/usr/bin
:/bin:/usr/sbin:/sbin:/usr/local/openssh-5.8p2.mechglue/bin
MAIL=/var/spool/mail/jalameda
SHELL=/bin/tcsh
LD_LIBRARY_PATH=/usr/apps/tools/tau/2.20.3-forge/x86_64/lib:/usr/apps/tools/CUDAToolsSDK/4.0.17/CU
PTI/lib:/usr/apps/tools/papi/4.1.4-forge/lib:/usr/local/mpi/openmpi/openmpi-1.4.3-intel-12.0.4/lib
:/usr/local/globus-5.0.4-r1/lib:/usr/local/lib64:/usr/local/lib:/lib:/lib64:/usr/lib64:/usr/lib:/u
sr/X11R6/lib64:/usr/local/intel/lib/intel64:/usr/local/intel/mkl/lib/intel64:/usr/local/cuda_4.0.1
7/cuda/lib64:/usr/local/cuda_4.0.17/cuda/open64/lib:/usr/local/cuda_4.0.17/cuda/computeprof/bin
LIBPATH=/usr/local/globus-5.0.4-r1/lib
SHLIB_PATH=/usr/local/globus-5.0.4-r1/lib
SSH_CLIENT=141.142.231.232 63653 22
SSH_CONNECTION=141.142.231.232 63653 141.142.164.101 22
SSH_TTY=/dev/pts/1
TERM=ansi
HOSTTYPE=x86_64-linux
VENDOR=unknown
OSTYPE=linux
MACHTYPE=x86_64
SHLVL=1
PWD=/uf/ncsa/jalameda
GROUP=acv
HOST=forge.ncsa.illinois.edu
REMOTEHOST=ncsa-3-usernet231-232.ncsa.uiuc.edu
HOSTNAME=forge.ncsa.illinois.edu
LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31
;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tg
z=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=0
1;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.
bz=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio
=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01
;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;
35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;
35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35
:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.
dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv
=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=
01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01
;36:
G_BROKEN_FILENAMES=1
LESSOPEN=|/usr/bin/lesspipe.sh %s
MODULESHOME=/usr/local/modules-3.2.9.forge/Modules
MODULEPATH=/usr/local/modules-3.2.9.forge/Modules/modulefiles:/usr/local/modules-3.2.9.forge/Modul
es/ncsa:/usr/local/modules-3.2.9.forge/Modules/cue:/usr/local/modules-3.2.9.forge/Modules/apps
LOADEDMODULES=user_paths:torque-3.0.2:moab-5.3.7:cuda-4.0.17:intel/12.0.4:mssftp-client-2.9:uberft
p-client-2.6:saveafterjob-2.1.0:tginfo-1.1.1-r1:ncsa-ca:os_paths:gx-map-0.5.3.3-r1:globus-5.0.4-r1
:java-sun-1.6:tgusage-3.0-r3:openmpi-1.4.3-intel-12.0.4:papi/4.1.4:cupti/4.0.17:tau/2.20.3
MANPATH=/usr/apps/tools/tau/2.20.3-forge/man:/usr/apps/tools/papi/4.1.4-forge/share/man:/usr/local
/mpi/openmpi/openmpi-1.4.3-intel-12.0.4/share/man:/usr/local/globus-5.0.4-r1/man:/usr/local/gx-map
-0.5.3.3-r1/man:/usr/local/share/man:/man:/usr/X11R6/share/man:/usr/local/NCSA-CA/man:/usr/local/s
aveafterjob/man:/usr/local/uberftp-client-2.6/man:/usr/local/mssftp-client-2.9/man:/usr/local/inte
l/man/en_US:/usr/local/moab/man:/usr/local/torque/man:/uf/ncsa/jalameda/man:/usr/share/man
_LMFILES_=/usr/local/modules-3.2.9.forge/Modules/ncsa/user_paths:/usr/local/modules-3.2.9.forge/Mo
dules/ncsa/torque-3.0.2:/usr/local/modules-3.2.9.forge/Modules/ncsa/moab-5.3.7:/usr/local/modules-
3.2.9.forge/Modules/apps/cuda-4.0.17:/usr/local/modules-3.2.9.forge/Modules/apps/intel/12.0.4:/usr
/local/modules-3.2.9.forge/Modules/ncsa/mssftp-client-2.9:/usr/local/modules-3.2.9.forge/Modules/n
csa/uberftp-client-2.6:/usr/local/modules-3.2.9.forge/Modules/ncsa/saveafterjob-2.1.0:/usr/local/m
odules-3.2.9.forge/Modules/ncsa/tginfo-1.1.1-r1:/usr/local/modules-3.2.9.forge/Modules/ncsa/ncsa-c
a:/usr/local/modules-3.2.9.forge/Modules/ncsa/os_paths:/usr/local/modules-3.2.9.forge/Modules/ncsa
/gx-map-0.5.3.3-r1:/usr/local/modules-3.2.9.forge/Modules/ncsa/globus-5.0.4-r1:/usr/local/modules-
3.2.9.forge/Modules/ncsa/java-sun-1.6:/usr/local/modules-3.2.9.forge/Modules/ncsa/tgusage-3.0-r3:/
usr/local/modules-3.2.9.forge/Modules/apps/openmpi-1.4.3-intel-12.0.4:/usr/local/modules-3.2.9.for
ge/Modules/apps/papi/4.1.4:/usr/local/modules-3.2.9.forge/Modules/apps/cupti/4.0.17:/usr/local/mod
ules-3.2.9.forge/Modules/apps/tau/2.20.3
PBS_DEFAULT=fsched
INTEL_HOME=/usr/local/intel
LC_ALL=C
LM_LICENSE_FILE=1708@xxxxxxxxxxxxxxxxxxxxxxxxxx
MKL_HOME=/usr/local/intel/mkl
MKL_NUM_THREADS=1
GLOBUS_HOSTNAME=forge.ncsa.illinois.edu
GLOBUS_LOCATION=/usr/local/globus-5.0.4-r1
GLOBUS_PATH=/usr/local/globus-5.0.4-r1
GLOBUS_TCP_PORT_RANGE=50000,51000
MYPROXY_SERVER=myproxy.teragrid.org
RSHCOMMAND=/usr/bin/ssh
JAVA_BINDIR=/usr/local/java-1.6.sun/jdk1.6.0_27/bin
JAVA_HOME=/usr/local/java-1.6.sun/jdk1.6.0_27
JAVA_ROOT=/usr/local/java-1.6.sun/jdk1.6.0_27
JDK_HOME=/usr/local/java-1.6.sun/jdk1.6.0_27
JRE_HOME=/usr/local/java-1.6.sun/jdk1.6.0_27/jre
SDK_HOME=/usr/local/java-1.6.sun/jdk1.6.0_27
QTDIR=/usr/lib64/qt-3.3
QTINC=/usr/lib64/qt-3.3/include
QTLIB=/usr/lib64/qt-3.3/lib
[jalameda@forge ~]$ module purge
test: Command not found.
[jalameda@forge ~]$ env
env: Command not found.
[jalameda@forge ~]$
 
From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx] On Behalf Of Alameda, Jay
Sent: Tuesday, June 19, 2012 3:58 PM
To: Parallel Tools Platform general developers
Subject: Re: [ptp-dev] PTP and Parallel Package Juno RC4 build - Need your vote for final Parallel Package build!
 
I’m a little bit puzzled – I found the script that drives the build, executing it manually causes the same output:
 
[jalameda@forge ~/mpi-test-rc4]$ bash /tmp/ptpscript_vDA4kU 
 
**** Environment configuration script temporarily stored in /tmp/ptpscript_vDA4kU **
**
module purge >/dev/null 2>&1
: ambiguous redirectU: line 5: 1
module load cuda-4.0.17
/tmp/ptpscript_vDA4kU: line 7: module: command not found
module load cupti/4.0.17
/tmp/ptpscript_vDA4kU: line 9: module: command not found
module load globus-5.0.4-r1
/tmp/ptpscript_vDA4kU: line 11: module: command not found
module load gx-map-0.5.3.3-r1
/tmp/ptpscript_vDA4kU: line 13: module: command not found
module load intel/12.0.4
/tmp/ptpscript_vDA4kU: line 15: module: command not found
module load java-sun-1.6
/tmp/ptpscript_vDA4kU: line 17: module: command not found
module load moab-5.3.7
/tmp/ptpscript_vDA4kU: line 19: module: command not found
module load mssftp-client-2.9
/tmp/ptpscript_vDA4kU: line 21: module: command not found
module load ncsa-ca
/tmp/ptpscript_vDA4kU: line 23: module: command not found
module load openmpi-1.4.3-intel-12.0.4
/tmp/ptpscript_vDA4kU: line 25: module: command not found
module load os_paths
/tmp/ptpscript_vDA4kU: line 27: module: command not found
module load papi/4.1.4
/tmp/ptpscript_vDA4kU: line 29: module: command not found
module load saveafterjob-2.1.0
/tmp/ptpscript_vDA4kU: line 31: module: command not found
module load tau/2.20.3
/tmp/ptpscript_vDA4kU: line 33: module: command not found
module load tginfo-1.1.1-r1
/tmp/ptpscript_vDA4kU: line 35: module: command not found
module load tgusage-3.0-r3
/tmp/ptpscript_vDA4kU: line 37: module: command not found
module load torque-3.0.2
/tmp/ptpscript_vDA4kU: line 39: module: command not found
module load uberftp-client-2.6
/tmp/ptpscript_vDA4kU: line 41: module: command not found
module load user_paths
/tmp/ptpscript_vDA4kU: line 43: module: command not found
make all 
make: Nothing to be done for `all'.
'.  Stop. No rule to make target `
[jalameda@forge ~/mpi-test-rc4]$
 
The script’s contents are:
 
 
#!/bin/bash
echo ''
echo '**** Environment configuration script temporarily stored in /tmp/ptpscript_vDA4kU ****'
echo 'module purge >/dev/null 2>&1'
module purge >/dev/null 2>&1
echo 'module load cuda-4.0.17'
module load cuda-4.0.17
echo 'module load cupti/4.0.17'
module load cupti/4.0.17
echo 'module load globus-5.0.4-r1'
module load globus-5.0.4-r1
echo 'module load gx-map-0.5.3.3-r1'
module load gx-map-0.5.3.3-r1
echo 'module load intel/12.0.4'
module load intel/12.0.4
echo 'module load java-sun-1.6'
module load java-sun-1.6
echo 'module load moab-5.3.7'
module load moab-5.3.7
echo 'module load mssftp-client-2.9'
module load mssftp-client-2.9
echo 'module load ncsa-ca'
module load ncsa-ca
echo 'module load openmpi-1.4.3-intel-12.0.4'
module load openmpi-1.4.3-intel-12.0.4
echo 'module load os_paths'
module load os_paths
echo 'module load papi/4.1.4'
module load papi/4.1.4
echo 'module load saveafterjob-2.1.0'
module load saveafterjob-2.1.0
echo 'module load tau/2.20.3'
module load tau/2.20.3
echo 'module load tginfo-1.1.1-r1'
module load tginfo-1.1.1-r1
echo 'module load tgusage-3.0-r3'
module load tgusage-3.0-r3
echo 'module load torque-3.0.2'
module load torque-3.0.2
echo 'module load uberftp-client-2.6'
module load uberftp-client-2.6
echo 'module load user_paths'
module load user_paths
echo 'make all '
make all
rm -f '/tmp/ptpscript_vDA4kU'
 
From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx] On Behalf Of Alameda, Jay
Sent: Tuesday, June 19, 2012 3:50 PM
To: Parallel Tools Platform general developers
Subject: Re: [ptp-dev] PTP and Parallel Package Juno RC4 build - Need your vote for final Parallel Package build!
 
Beth, 
Windows 7 64 bit – Java 1.6 –
I’m working through a capability matrix that Jeff and I have been working on – started with a local project, with your sample mpi code
Made it into a synchronized project, on blacklight, documented missing config items for blacklight (not a big deal for now, as we simply haven’t developed the configurations for SGI MPT, and have some things to fix in the LML for the origin, something Carsten can do very very easily).
But, the environment management system reported that it could not work with blacklight –
 
Then added a build configuration for forge, figured out where the things that are set in the wizard are set (project properties) – tried env management, and when I went to set them, had this issue – this is for build-time environment management:
 
15:44:17 **** Incremental Build of configuration forge for project mpi-test-rc4 ****
make all 
 
**** Environment configuration script temporarily stored in /tmp/ptpscript_vDA4kU ****
module purge >/dev/null 2>&1
/tmp/ptpscript_vDA4kU: line 5: 1
: ambiguous redirect
module load cuda-4.0.17
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'cuda-4.0.17
'
module load cupti/4.0.17
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'cupti/4.0.17
'
module load globus-5.0.4-r1
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'globus-5.0.4-r1
'
module load gx-map-0.5.3.3-r1
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'gx-map-0.5.3.3-r1
'
module load intel/12.0.4
intel(7):ERROR:105: Unable to locate a modulefile for 'intel/12.0.4
'
module load java-sun-1.6
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'java-sun-1.6
'
module load moab-5.3.7
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'moab-5.3.7
'
module load mssftp-client-2.9
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefmodule load ncsa-ca
module load openmpi-1.4.3-intel-12.0.4
module load os_paths
module load papi/4.1.4
module load saveafterjob-2.1.0
module load tau/2.20.3
module load tginfo-1.1.1-r1
ile for 'mssftp-client-2.9
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'ncsa-ca
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'openmpi-1.4.3-intel-12.0.4
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'os_paths
'
papi(8):ERROR:105: Unable to locate a modulefile for 'papi/4.1.4
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'saveafterjob-2.1.0
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'tau/2.20.3
'
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'tginfo-1.1.1-r1
'
module load tgusage-3.0-r3
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'tgusage-3.0-r3
'
module load torque-3.0.2
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'torque-3.0.2
'
module load uberftp-client-2.6
ModuleCmd_Load.c(204):ERROR:105: Unable to locate a modulefile for 'uberftp-client-2.6
'
module load user_paths
ModuleCmd_Load.c(204):ERROR:105: Unable to locate amake all 
mpicc -g -o mpi-test mpi-test.o
modulefile for 'user_paths
'
make: *** No rule to make target `
'.  Stop.
 
15:44:24 Build Finished (took 7s.446ms)
 
 
 
From: ptp-dev-bounces@xxxxxxxxxxx [mailto:ptp-dev-bounces@xxxxxxxxxxx] On Behalf Of Beth Tibbitts
Sent: Monday, June 18, 2012 12:23 PM
To: ptp-dev@xxxxxxxxxxx
Subject: [ptp-dev] PTP and Parallel Package Juno RC4 build - Need your vote for final Parallel Package build!

Sorry.... I thought I sent this out on Friday...

PLEASE TRY THIS.  It's our final build of the parallel package.
I would like a few "+1" votes on some various platforms before I give it the big "+1" to be on the downloads site on Juno Day, June 27.

As mentioned in our ptp-dev call last Tuesday, please test as much as possible; we are most likely releasing a 6.0.1 bugfix release at about the time of the release on Wed June 27

Here's my vote:
+1 for Mac64

The final Juno RC4 build of the parallel package is available here:
 http://build.eclipse.org/technology/epp/epp_build/juno/download/20120614-1725/

The repository from which you can use Help>Install new software to test installation from an existing workbench is
 http://download.eclipse.org/releases/staging

These will not be promoted to the usual areas on the Eclipse download sites, since this would essentially
be releasing early

Final release of the Eclipse Juno, including PTP 6.0.0 and the "Eclipse for Parallel Application Developers"
is June 27.


...Beth

Beth Tibbitts
Eclipse Parallel Tools Platform  http://eclipse.org/ptp
IBM STG - High Performance Computing Tools
Mailing Address:  IBM Corp., 745 West New Circle Road, Lexington, KY 40511
----- Forwarded by Beth Tibbitts/Watson/IBM on 06/15/2012 08:50 AM -----

From:	Markus Knauer <mknauer@xxxxxxxxxxxxxxxxx>
To:	EPP Developer Mailing List <epp-dev@xxxxxxxxxxx>,
Date:	06/14/2012 04:28 PM
Subject:	[epp-dev] EPP Juno RC4 build
Sent by:	epp-dev-bounces@xxxxxxxxxxx

---

Hi package maintainers,

now we've got a build available that I think could be the final RC4 build:

  http://build.eclipse.org/technology/epp/epp_build/juno/download/20120614-1725/

Upgrades etc. can be tested with the RC4 p2 repositories at

  http://build.eclipse.org/technology/epp/epp_build/juno/download/20120614-1725/repository and 
  http://download.eclipse.org/releases/staging

There are some 'special' things that I should mention:

(1) Bug 382574 - An internal error occurred during: "Indexing help...".
The workaround that we came up with includes adding a new Java property to the eclipse.ini file. With this property set, the search in the Eclipse Help system should work even in case someone installs the higher version of the Apache Lucene library from the Juno repository at a later time. But it is important that you test the search in your package to make sure there are no bad side effects.

(2) There won't be the usual 'release' of the packages from eclipse.org/downloads tomorrow/Friday. RC4 has always been a 'quiet' release. If you send your +1's these packages will be the final ones that will be released on June 27th.

Huh, it's going to be a longer list... I hate such lists... :)

(3) Test the packages... if you find errors, try to find a workaround and document it. If you find a stop-ship bug, well, in that case we need to find a solution. In most cases this means that we need to rebuild (and test!) all packages again.

(4) Test the packages early... and send your vote to the list as usual. I'd like to push them to the Eclipse mirror servers beginning of next week to give them enough time to sync. And before doing so, I need your votes...

Good, I'll stop for now...

Thanks,
Markus_______________________________________________
epp-dev mailing list
epp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/epp-dev_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/ptp-dev