Re: [ptp-user] Eclipse PTP on K - monitoring

[Carsten Karbach <c.karbach@xxxxxxxxxxxxx>]

Dear Peter,

thanks for the hint on the broken link. It was moved to
http://llview.fz-juelich.de/LML/OnlineDocumentation/lmldoc.html. I have
updated the documentation page with the new link. On the LML
documentation page you can find a section about LML layout files, which
is located at
http://llview.fz-juelich.de/LML/OnlineDocumentation/layouts.html.

There are also some layout examples integrated into PTP. You can find
them at
http://git.eclipse.org/c/ptp/org.eclipse.ptp.git/tree/rms/org.eclipse.ptp.rm.jaxb.contrib/data.
E.g. take a look at the configuration files
de.fz-juelich.judge.torque.batch.xml, de.fz-juelich.juqueen.ll_bg.xml or
de.fz-juelich.juropa.torque.batch.xml. They all contain <monitor-data>
elements, which represent the layout definitions for each site.

See also
https://wiki.eclipse.org/images/7/7e/Carsten-Karbach-31july2013-Slides.pdf
for an introduction to creating your own monitoring layouts.

Regarding your first question: A summary on the monitoring architecture
is given in the presentation here:
https://wiki.eclipse.org/images/d/d0/PTPUserDev2012_Monitoring_Karbach_Frings.pdf.
When you need to develop your own batch system adapter, you basically
have to write scripts for gathering three types of data: jobs, nodes and
global system information. You have to write one script for each of
these types, where each script generates an LML file. All subsequent
steps of LML_da should be handled automatically. Find examples for these
scripts for all supported batch systems at
http://git.eclipse.org/c/ptp/org.eclipse.ptp.git/tree/rms/org.eclipse.ptp.rm.lml.da/rms.

Best regards,

Carsten

On 01/19/15 09:05, Peter Bryzgalov wrote:
> Hi,
>
> I work on adopting Eclipse PTP to “K” computer and its PJM batch system
> made by Fujitsu. I have a basic job running and profiling with TAU
> features working. Now I'm working on monitoring.
> I have very basic understanding of workflow and LML. Where can I find
> specifications and examples of what output files should look like on
> every step of the workflow? I also need instructions on creating a
> layout definition file.
>
> There is a link on wiki.eclipse.org/PTP/designs/scalability
> <http://wiki.eclipse.org/PTP/designs/scalability> to LML specification.
> Unfortunately http://llview.zam.kfa-juelich.de site is not working.
>
> Kind regards,
> Peter Bryzgalov
>
> RIKEN AICS
> HPC Usability Research Team
> Research Scientist
>
>
> _______________________________________________
> ptp-user mailing list
> ptp-user@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> https://dev.eclipse.org/mailman/listinfo/ptp-user



------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------