Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [science-iwg] HDF in DAWN and January

Hello,

 

This might be fine but to sound a cautionary note, mixing up a file format with data description (not that I am accusing anyone of doing this) could result in pain depending on how it is done. The approach up until now has been to have a factory pattern (non-January) which loads different formats to datasets (January). Importantly, one can load datasets without a dependency on a particular file format coming in from the dependencies of the dataset. As long as this separation is maintained it means that we are not exposed to each other’s file format dependencies. Peter did actually do a very complete NeXus-HDF5 API but that of course should not be in January because NeXus-HDF5 is not as generic as a data description layer.

 

Matt

 

 

 

From: science-iwg-bounces@xxxxxxxxxxx [mailto:science-iwg-bounces@xxxxxxxxxxx] On Behalf Of Jay Jay Billings
Sent: 29 August 2016 16:30
To: Ted Habermann; Science Industry Working Group
Subject: [science-iwg] HDF in DAWN and January

 

Ted,

 

Following up on our email recently about data structures in Eclipse January, I wanted to provide you a link to the repository and the original proposal:

 

 

Peter Chang and Jonah Graham are the project leads. I am a committer in addition to being the project's mentor (for procedural support). This project combines data structures out of Eclipse ICE, EAVP, and DAWNSci. ICE focuses on higher level "Form" data structures that manage information in a large tree. EAVP is our visualization project and provided a lot of data structures for 3D geometries, meshes, post-processing, etc. DAWNSci made its IDataSet infrastructure open source which is an N-dimensional array library for Java. You may recall from the paper that Matt Gerring co-wrote with us that DAWNSci has some level of support for HDF5. I am not sure if that is available publicly, but certainly Peter and Matt can tell us.

 

It would be very interesting to add even more support for HDF5 into January.

 

Best,

Jay

 

--

Jay Jay Billings

Oak Ridge National Laboratory

Twitter Handle: @jayjaybillings

 

-- 

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom
 

Back to the top