| Re: [science-iwg] Your fixes - thanks! |
Werner
Send science-iwg mailing list submissions to
science-iwg@xxxxxxxxxxx
To subscribe or unsubscribe via the World Wide Web, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
or, via email, send a message with subject or body 'help' to
science-iwg-request@xxxxxxxxxxx
You can reach the person managing the list at
science-iwg-owner@xxxxxxxxxxx
When replying, please edit your Subject line so it is more specific
than "Re: Contents of science-iwg digest..."
Today's Topics:
1. Re: Your fixes - thanks! (UOMo)
2. Re: Your fixes - thanks! (Matt.Gerring@xxxxxxxxxxxxx)
----------------------------------------------------------------------
Message: 2
Date: Wed, 22 Oct 2014 09:08:08 +0000
From: <Matt.Gerring@xxxxxxxxxxxxx>
To: <science-iwg@xxxxxxxxxxx>, <Peter.Chang@xxxxxxxxxxxxx>
Subject: Re: [science-iwg] Your fixes - thanks!
Message-ID:
<14159819E27EDC41968035052B165F668B7F1D76@xxxxxxxxxxxxxxxxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"
Hi Werner,
Units are dealt with as metadata in IDataset and more importantly as axes of data (axes are separate IDatasets with lower dimensions, which go with the main data as metadata).
So if you have a block of data, say 3D, it will have different axes to annotate the data in each dimension (multiple alternatives allowed - for any one dimension multiple units are simultaneously allowed to exist for it. For instance the image count dimension could also have a time axis (when the image was collected) in ms and an angle axis (rad) (where the goniometer was for example) and a position axis in mm say, distance from detector). Just to really fry ones brain, since dimensions higher than 3 are allowed of data, so arrays of axes exist. There is an added complication when data gets large as well, you have to use ILazyDataset and data will not be in memory.
To make that clear; a ?normal? dataset might be:
- Data [p, q, r] # 10000 images of 2048x2048 for instance but higher dimensions allowed.
o Time [p] ms
o Position [p] mm # If data were 4D position could be 2D
o Angle [p] rad
o X Position [r] mm # Could be [p,r]
o Y Position [q] mm # Could be [p,q]
When these data are sliced or manipulated mathematically, the axes should be carried correctly with the slice or other maths.
We are open to take advice on how to improve this system from anyone expert in units of course. It should be quite a powerful and generic approach though.
Sincerely,
Matt
PS We are familiar with enthought, it is distributed with DAWN at the moment, although currently the plan is that DAWN will move to Anaconda (specifically miniconda) in a future release.
PPS I am working on NumpyExamples in dawn-eclipse/org.eclipse.dawnsci.analysis.dataset. Which I hope illuminates the rough parity with IDataset. I am hoping Peter, in copy, will help out with the more difficult stuff.
From: UOMo [mailto:uomo@xxxxxxxxxxx]
Sent: 21 October 2014 17:35
To: science-iwg@xxxxxxxxxxx
Subject: Re: [science-iwg] Your fixes - thanks!
Hi,
Interesting, anybody using NumPy also worked with this plugin for SciMath?
http://docs.enthought.com/scimath/units/unit_numpy.html#working-with-unitscalars-and-unitarrays
However, it seems IDataset could not as flexibly be extended as say a NumPy array seemlessly working with a SciMath UnitArray, or is there something intended?
IDataset contains various numeric getters for Java primitive values, could the Object value also be used for further Information or is it mainly for other numeric types like BigDecimal, BigInteger, etc.?
Thanks,
Werner
On Tue, Oct 21, 2014 at 6:00 PM, <science-iwg-request@xxxxxxxxxxx<mailto:science-iwg-request@xxxxxxxxxxx>> wrote:
Send science-iwg mailing list submissions to
science-iwg@xxxxxxxxxxx<mailto:science-iwg@xxxxxxxxxxx>
To subscribe or unsubscribe via the World Wide Web, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
or, via email, send a message with subject or body 'help' to
science-iwg-request@xxxxxxxxxxx<mailto:science-iwg-request@xxxxxxxxxxx>
You can reach the person managing the list at
science-iwg-owner@xxxxxxxxxxx<mailto:science-iwg-owner@xxxxxxxxxxx>
When replying, please edit your Subject line so it is more specific
than "Re: Contents of science-iwg digest..."
Today's Topics:
1. Re: Your fixes - thanks! (Andrew Ross)
----------------------------------------------------------------------
Message: 1
Date: Tue, 21 Oct 2014 11:54:15 +0200
From: Andrew Ross <andrew.ross@xxxxxxxxxxx<mailto:andrew.ross@xxxxxxxxxxx>>
To: science-iwg@xxxxxxxxxxx<mailto:science-iwg@xxxxxxxxxxx>
Subject: Re: [science-iwg] Your fixes - thanks!
Message-ID: <54462D47.5030103@xxxxxxxxxxx<mailto:54462D47.5030103@xxxxxxxxxxx>>
Content-Type: text/plain; charset="iso-8859-1"; Format="flowed"
Hey Everyone,
Just a shout out to say it's really nice to see the budding & blossoming
collaboration. This is great! It's also a really attractive thing to
point at for newcomers & prospective newcomers.
Thanks!
Andrew
On 20/10/14 13:56, Matt.Gerring@xxxxxxxxxxxxx<mailto:Matt.Gerring@xxxxxxxxxxxxx> wrote:
>
>
> Hi Torkild,
>
>
> Thanks for the fixes, I have merged them!
>
>
> You might also be interested to know that we will add back a
> new plugin org.eclipse.dawnsci.analysis.examples. This shows
> how to do many mathematical operations using IDataset. For
> instance it will include the Java alternatives for these
> (using DAWNSci at least) :
> http://wiki.scipy.org/NumPy_for_Matlab_Users
>
>
> Sincerely,
>
>
> Matt
>
>
> >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>
>
> You can merge this Pull Request by running
>
> git pullhttps://github.com/marintek-sima/dawn-eclipse<http://github.com/marintek-sima/dawn-eclipse> master
>
> Or view, comment on, or merge it at:
>
> https://github.com/DawnScience/dawn-eclipse/pull/2
>
>
> Commit Summary
>
> ?Fix #1: Correct execution environment
>
>
> File Changes
>
> ?*M*org.eclipse.dawnsci.analysis.api/.classpath
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-0>(2)
>
> ?*M*org.eclipse.dawnsci.analysis.api/.settings/org.eclipse.jdt.core.prefs
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-1>(7)
>
> ?*M*org.eclipse.dawnsci.analysis.api/META-INF/MANIFEST.MF
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-2>(2)
>
> ?*M*org.eclipse.dawnsci.hdf5.editor/.classpath
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-3>(14)
>
> ?*M*org.eclipse.dawnsci.hdf5.editor/.settings/org.eclipse.jdt.core.prefs
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-4>(7)
>
> ?*M*org.eclipse.dawnsci.hdf5.editor/META-INF/MANIFEST.MF
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-5>(2)
>
> ?*M*org.eclipse.dawnsci.slicing.api/.classpath
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-6>(2)
>
> ?*M*org.eclipse.dawnsci.slicing.api/.settings/org.eclipse.jdt.core.prefs
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-7>(6)
>
> ?*M*org.eclipse.dawnsci.slicing.api/META-INF/MANIFEST.MF
> <https://github.com/DawnScience/dawn-eclipse/pull/2/files#diff-8>(2)
>
>
> Patch Links:
>
> ?https://github.com/DawnScience/dawn-eclipse/pull/2.patch
>
> ?https://github.com/DawnScience/dawn-eclipse/pull/2.diff
>
> ---
>
>
> --
>
> This e-mail and any attachments may contain confidential, copyright
> and or privileged material, and are for the use of the intended
> addressee only. If you are not the intended addressee or an authorised
> recipient of the addressee please notify us of receipt by returning
> the e-mail and do not use, copy, retain, distribute or disclose the
> information in or attached to the e-mail.
> Any opinions expressed within this e-mail are those of the individual
> and not necessarily of Diamond Light Source Ltd.
> Diamond Light Source Ltd. cannot guarantee that this e-mail or any
> attachments are free from viruses and we cannot accept liability for
> any damage which you may sustain as a result of software viruses which
> may be transmitted in or with the message.
> Diamond Light Source Limited (company no. 4375679). Registered in
> England and Wales with its registered office at Diamond House, Harwell
> Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United
> Kingdom
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dev.eclipse.org/mailman/private/science-iwg/attachments/20141021/028cb72f/attachment.html>
------------------------------
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx<mailto:science-iwg@xxxxxxxxxxx>
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
End of science-iwg Digest, Vol 21, Issue 13
*******************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://dev.eclipse.org/mailman/private/science-iwg/attachments/20141022/e09dafb0/attachment.html>
------------------------------
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
End of science-iwg Digest, Vol 21, Issue 14
*******************************************