Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [science-iwg] App store for scientific software
Everyone,

Here's a better description of what we are doing in ICE. This is just a big brain dump with a lot of moving parts for now. We welcome community engagement on this too!

A year or so ago I came up with the ideal of a simple "Developer" menu in ICE because I really like the developer menu that you can find in MS Office products. We had a brilliant request from students to automate the provisioning process for ICE bundles in Eclipse for development since doing it by hand requires a lot of knowledge about the project and how to work with PDE apps. We also had some requests from others to add support for cloning and provisioning some of the frameworks that we use, all of which are written in C++. This dev menu has been really handy for ICE, but where we really see the most growth for it is with natively compiled scientific software - C, C++ and Fortran applications - for modeling and simulation.

Obviously doing this as a menu won't work in the long run, so I asked Torkild about his experience building the DAWN marketplace. It would also be far better to do this type of work with a package manager than building out our own infrastructure for pulling and building, especially since we need to compile source code. This is why I mentioned Spack (https://github.com/LLNL/spack) in my email to Philip.

Our vision is that 3rd party dependencies come from Spack and projects under development are pulled directly from the repository. Right now developers can add their projects through an extension point, but we would have to change that in an actual marketplace app. So, if someone decides to download and do development on, say, "MyCode" on Linux, then MyCode would be checked out from the repository and provisioned as a project. We would build all of its dependencies - to the extent possible - using Spack, configure it to point at those dependencies, and finish its build.

What about other operating systems? In that case we would use Docker and do the same procedure as above in the container. Alex and I have been testing this and it works well. It is still possible to do development inside that container using PTP Synchronized projects, which also works very well. Alex wants to do this on Linux as well, but I would like to have the option to do completely native builds on Linux too. In addition to solving our cross-platform problems, we could in theory configure the Docker containers so that they could be used in cloud environments or, possibly, on HPC systems that support containers.

Here are some use cases we have in mind:
* Build apps based on common frameworks ("the modeling and simulation" use case)
* Improve development on common frameworks themselves
* Build native Linux binaries of 3rd party dependencies for other Science projects. For example, what if someone wanted to use OGRE with EAVP?
* Configure "basic" scientific software in Docker containers for cloud deployment

We would greatly appreciate your feedback!

Jay

On Tue, Dec 13, 2016 at 9:19 AM, Philip Wenig <philip.wenig@xxxxxxxxxxxxx> wrote:
Perfect :-).
I've created a bug in ChemClipse:
https://bugs.eclipse.org/bugs/show_bug.cgi?id=509156

Unfortunately, it wasn't possible to create it directly under the Science TLP.


Best,
Philip


Am 13.12.2016 um 14:30 schrieb Ian Skerrett:
I would be happy to talk with the Science WG to understand the requirements for a Science Marketplace. FWIW, we are doing something for the IoT WG right now and if successful we could extend it to the Science WG.

Here is the bug for the IoT Market https://bugs.eclipse.org/bugs/show_bug.cgi?id=506792

Is there a list of requirements for a Science Market?

-----Original Message-----
From: science-iwg-bounces@xxxxxxxxxxg [mailto:science-iwg-bounces@eclipse.org] On Behalf Of Torkild U. Resheim
Sent: Tuesday, December 13, 2016 5:28 AM
To: Science Industry Working Group <science-iwg@xxxxxxxxxxx>
Subject: Re: [science-iwg] App store for scientific software

Hi guys,

The DAWN Marketplace code was not contributed back to the Eclipse Marketplace. The problem with that one is that it’s based on Drupal and it’s not open source.

Best regards,
Torkild
--
Torkild Ulvøy Resheim
Consultant / Eclipse Committer / Senior Software Developer Itema AS - http://itema.no

13. des. 2016 kl. 11.22 skrev <Matt.Gerring@xxxxxxxxxxxxx> <Matt.Gerring@xxxxxxxxxxxxx>:

I think Torkild contributed that work back to the eclipse marketplace
so anyone can set one up. Could be a fast win for the SWG here Jay
Jay? It doesn’t matter where the server(s) sit…
  From: science-iwg-bounces@xxxxxxxxxxg
[mailto:science-iwg-bounces@eclipse.org] On Behalf Of
baha.el-kassaby@xxxxxxxxxxxxx
Sent: 13 December 2016 09:28
To: science-iwg@xxxxxxxxxxx
Subject: Re: [science-iwg] App store for scientific software
  Hi Jay Jay,
Torkild recently made for us a custom marketplace server : users of an RCP app can create their own plugins and then upload them to that market place, which is then available from the normal market place client given by Eclipse. Just the same way as for the already available marketplaces from Eclipse, Obeo and Redhat. There is also a front-end on the web that enable users to register and eventually upload directly a p2 repo of their choice.
It is based on the Eclipse market place. The project is available on
Github here :https://github.com/Itema-as/dawn-marketplace-server
  Is it something similar that you are working on?
  Regards
  baha
  From: science-iwg-bounces@xxxxxxxxxxg
[mailto:science-iwg-bounces@eclipse.org] On Behalf Of Jay Jay Billings
Sent: 13 December 2016 00:20
To: Science Industry Working Group <science-iwg@xxxxxxxxxxx>
Subject: [science-iwg] App store for scientific software
  Everyone,

I wanted to share the abstract I just submitted on creating an app store for scientific software:

https://www.eclipseconverge.org/na2017/session/full-service-scientific
-software-app-store-eclipse

We're working on this at ORNL to make our lives easier, but I thought it might interest the community too.

Jay

--
Jay Jay Billings
Oak Ridge National Laboratory
Twitter Handle: @jayjaybillings
 
--

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in
England and Wales with its registered office at Diamond House, Harwell
Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United
Kingdom
 
  --

This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message.
Diamond Light Source Limited (company no. 4375679). Registered in
England and Wales with its registered office at Diamond House, Harwell
Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United
Kingdom
 
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or
unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg
_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/science-iwg

_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg

--
~~~~~~~~~~~~~~~~~~~~~~~~
OpenChrom - the open source alternative for chromatography / mass spectrometry
Dr. Philip Wenig » Founder » philip.wenig@xxxxxxxxxxxxx » http://www.openchrom.net
~~~~~~~~~~~~~~~~~~~~~~~~

_______________________________________________
science-iwg mailing list
science-iwg@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/science-iwg



--
Jay Jay Billings
Oak Ridge National Laboratory
Twitter Handle: @jayjaybillings

Back to the top