MG15 - Talk detail |
|
Participant |
Brandt, Carlos Henrique | |||||||
|
Institution |
La Sapienza - Piazzale Aldo Moro 5 - Roma - RM - Italy | |||||||
|
Session |
HE8 |
Accepted |
|
Order |
Time |
|||
|
Talk |
Oral abstract |
Title |
Distribute processing, merge data: Docker containers and Virtual Observatories for worldwide data analysis | |||||
| Coauthors | ||||||||
|
Abstract |
In this talk we will present the use of Linux Containers to ship complex data analysis software. For instance, the application of the strong portability feature of Containers to provide loosely distributed computing solutions. Our goal is to address issues related to the highly technical environment in astronomical data analysis, which imposes limits to the scientific production and blocks the spread and use of astronomical data by non-specialists. By lowering the technical barrier to access high-level data — data ready for science — at the same time we provide the means to produce such data is an equilibrium we believe we have achieved with the use of Containers. In particular, it will be presented the Swift DeepSky, an application of the technology providing a working example of a complex x-ray data analysis pipeline, fully automated to generate science-ready products from a trivial set of input parameters and virtually zero software setup. The data products of this pipeline are transparently uploaded to a VO-compliant server to be published in realtime. |
|||||||
Pdf file |
||||||||