AMIGA : Wf4Ever - Preservation of scientific workflows

Check AstroTaverna Plugin for Taverna Workbench workflows management software ! One of the current challenges in Astronomy is the efficient exploita

Check AstroTaverna Plugin for Taverna Workbench workflows management software ! One of the current challenges in Astronomy is the efficient exploitation of the huge volume of data currently available. This efficiency is needed in order to ensure the prompt return of the big investments made in terms of facilities to obtain those data, something that clearly the traditional methods of analysis are not currently achieving. This is the reason why scientific workflows are becoming a need in Astronomy. The systematic capture of the scientific process into a digital Research Object (RO) enables researchers to create, re-use, and share the full methodology and agents of an experiment. The RO is a container of the lifecycle of an experiment, linking data, services and tools for their analysis, producing executable papers which go well beyond the pdf. This disruptive methodology reduces effort duplication and ensures repeatability of the discovery process, which finally leads to a complete change of paradigm in the way research is performed. Since December 2010, the AMIGA group is a participant in a EU FP7 funded project - Wf4Ever: Advanced Workflow Preservation Technologies for Enhanced Science - in order to contribute to the development of standards and models for the preservation of scientific workflows. Main goals Allow the methodology to be preserved and become re-usable by others. Increase the efficiency of the collaborative process in Astronomy. Contribute to the repeatability of the experiments, independently of their knowledge level. Ensure the reproducibility of the results, independently of the local working environment. Ease learning process for young researchers with organized and documented methodologies. Enable multiarchive/multifacility VO web-services-based workflows. Actions Develop models and ontologies for the semantic characterization of processesand integrate them into the VO. Creation of three representative Astronomy workflows. Handling of large data tables of physically interconnected parameters. Extractions of sources from digital surveys. Kinematical modeling of galaxies. Provide preservation of the Research Object to allow for re-use, sharing, repeatability, etc. of astronomy digital experiments. Upgrade of Taverna workflow managment tool to integrate VO services. Foster the use of collaborative web communities (MyExperiment) for publication, sharing, rating, etc. of ROs. Ellaboration of Research Object/Workflows for training. Astronomy is a collaborative science, but it has also become highly specialized, as many other disciplines. Scientific workflows will enable astronomers to greatly benefit from each other’s highly specialized know-how, they constitute a way to push Astronomy to share and publish not only results and data, but also processes and methodologies. Astronomers must hence be encouraged to document their methodology in a clear, concise and modular universal language. Golden Exemplar for a 3D Kinematical Modelling VO web-services-based scientific workflow At the start of this project most of the required individual infrastructures are either in place, or being developed with the goal of the interoperability of both data and methods through the Virtual Observatory initiative, although essentially no scientific workflows exist in Astronomy. Our first step is to build a representative set of Golden Exemplars, and subsequently assemble all of the involved pieces through preserved scientific workflows. Participants Intelligent Software Components iSOCO University of Manchester Universidad Politécnica de Madrid Poznan Supercomputing and Networking Center Oxford e-Research Centre Instituto de Astrofísica de Andalucía - CSIC Leiden University Medical Centrer Publications AstroTaverna - Building workflows with Virtual Observatory services J.E. Ruiz, J. Garrido, J.D. Santander-Vela, S. Sánchez-Expósito, L. Verdes-Montenegro 2014 Astronomy and Computing 7-8 Special Issue on The Virtual Observatory: I, 3-11, doi:10.1016/j.ascom.2014.09.002 How Reliable is Your Workflow: Monitoring Decay in Scholarly Publications J.M. Gómez-Pérez, E. García-Cuesta, J. Zhao, A. Garrido and J.E. Ruiz 2013. Proceedings of the Third International Conference on the Future of Scholarly Communication and Scientific Publishing Sepublica2013. Digital Science: Reproducibility and Visibility in Astronomy Ruiz, J. E., Verdes-Montenegro, L., Sánchez, S., Santander-Vela, J. D., Garrido, J.. 2013. Highlights of Spanish Astrophysics VII, Proceedings of the X Scientific Meeting of the Spanish Astronomical Society (SEA) (Springer) RO-Manager: A Tool for Creating and Manipulating Research Objects to Support Reproducibility and Reuse in Sciences J. Zhao, G. Klyne, P. Holubowicz, R. Palma, S. Soiland-Reyes, K. Hettne, J. E. Ruiz, M. Roos, K. Page, J. M. Gómez-Pérez, D. De Roure, C. Goble. August 2012.LISC2012 Conference. Papers Contributions Workflow-Centric Research Objects: A First Class Citizen in the Scholarly Discourse K. Belhajjame, O. Corcho, D. Garijo, J. Zhao, P. Missier, D. R. Newman, R. Palma, S. Bechhofer, E. Garcia Cuesta, J. M. Gomez-Perez, G. Klyne, K. Page, M. Roos, J. E. Ruiz, S. Soiland-Reyes, L. Verdes-Montenegro, D. De Roure and C. Goble. 2012. Proceedings of theSecond International Conference on the Future of Scholarly Communication and Scientific Publishing Sepublica2012. Scientific Workflows in Astronomy A. Schaaff, L. Verdes-Montenegro, J. E. Ruiz, J. D. Santander-Vela. 2012.Proceedings of the XXI ADASS Conference. Astronomical Society of the Pacific Conference Series. Towards the Preservation of Scientific Workflows David De Roure, Khalid Belhajjam, Paolo Missier, José Manuel Gómez-Pérez, Raúl Palma,José Enrique Ruiz, Kristina Hettne, Marco Roos, Graham Klyne and Carole Goble. 2011.iPRES2011 ConferencePapers Contributions. Technical Notes IVOA Note. Scientific Wotkflows in the VO Presentations in Conferences The AMIGA group has contributed to the dissemination of Wf4Ever Project in several technical and astronomy forums. --- This work is being supported by Grant AYA2008-06181-C02 and AYA2011-30491-C02-01, co-financed by MICINN and FEDER funds, and the Junta de Andalucía (Spain) grant P08-FQM-4205, as well as under the EU 7th Framework Programme in the area of Digital Libraries and Digital Preservation. (ICT-2009.4.1) Project reference: 270192.
 

Wf4Ever - Preservation of scientific workflows

Check AstroTaverna Plugin for Taverna Workbench workflows management software !
 

One of the current challenges in Astronomy is the efficient exploitation of the huge volume of data currently available. This efficiency is needed in order to ensure the prompt return of the big investments made in terms of facilities to obtain those data, something that clearly the traditional methods of analysis are not currently achieving. This is the reason why scientific workflows are becoming a need in Astronomy.

The systematic capture of the scientific process into a digital Research Object (RO) enables researchers to create, re-use, and share the full methodology and agents of an experiment. The RO is a container of the lifecycle of an experiment, linking data, services and tools for their analysis, producing executable papers which go well beyond the pdf. This disruptive methodology reduces effort duplication and ensures repeatability of the discovery process, which finally leads to a complete change of paradigm in the way research is performed. 

Since December 2010, the AMIGA group is a participant in a EU FP7 funded project - Wf4Ever: Advanced Workflow Preservation Technologies for Enhanced Science - in order to contribute to the development of standards and models for the preservation of scientific workflows.

Main goals

  • Allow the methodology to be preserved and become re-usable by others.
  • Increase the efficiency of the collaborative process in Astronomy.
  • Contribute to the repeatability of the experiments, independently of their knowledge level.
  • Ensure the reproducibility of the results, independently of the local working environment.
  • Ease learning process for young researchers with organized and documented methodologies.
  • Enable multiarchive/multifacility VO web-services-based workflows.

Actions

  • Develop models and ontologies for the semantic characterization of processes and integrate them into the VO.
  • Creation of three representative Astronomy workflows.
    • Handling of large data tables of physically interconnected parameters.
    • Extractions of sources from digital surveys.
    • Kinematical modeling of galaxies.
  • Provide preservation of the Research Object to allow for re-use, sharing, repeatability, etc. of astronomy digital experiments.
  • Upgrade of Taverna workflow managment tool to integrate VO services.
  • Foster the use of collaborative web communities (MyExperiment) for publication, sharing, rating, etc. of ROs.
  • Ellaboration of Research Object/Workflows for training.
     

Astronomy is a collaborative science, but it has also become highly specialized, as many other disciplines. Scientific workflows will enable astronomers to greatly benefit from each other’s highly specialized know-how, they constitute a way to push Astronomy to share and publish not only results and data, but also processes and methodologies. Astronomers must hence be encouraged to document their methodology in a clear, concise and modular universal language.

Golden Exemplar for a 3D Kinematical Modelling VO web-services-based scientific workflow

At the start of this project most of the required individual infrastructures are either in place, or being developed with the goal of the interoperability of both data and methods through the Virtual Observatory initiative, although essentially no scientific workflows exist in Astronomy. Our first step is to build a representative set of Golden Exemplars, and subsequently assemble all of the involved pieces through preserved scientific workflows.

Participants

Publications

Technical Notes

Presentations in Conferences

The AMIGA group has contributed to the dissemination of Wf4Ever Project in several technical and astronomy forums. 

---

This work is being supported by Grant AYA2008-06181-C02 and AYA2011-30491-C02-01, co-financed by MICINN and FEDER funds, and the Junta de Andalucía (Spain) grant P08-FQM-4205, as well as under the EU 7th Framework Programme in the area of Digital Libraries and Digital Preservation. (ICT-2009.4.1) Project reference: 270192.