A Caltech Library Service

Experiences using cloud computing for a scientific workflow application

Vöckler, Jens-S. and Juve, Gideon and Deelman, Ewa and Rynge, Mats and Berriman, G. Bruce (2011) Experiences using cloud computing for a scientific workflow application. In: Proceedings of the 2nd international workshop on Scientific cloud computing. Association for Computing Machinery (ACM) , New York, NY, pp. 15-24. ISBN 978-1-4503-0699-7.

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item:


Clouds are rapidly becoming an important platform for scientific applications. In this paper we describe our experiences running a scientific workflow application in the cloud. The application was developed to process astronomy data released by the Kepler project, a NASA mission to search for Earth-like planets orbiting other stars. This workflow was deployed across multiple clouds using the Pegasus Workflow Management System. The clouds used include several sites within the FutureGrid, NERSC's Magellan cloud, and Amazon EC2. We describe how the application was deployed, evaluate its performance executing in different clouds (based on Nimbus, Eucalyptus, and EC2), and discuss the challenges of deploying and executing workflows in a cloud environment. We also demonstrate how Pegasus was able to support sky computing by executing a single workflow across multiple cloud infrastructures simultaneously.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Berriman, G. Bruce0000-0001-8388-534X
Additional Information:© 2011 ACM. This material is based upon work supported in part by the National Science Foundation under Grant No. 0910812 to Indiana University for ”FutureGrid: An Experimental, High-Performance Grid testbed.” Partners in the FutureGrid project include U. Chicago, U. Florida, San Diego Supercomputer Center - UC San Diego, U. Southern California, U. Texas at Austin, U. Tennessee at Knoxville, U. of Virginia, Purdue I., and T.-U. Dresden. G. B. Berriman is supported by the NASA Exoplanet Science Institute at the Infrared Processing and Analysis Center, operated by the California Institute of Technology in coordination with the Jet Propulsion Laboratory (JPL).
Group:Infrared Processing and Analysis Center (IPAC)
Funding AgencyGrant Number
NASA Exoplanet Science InstituteUNSPECIFIED
Subject Keywords:Pegasus, Periodograms, Cross Cloud Computing, Nimbus, Eucalyptus, FutureGrid, EC2, Magellan, Workflow, Experience, Sky Computing
Record Number:CaltechAUTHORS:20120521-091730036
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:31560
Deposited By: Tony Diaz
Deposited On:21 May 2012 18:01
Last Modified:28 Oct 2019 21:26

Repository Staff Only: item control page