Laity, A. and Berriman, G. B. and Good, J. C. and Katz, D. S. and Jacob, J. C. and Brieger, L. and Moore, R. and Williams, R. and Deelman, E. and Singh, G. and Su, M.-H. (2007) An All-Sky 2MASS Mosaic Constructed on the TeraGrid. In: Astronomical Data Analysis Software and Systems XVI. ASP Conference Series (376). Astronomical Society of the Pacific , San Francisco, CA, pp. 65-68. ISBN 978-1-58381-313-3 http://resolver.caltech.edu/CaltechAUTHORS:20100923-152445154
- Published Version
Restricted to Repository administrators only
See Usage Policy.
Use this Persistent URL to link to this item: http://resolver.caltech.edu/CaltechAUTHORS:20100923-152445154
The Montage mosaic engine supplies on-request image mosaic services for the NVO astronomical community. A companion paper describes scientific applications of Montage. This paper describes one application in detail: the generation at SDSC of a mosaic of the 2MASS All-sky Image Atlas on the NSF TeraGrid. The goals of the project are: to provide a value-added 2MASS product that combines overlapping images to improve sensitivity; to demonstrate applicability of computing at-scale to astronomical missions and surveys, especially projects such as LSST; and to demonstrate the utility of the NVO Hyperatlas format. The numerical processing of an 8 TB, 32-bit survey to produce a 64-bit, 20 TB output atlas presented multiple scalability and operational challenges. An MPI Python module, MYMPI, was used to manage the alternately sequential and parallel steps of the Montage process. This allowed us to parallelize all steps of the mosaic process: that of many, sequential steps executing simultaneously for independent mosaics and that of a single MPI parallel job executing on many CPUs for a single mosaic. The Storage Resource Broker (SRB) was used to archive the output results in the Hyperatlas. The 2MASS mosaics are now being assessed for scientific quality. Around 130,000 CPU-hours were used to complete the mosaics. The output consists of 1734 plates spanning 6◦ for each of 3 bands. Each of the 5202 mosaics is roughly 4 GB in size, and each has been tiled into a 12×12 array of 26 MB files for ease of handling. The total size is about 20 TB in 750,000 tiles.
|Item Type:||Book Section|
|Additional Information:||© 2007 Astronomical Society of the Pacific. This work made use of Montage, funded by the National Aeronautics and Space Administration’s Earth Science Technology Office, Computational Technologies Project, under Cooperative Agreement Number NCC5-626 between NASA and the California Institute of Technology. The 2MASS project is a collaboration between The University of Massachusetts and the Infrared Processing and Analysis Center (JPL/Caltech). Funding is provided primarily by NASA and the NSF. The 2MASS image data products generated by Montage are not endorsed by the 2MASS project. Part of the work was done under funding support from the National Virtual Observatory, through the National Science Foundation.|
|Usage Policy:||No commercial reproduction, distribution, display or performance rights in this work are provided.|
|Deposited By:||Jason Perez|
|Deposited On:||24 Sep 2010 18:25|
|Last Modified:||26 Dec 2012 12:27|
Repository Staff Only: item control page