A Caltech Library Service

A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more

Berriman, G. Bruce and Cohen, Richard W. and Colson, Andrew and Gelino, Christopher R. and Good, John C. and Kong, Mihseh and Laity, Anastasia C. and Mader, Jeffrey A. and Swain, Melanie A. and Tran, Hien D. and Wang, Shin-Ywan (2016) A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more. In: Software and Cyberinfrastructure for Astronomy IV. Proceedings of SPIE. No.9913. Society of Photo-Optical Instrumentation Engineers , Bellingham, WA, Art. No. 99130I. ISBN 9781510602052.

[img] PDF - Published Version
See Usage Policy.

[img] PDF - Submitted Version
See Usage Policy.


Use this Persistent URL to link to this item:


The Keck Observatory Archive (KOA) ( curates all observations acquired at the W. M. Keck Observatory (WMKO) since it began operations in 1994, including data from eight active instruments and two decommissioned instruments. The archive is a collaboration between WMKO and the NASA Exoplanet Science Institute (NExScI). Since its inception in 2004, the science information system used at KOA has adopted an architectural approach that emphasizes software re-use and adaptability. This paper describes how KOA is currently leveraging and extending open source software components to develop new services and to support delivery of a complete set of instrument metadata, which will enable more sophisticated and extensive queries than currently possible. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Alliance (IVOA), which defines a standard mechanism for discovering images through spatial queries. The heart of the KOA service is an R-tree-based, database-indexing mechanism prototyped by the Virtual Astronomical Observatory (VAO) and further developed by the Montage Image Mosaic project, designed to provide fast access to large imaging data sets as a first step in creating wide-area image mosaics (such as mosaics of subsets of the 4.7 million images of the SDSS DR9 release). The KOA service uses the results of the spatial R-tree search to create an SQLite data database for further relational filtering. The service uses a JSON configuration file to describe the association between instrument parameters and the service query parameters, and to make it applicable beyond the Keck instruments. The images generated at the Keck telescope usually do not encode the image footprints as WCS fields in the FITS file headers. Because SIAP searches are spatial, much of the effort in developing the program interface involved processing the instrument and telescope parameters to understand how accurately we can derive the WCS information for each instrument. This knowledge is now being fed back into the KOA databases as part of a program to include complete metadata information for all imaging observations. The R-tree program was itself extended to support temporal (in addition to spatial) indexing, in response to requests from the planetary science community for a search engine to discover observations of Solar System objects. With this 3D-indexing scheme, the service performs very fast time and spatial matches between the target ephemerides, obtained from the JPL SPICE service. Our experiments indicate these matches can be more than 100 times faster than when separating temporal and spatial searches. Images of the tracks of the moving targets, overlaid with the image footprints, are computed with a new command-line visualization tool, mViewer, released with the Montage distribution. The service is currently in test and will be released in late summer 2016.

Item Type:Book Section
Related URLs:
URLURL TypeDescription Paper
Berriman, G. Bruce0000-0001-8388-534X
Additional Information:© 2016 SPIE. The Keck Observatory Archive (KOA) is collaboration between the W. M. Keck Observatory (WMKO) and the NASA Exoplanet Science Institute (NExScI). Funding for KOA is provided by the National Aeronautics and Space Administration (NASA). WMKO is operated as a scientific partnership among the California Institute of Technology, the University of California, and NASA. The Observatory was made possible by the generous financial support of the W. M. Keck Foundation. NExScI is sponsored by NASA’s Origins Theme and Exoplanet Exploration Program, and operated by the California Institute of Technology in coordination with the Jet Propulsion Laboratory. This material is based in part upon work supported by NASA under Grant and Cooperative agreement No. NNX13AH26A. This work made use of Montage. It is funded by the National Science Foundation under Grant Number ACI-1440620, and was previously funded by the National Aeronautics and Space Administration's Earth Science Technology Office, Computation Technologies Project, under Cooperative Agreement Number NCC5-626 between NASA and the California Institute of Technology.
Group:Infrared Processing and Analysis Center (IPAC)
Funding AgencyGrant Number
W. M. Keck FoundationUNSPECIFIED
Series Name:Proceedings of SPIE
Issue or Number:9913
Record Number:CaltechAUTHORS:20161122-090204174
Persistent URL:
Official Citation:G. Bruce Berriman ; Richard W. Cohen ; Andrew Colson ; Christopher R. Gelino ; John C. Good ; Mihseh Kong ; Anastasia C. Laity ; Jeffrey A. Mader ; Melanie A. Swain ; Hien D. Tran ; Shin-Ywan Wang; A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more. Proc. SPIE 9913, Software and Cyberinfrastructure for Astronomy IV, 99130I (August 8, 2016); doi:10.1117/12.2231719
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:72242
Deposited By: Tony Diaz
Deposited On:22 Nov 2016 18:01
Last Modified:28 Oct 2019 21:03

Repository Staff Only: item control page