A Caltech Library Service

The NOAO Data Lab: Science-Driven Development

Fitzpatrick, Michael J. and Graham, Matthew J. and Mighell, Kenneth J. and Olsen, Knut and Norris, Patrick and Ridgway, Stephen T. and Stobie, Elizabeth B. and Bolton, Adam S. and Saha, Abhijit and Huang, Lijuan (2016) The NOAO Data Lab: Science-Driven Development. In: Software and Cyberinfrastructure for Astronomy IV. Proceedings of SPIE. No.9913. Society of Photo-Optical Instrumentation Engineers (SPIE) , Bellingham, WA, Art. No. 99130L. ISBN 978-1-5106-0205-2.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


The NOAO Data Lab aims to provide infrastructure to maximize community use of the high-value survey datasets now being collected with NOAO telescopes and instruments. As a science exploration framework, the Data Lab allow users to access and search databases containing large (i.e. terabyte-scale) catalogs, visualize, analyze, and store the results of these searches, combine search results with data from other archives or facilities, and share these results with collaborators using a shared workspace and/or data publication service. In the process of implementing the needed tools and services, specific science cases are used to guide development of the system framework and tools. The result is a Year-1 capability demonstration that (fully or partially) implements each of the major architecture components in the context of a real-world science use-case. In this paper, we discuss how this model of science-driven development helped us to build a fully functional system capable of executing the chosen science case, and how we plan to scale this system to support general use in the next phase of the project.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Graham, Matthew J.0000-0002-3168-0139
Olsen, Knut0000-0002-7134-8296
Saha, Abhijit0000-0002-6839-4881
Additional Information:© 2016 Society of Photo-Optical Instrumentation Engineers (SPIE). We gratefully acknowledge the many useful comments and suggestions offered by review committees and local NOAO staff. The National Optical Astronomy Observatory (NOAO) is operated by the Association of Universities for Research in Astronomy (AURA) under contract to the National Science Foundation (NSF).
Funding AgencyGrant Number
Subject Keywords:Science exploration framework, remote execution, data services, application containers
Series Name:Proceedings of SPIE
Issue or Number:9913
Record Number:CaltechAUTHORS:20170110-112451937
Persistent URL:
Official Citation:Michael J. Fitzpatrick ; Matthew J. Graham ; Kenneth J. Mighell ; Knut Olsen ; Patrick Norris ; Stephen T. Ridgway ; Elizabeth B. Stobie ; Adam S. Bolton ; Abhijit Saha ; Lijuan W. Huang; The NOAO data lab: science-driven development. Proc. SPIE 9913, Software and Cyberinfrastructure for Astronomy IV, 99130L (August 2, 2016); doi:10.1117/12.2233791.
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:73372
Deposited By: Ruth Sustaita
Deposited On:10 Jan 2017 20:16
Last Modified:17 Nov 2019 06:09

Repository Staff Only: item control page