A Caltech Library Service

Observatory Archives in the Era of Big Data: Perspectives from the Spitzer Mission

Storrie-Lombardi, Lisa J. (2016) Observatory Archives in the Era of Big Data: Perspectives from the Spitzer Mission. In: Astronomical Data Analysis Software and Systems XXV. Astronomical Society of the Pacific Conference Series. No.512. Astronomical Society of the Pacific , San Francisco, CA, pp. 29-31. ISBN 978-1-58381-908-1.

[img] PDF - Published Version
See Usage Policy.


Use this Persistent URL to link to this item:


Community Observatory archives, supporting disparate data sets, have traditionally been fundamentally different than homogeneous survey archives. Technological advances in the past decade, particularly with respect to the ease of connectivity, are blurring the lines between observatory archives and large sky surveys. Archives are no longer monolithic repositories of data but instead are portals for data and services as part of the broader scientific landscape. If starting today we would approach the Spitzer archive design with a very different mindset than we did fifteen years ago. We discuss here (1) design lessons learned and the evolution of the archive, (2) the benefits of having the Spitzer archive as a component of IRSA, (3) the value of serving enhanced data sets that are returned to the archive by science teams, and (4) the benefits of connectivity to large survey archives, now and in the future.

Item Type:Book Section
Related URLs:
URLURL TypeDescription
Storrie-Lombardi, Lisa J.0000-0002-5987-5210
Additional Information:© 2017 Astronomical Society of the Pacific. The author thanks all of the dedicated scientists and software developers that have contributed to creating the Spitzer and IRSA archives.
Group:Infrared Processing and Analysis Center (IPAC)
Series Name:Astronomical Society of the Pacific Conference Series
Issue or Number:512
Record Number:CaltechAUTHORS:20180913-074908897
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:89603
Deposited By: Tony Diaz
Deposited On:13 Sep 2018 17:57
Last Modified:03 Oct 2019 20:17

Repository Staff Only: item control page