Published October 2012 | Version public
Journal Article

Data challenges of time domain astronomy

  • 1. ROR icon California Institute of Technology
  • 2. ROR icon University of Naples Federico II

Abstract

Astronomy has been at the forefront of the development of the techniques and methodologies of data intensive science for over a decade with large sky surveys and distributed efforts such as the Virtual Observatory. However, it faces a new data deluge with the next generation of synoptic sky surveys which are opening up the time domain for discovery and exploration. This brings both new scientific opportunities and fresh challenges, in terms of data rates from robotic telescopes and exponential complexity in linked data, but also for data mining algorithms used in classification and decision making. In this paper, we describe how an informatics-based approach— part of the so-called "fourth paradigm" of scientific discovery—is emerging to deal with these. We review our experiences with the Palomar-Quest and Catalina Real- Time Transient Sky Surveys; in particular, addressing the issue of the heterogeneity of data associated with transient astronomical events (and other sensor networks) and how to manage and analyze it.

Additional Information

© 2012 Springer Science+Business Media, LLC. Published online: 10 August 2012. This work has been supported in part by the National Science Foundation grants AST-0407448, CNS-0540369, AST-0834235, AST-0909182 and IIS-1118041; the National Aeronautics and Space Administration grant 08-AISR08-0085; and by the Ajax and Fishbein Family Foundations. We are thankful to numerous colleagues in the VO and Astroinformatics community, and to the members of the DPOSS, PQ, and CRTS survey teams, for many useful discussions and interactions through the years. We thank the anonymous referees for their useful comments.

Additional details

Identifiers

Eprint ID
34703
Resolver ID
CaltechAUTHORS:20121005-095516304

Funding

NSF
AST-0407448
NSF
CNS-0540369
NSF
AST-0834235
NSF
AST-0909182
NSF
IIS-1118041
NASA
08-AISR08-0085
Ajax Foundation
Fishbein Family Foundation

Dates

Created
2012-10-05
Created from EPrint's datestamp field
Updated
2021-11-09
Created from EPrint's last_modified field