A Caltech Library Service

DAMEWARE: A Web Cyberinfrastructure for Astrophysical Data Mining

Brescia, Massimo and Cavuoti, Stefano and Longo, Giuseppe and Nocella, Alfonso and Garofalo, Mauro and Manna, Francesco and Esposito, Francesco and Albano, Giovanni and Guglielmo, Marisa and D’Angelo, Giovanni and Di Guido, Alessandro and Djorgovski, S. George and Donalek, Ciro and Mahabal, Ashish A. and Graham, Matthew J. and Fiore, Michelangelo and D’Abrusco, Raffaele (2014) DAMEWARE: A Web Cyberinfrastructure for Astrophysical Data Mining. Publications of the Astronomical Society of the Pacific, 126 (942). pp. 783-797. ISSN 0004-6280. doi:10.1086/677725.

PDF - Published Version
See Usage Policy.

PDF - Submitted Version
See Usage Policy.


Use this Persistent URL to link to this item:


Astronomy is undergoing a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden behind data which are both complex and of high dimensionality. We present DAMEWARE (DAta Mining & Exploration Web Application REsource): a general purpose, web-based, distributed data mining environment developed for the exploration of large data sets, and finely tuned for astronomical applications. By means of graphical user interfaces, it allows the user to perform classification, regression, or clustering tasks with machine learning methods. Salient features of DAMEWARE include its ability to work on large datasets with minimal human intervention, and to deal with a wide variety of real problems such as the classification of globular clusters in the galaxy NGC1399; the evaluation of photometric redshifts; and, finally, the identification of candidate Active Galactic Nuclei in multiband photometric surveys. In all these applications, DAMEWARE allowed us to achieve better results than those attained with more traditional methods. With the aim of providing potential users with all needed information, in this paper we briefly describe the technological background of DAMEWARE, give a short introduction to some relevant aspects of data mining, followed by a summary of some science cases and, finally, provide a detailed description of a template use case.

Item Type:Article
Related URLs:
URLURL TypeDescription
Brescia, Massimo0000-0001-9506-5680
Cavuoti, Stefano0000-0002-3787-4196
Longo, Giuseppe0000-0002-9182-8414
Djorgovski, S. George0000-0002-0603-3087
Mahabal, Ashish A.0000-0003-2242-0244
Graham, Matthew J.0000-0002-3168-0139
Additional Information:© 2014 The Astronomical Society of the Pacific. Received 2014 April 06; accepted 2014 June 10; published 2014 July 21. The authors wish to thank the many students who contributed one way or another to the project. Many of them played such an important role to earn a place in the authors list; some others made small but significant contributions. To all of them we are very grateful. The authors wish also to thank the anonymous referee for his/her many helpful suggestions. DAMEWARE has been a multiyear project funded by many sponsors. The Italian Ministry of Foreign Affairs through a bilateral Great Relevance Italy-USA project; the European funded VO-Tech (Virtual Observatory Technological Infrastructure) 6-th European FW project; the Department of Physics and the Polo della Scienza e Della Tecnologia of the University Federico II in Napoli. GL, MB and SC acknowledge financial support by the Project F.A.R.O., 3rd call by the University Federico II of Naples. GL wish also to thank the financial support by the PRIN-MIUR 2011, Cosmology with the Euclid space mission. SGD, CD, AAM, and MJG acknowledge a partial support from the NSF grants AST-0834235 and IIS-1118041, and the NASA grant 08-AISR08-0085. Some of the work reported here benefited from the discussions which took place during a study and the workshops organized by the Keck Institute for Space Studies at Caltech.
Funding AgencyGrant Number
Italian Ministry of Foreign AffairsUNSPECIFIED
Virtual Observatory Technological InfrastructureUNSPECIFIED
University Federico IIUNSPECIFIED
Subject Keywords:Data Analysis and Techniques
Issue or Number:942
Record Number:CaltechAUTHORS:20141008-104855024
Persistent URL:
Official Citation:DAMEWARE: A Web Cyberinfrastructure for Astrophysical Data Mining Massimo Brescia, Stefano Cavuoti, Giuseppe Longo, Alfonso Nocella, Mauro Garofalo, Francesco Manna, Francesco Esposito, Giovanni Albano, Marisa Guglielmo, Giovanni D’Angelo, Alessandro Di Guido, S. George Djorgovski, Ciro Donalek, Ashish A. Mahabal, Matthew J. Graham, Michelangelo Fiore, and Raffaele D’Abrusco Publications of the Astronomical Society of the Pacific Vol. 126, No. 942 (August 2014) , pp. 783-797 Published by: The University of Chicago Press on behalf of the Astronomical Society of the Pacific Stable URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:50265
Deposited By: Tony Diaz
Deposited On:09 Oct 2014 20:33
Last Modified:10 Nov 2021 18:54

Repository Staff Only: item control page