Förster, F. and Cabrera-Vives, G. and Castillo-Navarrete, E. and Estévez, P. A. and Sánchez-Sáez, P. and Arredondo, J. and Bauer, F. E. and Carrasco-Davis, R. and Catelan, M. and Elorrieta, F. and Eyheramendy, S. and Huijse, P. and Pignata, G. and Reyes, E. and Reyes, I. and Rodríguez-Mancini, D. and Ruz-Mieres, D. and Valenzuela, C. and Álvarez-Maldonado, I. and Astorga, N. and Borissova, J. and Clocchiatti, A. and De Cicco, D. and Donoso-Oliva, C. and Hernández-García, L. and Graham, M. J. and Jordán, A. and Kurtev, R. and Mahabal, A. and Maureira, J. C. and Muñoz-Arancibia, A. and Molina-Ferreiro, R. and Moya, A. and Palma, W. and Pérez-Carrasco, M. and Protopapas, P. and Romero-Wolf, M. and Sabatini-Gacitua, L. and Sánchez, A. and San Martín, J. and Sepúlveda-Cobo, C. and Vera, E. and Vergara, J. R. (2021) The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker. Astronomical Journal, 161 (5). Art. No. 242. ISSN 0004-6256. doi:10.3847/1538-3881/abe9bc. https://resolver.caltech.edu/CaltechAUTHORS:20210503-115703881
![[img]](https://authors.library.caltech.edu/style/images/fileicons/application_pdf.png) |
PDF
- Published Version
See Usage Policy. 4MB |
|
PDF
- Submitted Version
See Usage Policy. 6MB |
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20210503-115703881
Abstract
We introduce the Automatic Learning for the Rapid Classification of Events (ALeRCE) broker, an astronomical alert broker designed to provide a rapid and self-consistent classification of large etendue telescope alert streams, such as that provided by the Zwicky Transient Facility (ZTF) and, in the future, the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). ALeRCE is a Chilean-led broker run by an interdisciplinary team of astronomers and engineers working to become intermediaries between survey and follow-up facilities. ALeRCE uses a pipeline that includes the real-time ingestion, aggregation, cross-matching, machine-learning (ML) classification, and visualization of the ZTF alert stream. We use two classifiers: a stamp-based classifier, designed for rapid classification, and a light curve–based classifier, which uses the multiband flux evolution to achieve a more refined classification. We describe in detail our pipeline, data products, tools, and services, which are made public for the community (see https://alerce.science). Since we began operating our real-time ML classification of the ZTF alert stream in early 2019, we have grown a large community of active users around the globe. We describe our results to date, including the real-time processing of 1.5 × 10⁸ alerts, the stamp classification of 3.4 × 10⁷ objects, the light-curve classification of 1.1 × 10⁶ objects, the report of 6162 supernova candidates, and different experiments using LSST-like alert streams. Finally, we discuss the challenges ahead in going from a single stream of alerts such as ZTF to a multistream ecosystem dominated by LSST.
| Item Type: | Article | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Related URLs: |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ORCID: |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Additional Information: | © 2021. The American Astronomical Society. Received 2020 June 29; revised 2021 February 22; accepted 2021 February 25; published 2021 April 27. This work was funded by ANID—Millennium Science Initiative Program—ICN12_009 awarded to the Millennium Institute of Astrophysics MAS (A.C., A.M., A.M.A., A.S., C.S.C., C.D.O., C.V., D.D.C., D.R.Ma., D.R.Mi., E.C.N., E.R., F.E., F.E.B., F.F., G.C.V., G.P., I.A.M., I.R., J.A., J.B., J.R.V., L.H.G., L.S.G., M.C., M.P.C., N.A., P.A.E., P.H., P.S.S., R.C.D., S.E., R.K., and W.P.), and National Agency for Research and Development (ANID) grants: Basal Center for Mathematical Modeling grant CMM ANID PIA AFB170001 (A.M., A.M.A., C.V., C.S.C., E.C.N., E.V., D.R.Ma., D.R.Mi., F.F., I.A.M., I.R., J.C.M., J.S.M., L.S.G., and P.A.E.); Centro de Astrofísica y Tecnologías Afines AFB-170002 (D.D.C., F.E.B., M.C., P.S.S., and A.C.); FONDECYT Regular Nos. 1200710 (F.F.), 1190818 (F.E.B.), 1200495 (F.E.B.), 1171273 (M.C.), 1201793 (G.P.), and 1171678 (P.A.E.); FONDECYT Iniciacion Nos. 11200590 (F.E.) and 11191130 (G.C.V.); FONDECYT Postdoctorado Nos. 3200250 (P.S.S.) and 3200222 (D.D.C.); Magister Nacional 2019 No. 22190947 (E.R.); and ANID infrastructure funds QUIMAL140003 and QUIMAL190012. We acknowledge support from REUNA Chile, which hosts and maintains some of our infrastructure. This work has been possible thanks to the use of AWS-U.Chile-NLHPC credits. This work was funded in part by project CORFO 10CEII-9157 Inria Chile. Powered@NLHPC: This research was partially supported by the supercomputing infrastructure of the NLHPC (ECM-02). This project was supported by the Competition for Research Regular Projects, year 2019, code LPR19-22, Universidad Tecnológica Metropolitana and the high-performance computing system of PIDi-UTEM (SCC-PIDi-UTEM—CONICYT—FONDEQUIP—EQM180180). Software: Aladin (Bonnarel et al. 2000), Apache ECharts, 36 Apache Kafka, 37 Apache Spark (Zaharia et al. 2016), ASTROIDE (Brahem et al. 2018), Astropy (Astropy Collaboration et al. 2013), catsHTM (Soumagnac & Ofek 2018), Dask (Rocklin 2015), FATS (Nun et al. 2017), Grafana, 38 Imbalanced-learn (Lemaître et al. 2017), ipyladin (Boch & Desroziers 2020), Jupyter (Kluyver et al. 2016), Keras (Gulli et al. 2017), Matplotlib (Hunter 2007), NED (Steer et al. 2017), P4J (Huijse et al. 2018), Pandas (McKinney et al. 2010), Prometheus, 39 Python (Van Rossum & Drake 1995), scikit-learn (Pedregosa et al. 2011), Simbad-CDS (Wenger et al. 2000), Tensorflow (Abadi et al. 2016), Vue, 40 Vuetify, 41 PostgreSQL, 42 XGBoost. 43 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Funders: |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Subject Keywords: | Supernovae; Variable stars; Active galactic nuclei; Astroinformatics; Surveys; Classification; Astrostatistics; Convolutional neural networks; Random Forests; Cloud computing; Distributed computing; Small solar system bodies | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Issue or Number: | 5 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Classification Code: | Unified Astronomy Thesaurus concepts: Supernovae (1668); Variable stars (1761); Active galactic nuclei (16); Astroinformatics (78); Surveys (1671); Classification (1907); Astrostatistics (1882); Convolutional neural networks (1938); Random Forests (1935); | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| DOI: | 10.3847/1538-3881/abe9bc | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Record Number: | CaltechAUTHORS:20210503-115703881 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20210503-115703881 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Official Citation: | F. Förster et al 2021 AJ 161 242 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ID Code: | 108930 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Collection: | CaltechAUTHORS | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Deposited By: | George Porter | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Deposited On: | 06 May 2021 14:36 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Last Modified: | 16 Nov 2021 19:33 |
Repository Staff Only: item control page
