Landry, Walter and Monkewitz, Serge (2019) Instantaneous Archives. In: Astronomical Data Analysis Software and Systems XXVI. Astronomical Society of the Pacific Conference Series. No.521. Astronomical Society of the Pacific , San Francisco, CA, pp. 20-23. ISBN 978-1-58381-929-6. https://resolver.caltech.edu/CaltechAUTHORS:20191202-075406415
Full text is not posted in this repository. Consult Related URLs below.
Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20191202-075406415
Abstract
IRSA, the NASA/IPAC Infrared Science Archive, is one of the largest and busiest astronomy archives in the world. In the past, our main emphasis was on making new data and new capabilities available. With the widespread implementation of Virtual Observatory protocols, there are a number of useful tools that can quickly and easily perform insightful, sophisticated queries from archives around the world (Taylor et al. 2019; Astropy Collaboration et al. 2013). The queries, if not handled quickly, can easily overwhelm the site and interfere with other users. In addition, reducing latency below the point of human perception enables more interactive and exploratory science. This paper discusses how we are re-architecting our query pipeline to eliminate process, file system, and database connection overheads. Taken together, these improvements delivered radical, order of magnitude improvements in latency and throughput.
| Item Type: | Book Section | ||||||
|---|---|---|---|---|---|---|---|
| Related URLs: |
| ||||||
| Additional Information: | © 2019 Astronomical Society of the Pacific. We would like to thank Mark O'Dell, Angela Zhang, Scott Terek, and Gilles Landais for their assistance. | ||||||
| Group: | Infrared Processing and Analysis Center (IPAC) | ||||||
| Series Name: | Astronomical Society of the Pacific Conference Series | ||||||
| Issue or Number: | 521 | ||||||
| Record Number: | CaltechAUTHORS:20191202-075406415 | ||||||
| Persistent URL: | https://resolver.caltech.edu/CaltechAUTHORS:20191202-075406415 | ||||||
| Usage Policy: | No commercial reproduction, distribution, display or performance rights in this work are provided. | ||||||
| ID Code: | 100120 | ||||||
| Collection: | CaltechAUTHORS | ||||||
| Deposited By: | Tony Diaz | ||||||
| Deposited On: | 02 Dec 2019 18:21 | ||||||
| Last Modified: | 18 Nov 2020 19:06 |
Repository Staff Only: item control page
