Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published January 2018 | Published + Supplemental Material
Journal Article Open

Earthquake Early Warning ShakeAlert System: Testing and Certification Platform


Earthquake early warning systems provide warnings to end users of incoming moderate to strong ground shaking from earthquakes. An earthquake early warning system, ShakeAlert, is providing alerts to beta end users in the western United States, specifically California, Oregon, and Washington. An essential aspect of the earthquake early warning system is the development of a framework to test modifications to code to ensure functionality and assess performance. In 2016, a Testing and Certification Platform (TCP) was included in the development of the Production Prototype version of ShakeAlert. The purpose of the TCP is to evaluate the robustness of candidate code that is proposed for deployment on ShakeAlert Production Prototype servers. TCP consists of two main components: a real‐time in situ test that replicates the real‐time production system and an offline playback system to replay test suites. The real‐time tests of system performance assess code optimization and stability. The offline tests comprise a stress test of candidate code to assess if the code is production ready. The test suite includes over 120 events including local, regional, and teleseismic historic earthquakes, recentering and calibration events, and other anomalous and potentially problematic signals. Two assessments of alert performance are conducted. First, point‐source assessments are undertaken to compare magnitude, epicentral location, and origin time with the Advanced National Seismic System Comprehensive Catalog, as well as to evaluate alert latency. Second, we describe assessment of the quality of ground‐motion predictions at end‐user sites by comparing predicted shaking intensities to ShakeMaps for historic events and implement a threshold‐based approach that assesses how often end users initiate the appropriate action, based on their ground‐shaking threshold. TCP has been developed to be a convenient streamlined procedure for objectively testing algorithms, and it has been designed with flexibility to accommodate significant changes in development of new or modified system code. It is expected that the TCP will continue to evolve along with the ShakeAlert system, and the framework we describe here provides one example of how earthquake early warning systems can be evaluated.

Additional Information

© 2017 Seismological Society of America. Published Online 6 December 2017. Data and Resources: All test event data used by Testing and Certification Platform (TCP) are provided as miniSEED files and in tank file format at http://scedc.caltech.edu/research-tools/eewtesting.html (last accessed November 2017). The Earthworm open‐source software is available at www.isti.com (last accessed November 2017). For Haywired website, see https://geography.wr.usgs.gov/science/mhdp/haywired.html (last accessed November 2017). The unpublished manuscript by S. E. Minson, M.‐A. Meier, A. S. Baltay, T. C. Hanks, and E. S. Cochran, 2017, "The theoretical and observational limits of earthquake early warning: Timeliness of ground motion estimates", submitted to Science Advances. The authors wish to acknowledge the entire ShakeAlert research and development team, many of whom provided valuable discussions that helped inform the design of the system. The authors also thank internal U.S. Geological Survey (USGS) reviewers Sarah Minson and Glenn Biasi as well as two anonymous journal reviewers and Associate Editor Brendan Crowell for their helpful and insightful comments.

Attached Files

Published - srl-2017138.1.pdf

Supplemental Material - srl-2017138_esupp.zip


Files (785.5 kB)
Name Size Download all
750.5 kB Preview Download
35.0 kB Preview Download

Additional details

August 19, 2023
March 6, 2024