CaltechAUTHORS
  A Caltech Library Service

Enabling 1,000,000-entity simulations on distributed Linux clusters

Wagenbreth, Gene and Yao, Ke-Thia and Davis, Dan M. and Lucas, Robert F. and Gottschalk, Thomas D. (2005) Enabling 1,000,000-entity simulations on distributed Linux clusters. In: WSC '05 Proceedings of the 37th conference on Winter simulation. Winter Simulation Conference , pp. 1170-1181. ISBN 0-7803-9519-0. https://resolver.caltech.edu/CaltechAUTHORS:20170103-174313975

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20170103-174313975

Abstract

The Information Sciences Institute and Caltech are enabling USJFCOM and the Institute for Defense Analyses to conduct entity-level simulation experiments using hundreds of distributed computer nodes on Linux Clusters as a vehicle for simulating millions of JSAF entities. Included below is the experience with the design and implementation of the code that increased scalability, thereby enabling two orders of magnitude growth and the effective use of DoD high-end computers. A typical JSAF experiment generates several terabytes of logged data, which is queried in near-real-time and for months afterward. The amount of logged data and the desired database query performance mandated the redesign of the original logger system's monolithic database, making it distributed and incorporating several advanced concepts. System procedures and practices were established to reliably execute the global-scale simulations, effectively operate the distributed computers, efficiently process and store terabytes of data, and provide straightforward access to the data by analysts.


Item Type:Book Section
Related URLs:
URLURL TypeDescription
http://dl.acm.org/citation.cfm?id=1162914PublisherArticle
Additional Information:© 2005 Winter Simulation Conference. The authors would like to thank the Joint Experimentation Group at JFCOM and they acknowledge the support and encouragement of Major General Woods, Anthony Cerri, and Jim Blank. The authors especially would like to acknowledge the direction, support and counsel of Rae Dehncke, program manger and guiding light for this project. They would like to recognize the excellent technical support of the ISI’s Computational Sciences Division, especially John Tran and the guidance and assistance from ISI’s Scalable Systems Division and the JSAF team: Dr. Andy Ceranowicz, Mark Torpey, Bill Hellfinstine and many others. This material is based on research sponsored by the Air Force Research Laboratory under agreement numbers F30602-02-C-0213 and FA8750-05-2-0204. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes, notwithstanding any copyright notation thereon.
Funders:
Funding AgencyGrant Number
Air Force Research LaboratoryF30602-02-C-0213
Air Force Research LaboratoryFA8750-05-2-0204
Record Number:CaltechAUTHORS:20170103-174313975
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20170103-174313975
Official Citation:Gene Wagenbreth, Ke-Thia Yao, Dan M. Davis, Robert F. Lucas, and Thomas D. Gottschalk. 2005. Enabling 1,000,000-entity simulations on distributed Linux clusters. In Proceedings of the 37th conference on Winter simulation (WSC '05). Winter Simulation Conference 1170-1181
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:73196
Collection:CaltechAUTHORS
Deposited By: Kristin Buxton
Deposited On:04 Jan 2017 15:55
Last Modified:03 Oct 2019 16:25

Repository Staff Only: item control page