Published July 2025 | Published
Journal Article Open

Ensemble Kalman methods: A mean-field perspective

  • 1. ROR icon California Institute of Technology
  • 2. ROR icon University of Potsdam

Abstract

Ensemble Kalman methods, introduced in 1994 in the context of ocean state estimation, are now widely used for state estimation and parameter estimation (inverse problems) in many arenae. Their success stems from the fact that they take an underlying computational model as a black box to provide a systematic, derivative-free methodology for incorporating observations; furthermore the ensemble approach allows for sensitivities and uncertainties to be calculated. Analysis of the accuracy of ensemble Kalman methods, especially in terms of uncertainty quantification, is lagging behind empirical success; this paper provides a unifying mean-field-based framework for their analysis. Both state estimation and parameter estimation problems are considered, and formulations in both discrete and continuous time are employed. For state estimation problems, both the control and filtering approaches are considered; analogously for parameter estimation problems, the optimization and Bayesian perspectives are both studied. As well as providing an elegant framework, the mean-field perspective also allows for the derivation of a variety of methods used in practice. In addition it unifies a wide-ranging literature in the field and suggests open problems.

Copyright and License

© The Author(s), 2025. Published by Cambridge University Press. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Acknowledgement

The authors are grateful to Dmitry Burov for helpful advice regarding the numerical experiments; they are also grateful to Arnaud Vadeboncoeur, Eviatar Bach, Ricardo Baptista and Daniel Sanz-Alonso for helpful discussions which improved this paper. The authors thank Mark Asch for careful reading of the paper, and useful feedback. Finally AMS is grateful for hospitality offered at the University of Chicago, by Guillaume Bal, Peter McCullagh, Daniel Sanz-Alonso and Rebecca Willett, where he delivered lectures based on a preliminary version of this paper in May 2022.

Funding

EC is grateful to the Kortschak Scholars Program within the CMS Department at Caltech for financial support. Thework ofSRis supported by Deutsche Forschungsgemeinschaft (DFG) – Project-ID 318763901 – SFB1294. The work of AMS is supported by NSF award AGS1835860, and by a Department of Defense Vannevar Bush Faculty Fellowship, which also supports EC. In addition, AMS and EC are supported by the SciAI Center, funded by the Office of Naval Research (ONR), under grant no. N00014-23-1-2729. The work of EC was also supported by the Resnick Sustainability Institute.

Files

ensemble-kalman-methods-a-mean-field-perspective.pdf
Files (3.7 MB)

Additional details

Created:
July 22, 2025
Modified:
July 22, 2025