CaltechAUTHORS
  A Caltech Library Service

Consensus Based Sampling

Carrillo, J. A. and Hoffmann, F. and Stuart, A. M. and Vaes, U. (2021) Consensus Based Sampling. . (Unpublished) https://resolver.caltech.edu/CaltechAUTHORS:20210719-210142693

[img] PDF - Submitted Version
Creative Commons Attribution Share Alike.

2MB

Use this Persistent URL to link to this item: https://resolver.caltech.edu/CaltechAUTHORS:20210719-210142693

Abstract

We propose a novel method for sampling and optimization tasks based on a stochastic interacting particle system. We explain how this method can be used for the following two goals: (i) generating approximate samples from a given target distribution; (ii) optimizing a given objective function. The approach is derivative-free and affine invariant, and is therefore well-suited for solving inverse problems defined by complex forward models: (i) allows generation of samples from the Bayesian posterior and (ii) allows determination of the maximum a posteriori estimator. We investigate the properties of the proposed family of methods in terms of various parameter choices, both analytically and by means of numerical simulations. The analysis and numerical simulation establish that the method has potential for general purpose optimization tasks over Euclidean space; contraction properties of the algorithm are established under suitable conditions, and computational experiments demonstrate wide basins of attraction for various specific problems. The analysis and experiments also demonstrate the potential for the sampling methodology in regimes in which the target distribution is unimodal and close to Gaussian; indeed we prove that the method recovers a Laplace approximation to the measure in certain parametric regimes and provide numerical evidence that this Laplace approximation attracts a large set of initial conditions in a number of examples.


Item Type:Report or Paper (Discussion Paper)
Related URLs:
URLURL TypeDescription
http://arxiv.org/abs/2106.02519arXivDiscussion Paper
ORCID:
AuthorORCID
Carrillo, J. A.0000-0001-8819-4660
Hoffmann, F.0000-0002-1182-5521
Additional Information:Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) The authors are grateful to Zehua Lai for pointing out that the Poincaré inequality could be employed for proving Lemma 3.1. JAC was supported by the Advanced Grant Nonlocal-CPD (Nonlocal PDEs for Complex Particle Dynamics: Phase Transitions, Patterns and Synchronization) of the European Research Council Executive Agency (ERC) under the European Union's Horizon 2020 research and innovation programme (grant agreement No. 883363) and by EPSRC grant number EP/T022132/1. JAC and UV were also supported by EPSRC grant number EP/P031587/1. FH was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy - GZ 2047/1, Projekt-ID 390685813. AMS is supported by NSF (award AGS-1835860), NSF (award DMS-1818977) and by the Office of Naval Research (award N00014-17-1-2079). UV was also supported by the Fondation Sciences Mathématiques de Paris (FSMP), through a postdoctoral fellowship in the "mathematical interactions" program.
Funders:
Funding AgencyGrant Number
European Research Council (ERC)883363
Engineering and Physical Sciences Research Council (EPSRC)EP/T022132/1
Engineering and Physical Sciences Research Council (EPSRC)EP/P031587/1
Deutsche Forschungsgemeinschaft (DFG)390685813 - GZ 2047/1
NSFAGS-1835860
NSFDMS-1818977
Office of Naval Research (ONR)N00014-17-1-2079
Fondation Sciences Mathématiques de ParisUNSPECIFIED
Record Number:CaltechAUTHORS:20210719-210142693
Persistent URL:https://resolver.caltech.edu/CaltechAUTHORS:20210719-210142693
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:109920
Collection:CaltechAUTHORS
Deposited By: George Porter
Deposited On:19 Jul 2021 21:27
Last Modified:19 Jul 2021 21:27

Repository Staff Only: item control page