Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling

TitleAccelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling
Publication TypeJournal Article
Year of Publication2009
AuthorsVrugt, J. A., ter Braak C. J. F., Diks C. G. H., Robinson B. A., Hyman J. M., & Higdon D.
JournalInternational Journal of Nonlinear Sciences and Numerical Simulation
Volume10
Pagination273-290
Date PublishedMar
Type of ArticleArticle
ISBN Number1565-1339
Accession Numberhttp://apps.isiknowledge.com/InboundService.do?Func=Frame&product=WOS&action=retrieve&SrcApp=EndNote&Init=Yes&SrcAuth=ResearchSoft&mode=FullRecord&UT=000264593800001
Keywords1172; adaptation; bayesian-inference; Content Type: Biblio; DE-MC,; differential evolution Markov chain; DRAM, delayed rejection adaptive; DREAM, differential evolution adaptive metropolis; MCMC, Markov chain Monte Carlo; Metropolis; metropolis algorithm; migration; models; optimization; proposal; regeneration; RWM, random walk metropolis; samplers; SCE-UA,; shuffled complex evolution - university of Arizona; uncertainty
Abstract

Markov chain Monte Carlo (MCMC) methods have found widespread use in many fields of study to estimate the average properties of complex systems, and for posterior inference in a Bayesian framework. Existing theory and experiments prove convergence of well-constructed MCMC schemes to the appropriate limiting distribution under a variety of different conditions. In practice, however this convergence is often observed to be disturbingly slow. This is frequently caused by an inappropriate selection of the proposal distribution used to generate trial moves in the Markov Chain. Here we show that significant improvements to the efficiency of MCMC simulation can be made by using a self-adaptive Differential Evolution learning strategy within a population-based evolutionary framework. This scheme, entitled Differential Evolution Adaptive Metropolis or DREAM, runs multiple different chains simultaneously for global exploration, and automatically tunes the scale and orientation of the proposal distribution in randomized subspaces during the search. Ergodicity of the algorithm is proved, and various examples involving nonlinearity, high-dimensionality, and multimodality show that DREAM is generally Superior to other adaptive MCMC sampling approaches. The DREAM scheme significantly enhances the applicability of MCMC simulation to Complex, multi-modal search problems.

URLhttp://apps.isiknowledge.com/InboundService.do?Func=Frame&product=WOS&action=retrieve&SrcApp=EndNote&Init=Yes&SrcAuth=ResearchSoft&mode=FullRecord&UT=000264593800001
Alternate JournalInt. J. Nonlinear Sci. Numer. Simul.
Publication Information
ESS Associations
Research Area: 
Physical Climate