Search ESS
-
Apr 24, 2013 4:41 GMT
-
Apr 4, 2013 11:57 GMT
Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling
| Title | Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling |
| Publication Type | Journal Article |
| Year of Publication | 2009 |
| Authors | Vrugt, J. A., ter Braak C. J. F., Diks C. G. H., Robinson B. A., Hyman J. M., & Higdon D. |
| Journal | International Journal of Nonlinear Sciences and Numerical Simulation |
| Volume | 10 |
| Pagination | 273-290 |
| Date Published | Mar |
| Type of Article | Article |
| ISBN Number | 1565-1339 |
| Accession Number | http://apps.isiknowledge.com/InboundService.do?Func=Frame&product=WOS&action=retrieve&SrcApp=EndNote&Init=Yes&SrcAuth=ResearchSoft&mode=FullRecord&UT=000264593800001 |
| Keywords | 1172; adaptation; bayesian-inference; Content Type: Biblio; DE-MC,; differential evolution Markov chain; DRAM, delayed rejection adaptive; DREAM, differential evolution adaptive metropolis; MCMC, Markov chain Monte Carlo; Metropolis; metropolis algorithm; migration; models; optimization; proposal; regeneration; RWM, random walk metropolis; samplers; SCE-UA,; shuffled complex evolution - university of Arizona; uncertainty |
| Abstract | Markov chain Monte Carlo (MCMC) methods have found widespread use in many fields of study to estimate the average properties of complex systems, and for posterior inference in a Bayesian framework. Existing theory and experiments prove convergence of well-constructed MCMC schemes to the appropriate limiting distribution under a variety of different conditions. In practice, however this convergence is often observed to be disturbingly slow. This is frequently caused by an inappropriate selection of the proposal distribution used to generate trial moves in the Markov Chain. Here we show that significant improvements to the efficiency of MCMC simulation can be made by using a self-adaptive Differential Evolution learning strategy within a population-based evolutionary framework. This scheme, entitled Differential Evolution Adaptive Metropolis or DREAM, runs multiple different chains simultaneously for global exploration, and automatically tunes the scale and orientation of the proposal distribution in randomized subspaces during the search. Ergodicity of the algorithm is proved, and various examples involving nonlinearity, high-dimensionality, and multimodality show that DREAM is generally Superior to other adaptive MCMC sampling approaches. The DREAM scheme significantly enhances the applicability of MCMC simulation to Complex, multi-modal search problems. |
| URL | http://apps.isiknowledge.com/InboundService.do?Func=Frame&product=WOS&action=retrieve&SrcApp=EndNote&Init=Yes&SrcAuth=ResearchSoft&mode=FullRecord&UT=000264593800001 |
| Alternate Journal | Int. J. Nonlinear Sci. Numer. Simul. |