Format

Send to

Choose Destination
J Stat Comput Simul. 2015;85(6):1090-1101.

Model-Averaged [Formula: see text] Regularization using Markov Chain Monte Carlo Model Composition.

Author information

1
Insilicos and University of Washington, Seattle, WA / cfraley@insilicos.com.
2
Department of Statistics, Carnegie Mellon University / dancsi@gmail.com.

Abstract

Bayesian Model Averaging (BMA) is an effective technique for addressing model uncertainty in variable selection problems. However, current BMA approaches have computational difficulty dealing with data in which there are many more measurements (variables) than samples. This paper presents a method for combining [Formula: see text] regularization and Markov chain Monte Carlo model composition techniques for BMA. By treating the [Formula: see text] regularization path as a model space, we propose a method to resolve the model uncertainty issues arising in model averaging from solution path point selection. We show that this method is computationally and empirically effective for regression and classification in high-dimensional datasets. We apply our technique in simulations, as well as to some applications that arise in genomics.

KEYWORDS:

MCMCMC; Markov chains; high-dimensional; lasso; model averaging; model composition; variable selection; ℓ1 regularization

Supplemental Content

Full text links

Icon for PubMed Central
Loading ...
Support Center