Variable selection in nonparametric additive models

We consider a nonparametric additive model of a conditional mean function in which the number of variables and additive components may be larger than the sample size but the number of nonzero additive components is "small" relative to the sample size. The statistical problem is to determine which additive components are nonzero. The additive components are approximated by truncated series expansions with B-spline bases. With this approximation, the problem of component selection becomes that of selecting the groups of coefficients in the expansion. We apply the adaptive group Lasso to select nonzero components, using the group Lasso to obtain an initial estimator and reduce the dimension of the problem. We give conditions under which the group Lasso selects a model whose number of components is comparable with the underlying model, and the adaptive group Lasso selects the nonzero components correctly with probability approaching one as the sample size increases and achieves the optimal rate of convergence. The results of Monte Carlo experiments show that the adaptive group Lasso procedure works well with samples of moderate size. A data example is used to illustrate the application of the proposed method.

Additive Regression andOther Nonparametric…Additive Regression and Other Nonparametric ModelsNonconcave penalizedlikelihood with a…Nonconcave penalized likelihood with a diverging number of parametersComponent selection andsmoothing in…Component selection and smoothing in multivariate nonparametric regressionThe Adaptive Lasso andIts Oracle PropertiesThe Adaptive Lasso and Its Oracle PropertiesLasso-type recovery ofsparse representations…Lasso-type recovery of sparse representations for high-dimensional dataThe sparsity and bias ofthe Lasso selection in…The sparsity and bias of the Lasso selection in high-dimensional linear regressionAsymptotic properties ofbridge estimators in…Asymptotic properties of bridge estimators in sparse high-dimensional regression modelsSparse Additive ModelsSparse Additive ModelsHigh-dimensionaladditive modelingHigh-dimensional additive modelingShrinkage Estimation ofthe Varying Coefficient…Shrinkage Estimation of the Varying Coefficient ModelNearly unbiased variableselection under minimax…Nearly unbiased variable selection under minimax concave penalty2010): “Consistent groupselection in…2010): “Consistent group selection in high-dimensional linear regressionIdentification ofPartially Linear…Identification of Partially Linear Structure in Additive Models with an Application to Gene Expression Prediction from SequencesGroup Lasso for highdimensional sparse…Group Lasso for high dimensional sparse quantile regression modelsSemi-varying coefficientmodels with a diverging…Semi-varying coefficient models with a diverging number of componentsVariable Selection inHigh-dimensional…Variable Selection in High-dimensional Varying-coefficient Models with Global OptimalityParametric componentdetection and variable…Parametric component detection and variable selection in varying-coefficient partially linear modelsVariable selection inhigh-dimensional…Variable selection in high-dimensional quantile varying coefficient modelsHigh dimensional singleindex modelsHigh dimensional single index modelsMinimax optimal rates ofestimation in high…Minimax optimal rates of estimation in high dimensional additive modelsVariable Selection andParameter Estimation…Variable Selection and Parameter Estimation with the Atan Regularization MethodFeature Selection withAnnealing for Computer…Feature Selection with Annealing for Computer Vision and Big Data LearningPathwise CoordinateOptimization for Sparse…Pathwise Coordinate Optimization for Sparse Learning: Algorithm and TheoryNonparametric andhigh-dimensional…Nonparametric and high-dimensional functional graphical modelsVariable selection innonparametric additive…Variable selection in nonparametric additive modelsEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.