Supervised Feature Selection via Dependence Estimation

We introduce a framework for filtering features that employs the Hilbert-Schmidt Independence Criterion (HSIC) as a measure of dependence between the features and the labels. The key idea is that good features should maximise such dependence. Feature selection for various supervised learning problems (including classification and regression) is unified under this framework, and the solutions can be approximated using a backward-elimination algorithm. We demonstrate the usefulness of our method on both artificial and real world datasets. 1

Regression Shrinkage andSelection Via the LassoRegression Shrinkage and Selection Via the LassoToward Optimal FeatureSelectionToward Optimal Feature Selection10.1162/15324430332275361610.1162/153244303322753616The Elements ofStatistical Learning…The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd EditionGene Selection forCancer Classification…Gene Selection for Cancer Classification using Support Vector MachinesUse of the Zero-Normwith Linear Models and…Use of the Zero-Norm with Linear Models and Kernel MethodsAn introduction tovariable and feature…An introduction to variable and feature selectionDimensionality Reductionfor Supervised Learning…Dimensionality Reduction for Supervised Learning with Reproducing Kernel Hilbert SpacesLinear Models andEmpirical Bayes Methods…Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray ExperimentsCombined SVM-BasedFeature Selection and…Combined SVM-Based Feature Selection and ClassificationMeasuring StatisticalDependence with…Measuring Statistical Dependence with Hilbert-Schmidt NormsIntegrating structuredbiological data by…Integrating structured biological data by Kernel Maximum Mean DiscrepancyNon-monotonic featureselectionNon-monotonic feature selectionDiscriminativeSemi-Supervised Feature…Discriminative Semi-Supervised Feature Selection via Manifold RegularizationA General Framework forAnalyzing Data from Two…A General Framework for Analyzing Data from Two Short Time-Series Microarray ExperimentsFromTransformation-Based…From Transformation-Based Dimensionality Reduction to Feature SelectionEfficient SpectralFeature Selection with…Efficient Spectral Feature Selection with Minimum RedundancyFeature Selection: AnEver Evolving Frontier…Feature Selection: An Ever Evolving Frontier in Data MiningKernel Methods inBioinformaticsKernel Methods in BioinformaticsMulticlass FeatureSelection With Kernel…Multiclass Feature Selection With Kernel Gram-Matrix-Based CriteriaBudget constrainednon-monotonic feature…Budget constrained non-monotonic feature selectionKernel-BasedDomain-Invariant Featur…Kernel-Based Domain-Invariant Feature Selection in Hyperspectral Images for Transfer LearningSemisupervised FeatureSelection Based on…Semisupervised Feature Selection Based on Relevance and Redundancy CriteriaDimensionality reductionapproaches and evolving…Dimensionality reduction approaches and evolving challenges in high dimensional dataSupervised FeatureSelection via Dependenc…Supervised Feature Selection via Dependence EstimationEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.