litlas
Log inCreate account

Regression by dependence minimization and its application to causal inference in additive noise models

Authors: Joris M. Mooij, Dominik Janzing, Jonas Peters, Bernhard Schölkopf - International Conference on Machine Learning, ICML 2009 cited by 109

Motivated by causal inference problems, we propose a novel method for regression that minimizes the statistical dependence between regressors and residuals. The key advantage of this approach to regression is that it does not assume a particular distribution of the noise, i.e., it is non-parametric with respect to the noise distribution. We argue that the proposed regression method is well suited to the task of causal inference in additive noise models. A practical disadvantage is that the resulting optimization problem is generally non-convex and can be difficult to solve. Nevertheless, we report good results on one of the tasks of the NIPS 2008 Causality Challenge, where the goal is to distinguish causes from effects in pairs of statistically dependent variables. In addition, we propose an algorithm for efficiently inferring causal models from observational data for more than two variables. The required number of regressions and independence tests is quadratic in the number of variables, which is a significant improvement over the simple method that tests all possible DAGs.

Structural Equationswith Latent VariablesStructural Equations with Latent VariablesStructural Equationswith Latent Variables.Structural Equations with Latent Variables.Causation, Prediction,and SearchCausation, Prediction, and SearchLearning GaussianNetworksLearning Gaussian NetworksCausality: Models,Reasoning and InferenceCausality: Models, Reasoning and InferenceGaussian processes formachine learningGaussian processes for machine learningMeasuring StatisticalDependence with…Measuring Statistical Dependence with Hilbert-Schmidt NormsA Linear Non-GaussianAcyclic Model for Causa…A Linear Non-Gaussian Acyclic Model for Causal DiscoveryNonlinear causaldiscovery with additive…Nonlinear causal discovery with additive noise modelsDistinguishing betweencause and effectDistinguishing between cause and effectDistinguishing causesfrom effects using…Distinguishing causes from effects using nonlinear acyclic causal modelsCausalityCausalityDistinguishing betweencause and effectDistinguishing between cause and effectDependence MinimizingRegression with Model…Dependence Minimizing Regression with Model Selection for Non-Linear Causal Inference under Non-Gaussian NoiseIdentifiability ofCausal Graphs using…Identifiability of Causal Graphs using Functional ModelsCausal Inference onDiscrete Data Using…Causal Inference on Discrete Data Using Additive Noise ModelsDirectLiNGAM: A DirectMethod for Learning a…DirectLiNGAM: A Direct Method for Learning a Linear Non-Gaussian Structural Equation ModelCausal discovery withcontinuous additive…Causal discovery with continuous additive noise modelsCausal Inference on TimeSeries using Restricted…Causal Inference on Time Series using Restricted Structural Equation ModelsSADA: A GeneralFramework to Support…SADA: A General Framework to Support Robust Causation DiscoveryLeast-squaresindependence regression…Least-squares independence regression for non-linear causal inference under non-Gaussian noiseLingam: Non-GaussianMethods for Estimating…Lingam: Non-Gaussian Methods for Estimating Causal StructuresScore-based causallearning in additive…Score-based causal learning in additive noise modelsDistinguishing Causefrom Effect Using…Distinguishing Cause from Effect Using Observational Data: Methods and BenchmarksRegression by dependenceminimization and its…Regression by dependence minimization and its application to causal inference in additive noise modelsEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.