Disentangling by Factorising

We define and address the problem of unsupervised learning of disentangled representations on data generated from independent factors of variation. We propose FactorVAE, a method that disentangles by encouraging the distribution of representations to be factorial and hence independent across the dimensions. We show that it improves upon $\beta$-VAE by providing a better trade-off between disentanglement and reconstruction quality. Moreover, we highlight the problems of a commonly used disentanglement metric and introduce a new metric that does not suffer from them.

Learning Factorial Codesby Predictability…Learning Factorial Codes by Predictability MinimizationUnsupervised FeatureLearning and Deep…Unsupervised Feature Learning and Deep Learning: A Review and New PerspectivesLearning to DisentangleFactors of Variation…Learning to Disentangle Factors of Variation with Manifold InteractionDeep ConvolutionalInverse Graphics NetworkDeep Convolutional Inverse Graphics NetworkAdversarial AutoencodersAdversarial AutoencodersBatch Normalization:Accelerating Deep…Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftInfoGAN: InterpretableRepresentation Learning…InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netsbeta-VAE: Learning BasicVisual Concepts with a…beta-VAE: Learning Basic Visual Concepts with a Constrained Variational FrameworkLearning IndependentFeatures with…Learning Independent Features with Adversarial Nets for Non-linear ICAWasserstein GenerativeAdversarial NetworksWasserstein Generative Adversarial NetworksA Framework for theQuantitative Evaluation…A Framework for the Quantitative Evaluation of Disentangled RepresentationsDistribution Matching inVariational InferenceDistribution Matching in Variational InferenceRelevance Factor VAE:Learning and Identifyin…Relevance Factor VAE: Learning and Identifying Disentangled FactorsMulti-ObjectRepresentation Learning…Multi-Object Representation Learning with Iterative Variational InferenceHierarchicalDisentanglement of…Hierarchical Disentanglement of Discriminative Latent Features for Zero-Shot LearningWeakly SupervisedDisentanglement with…Weakly Supervised Disentanglement with GuaranteesOOGAN: Disentangling GANwith One-Hot Sampling…OOGAN: Disentangling GAN with One-Hot Sampling and Orthogonal RegularizationVariational Autoencodersand Nonlinear ICA: A…Variational Autoencoders and Nonlinear ICA: A Unifying FrameworkIndependent SubspaceAnalysis for…Independent Subspace Analysis for Unsupervised Learning of Disentangled RepresentationsIndependence PromotedGraph Disentangled…Independence Promoted Graph Disentangled NetworksLifelong Teacher-StudentNetwork LearningLifelong Teacher-Student Network LearningCommutative Lie GroupVAE for Disentanglement…Commutative Lie Group VAE for Disentanglement LearningGroupifyVAE: fromGroup-based Definition…GroupifyVAE: from Group-based Definition to VAE-based Unsupervised Representation DisentanglementInterpretable MachineLearning: Fundamental…Interpretable Machine Learning: Fundamental Principles and 10 Grand ChallengesDisentangling byFactorisingDisentangling by FactorisingEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.