Hyperbolic Entailment Cones for Learning Hierarchical Embeddings

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior work, we first advocate for using hyperbolic spaces which provably model tree-like structures better than Euclidean geometry. Second, we view hierarchical relations as partial orders defined using a family of nested geodesically convex cones. We prove that these entailment cones admit an optimal shape with a closed form expression both in the Euclidean and hyperbolic spaces, and they canonically define the embedding learning process. Experiments show significant improvements of our method over strong recent baselines both in terms of representational capacity and generalization.

A ComprehensiveIntroduction to…A Comprehensive Introduction to Differential Geometry.Introduction to WordNet:An On-line Lexical…Introduction to WordNet: An On-line Lexical Database*Hyperbolic GeometryHyperbolic GeometryHyperbolic Embedding andRouting for Dynamic…Hyperbolic Embedding and Routing for Dynamic GraphsHyperbolic Geometry ofComplex NetworksHyperbolic Geometry of Complex NetworksLow Distortion DelaunayEmbedding of Trees in…Low Distortion Delaunay Embedding of Trees in Hyperbolic PlaneDistributedRepresentations of Word…Distributed Representations of Words and Phrases and their CompositionalityGlove: Global Vectorsfor Word RepresentationGlove: Global Vectors for Word RepresentationTranslating embeddingsfor modeling…Translating embeddings for modeling multi-relational dataGeometric Deep Learning:Going beyond Euclidean…Geometric Deep Learning: Going beyond Euclidean dataRepresentation Tradeoffsfor Hyperbolic…Representation Tradeoffs for Hyperbolic Embeddings.Representation Tradeoffsfor Hyperbolic…Representation Tradeoffs for Hyperbolic EmbeddingsLearning ContinuousHierarchies in the…Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic GeometryHyperbolic NeuralNetworksHyperbolic Neural NetworksRepresentation Tradeoffsfor Hyperbolic…Representation Tradeoffs for Hyperbolic EmbeddingsScalable HyperbolicRecommender SystemsScalable Hyperbolic Recommender SystemsInferring ConceptHierarchies from Text…Inferring Concept Hierarchies from Text Corpora via Hyperbolic EmbeddingsHyperbolic HeterogeneousInformation Network…Hyperbolic Heterogeneous Information Network EmbeddingHyperbolic DistanceMatricesHyperbolic Distance MatricesHyperbolic InteractionModel For Hierarchical…Hyperbolic Interaction Model For Hierarchical Multi-Label ClassificationHyperbolic GraphAttention NetworkHyperbolic Graph Attention NetworkLorentzian GraphConvolutional NetworksLorentzian Graph Convolutional NetworksEmbedding HeterogeneousNetworks into Hyperboli…Embedding Heterogeneous Networks into Hyperbolic Space Without Meta-pathMulti-modal EntityAlignment in Hyperbolic…Multi-modal Entity Alignment in Hyperbolic SpaceHyperbolic EntailmentCones for Learning…Hyperbolic Entailment Cones for Learning Hierarchical EmbeddingsEarlier referencesFocus paperCiting papersOlderNewer

Click a node to pin it, click the empty canvas to go back to this paper, or hover to preview. Open a node’s page from its title.