A Structural Probe for Finding Syntax in Word Representations

John Hewitt, Christopher D. Manning. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 2019.

Building a LargeAnnotated Corpus of…Building a Large Annotated Corpus of English: The Penn TreebankGenerating TypedDependency Parses from…Generating Typed Dependency Parses from Phrase Structure ParsesDistributedRepresentations of Word…Distributed Representations of Words and Phrases and their CompositionalityAssessing the Ability ofLSTMs to Learn…Assessing the Ability of LSTMs to Learn Syntax-Sensitive DependenciesAutomaticdifferentiation in…Automatic differentiation in PyTorchDyNet: The DynamicNeural Network ToolkitDyNet: The Dynamic Neural Network ToolkitDissecting ContextualWord Embeddings…Dissecting Contextual Word Embeddings: Architecture and RepresentationLSTMs Can LearnSyntax-Sensitive…LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them BetterModeling garden patheffects without explici…Modeling garden path effects without explicit hierarchical syntaxRNNs as psycholinguisticsubjects: Syntactic…RNNs as psycholinguistic subjects: Syntactic state and grammatical dependencyWhy Self-Attention? ATargeted Evaluation of…Why Self-Attention? A Targeted Evaluation of Neural Machine Translation ArchitecturesBERT: Pre-training ofDeep Bidirectional…BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingVisualizing andMeasuring the Geometry…Visualizing and Measuring the Geometry of BERTA Systematic Analysis ofMorphological Content i…A Systematic Analysis of Morphological Content in BERT Models for Multiple LanguagesInformation-TheoreticProbing for Linguistic…Information-Theoretic Probing for Linguistic StructureThe neural architectureof language: Integrativ…The neural architecture of language: Integrative modeling converges on predictive processingFinding UniversalGrammatical Relations i…Finding Universal Grammatical Relations in Multilingual BERTAssessing PhrasalRepresentation and…Assessing Phrasal Representation and Composition in TransformersConditional probing:measuring usable…Conditional probing: measuring usable information beyond a baselineWhen Do You NeedBillions of Words of…When Do You Need Billions of Words of Pretraining Data?Exploring the Role ofBERT Token…Exploring the Role of BERT Token Representations to Explain Sentence Probing ResultsHow much pretrainingdata do language models…How much pretraining data do language models need to learn syntax?Do Syntactic ProbesProbe Syntax?…Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky ProbingLinguisticInterpretability of…Linguistic Interpretability of Transformer-based Language Models: a systematic reviewA Structural Probe forFinding Syntax in Word…A Structural Probe for Finding Syntax in Word Representations過去の参考文献中心の論文この論文を引用する論文古い新しい

ノードをクリックするとフォーカスを固定、空白をクリックすると本論文に戻ります。ホバーで一時的にプレビューできます。各ノードのページはタイトルから開けます。