Ұзақ диапазонды тәуелділіктер
Related Papers
Parsing with Generative Models of Predicate-Argument Structure
The model used by the CCG parser of Hockenmaier and Steedman (2002b) would fail to capture the correct bilexical dependencies in a language with freer word order, such as Dutch. …...
A Discriminative Latent Variable Chinese Segmenter with Hybrid Word/Character Information
Conventional approaches to Chinese word segmentation treat the problem as a character- based tagging task. Recently, semi-Markov models have been applied to the problem, in- corporating features based on complete …...
Long-Short Range Context Neural Networks for Language Modeling
The goal of language modeling techniques is to capture the statistical and structural prop- erties of natural languages from training cor- pora. This task typically involves the learning of short …...
Interpolated Spectral NGram Language Models
AbstractSpectral models for learning weighted non-deterministic automata have nice theoretical and algorithmic properties. Despite this, it has been challenging to obtain competitive results in language modeling tasks, for two main …...
Multimodal Transformer for Unaligned Multimodal Language Sequences
AbstractHuman language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: …...
On the Linguistic Representational Power of Neural Machine Translation Models
AbstractDespite the recent success of deep neural networks in natural language processing and other spheres of artificial intelligence, their interpretability remains a challenge. We analyze the representations learned by neural …...
Revisiting Higher-Order Dependency Parsers
AbstractNeural encoders have allowed dependency parsers to shift from higher-order structured models to simpler first-order ones, making decoding faster and still achieving better accuracy than non-neural parsers. This has led …...
Learning Logic Rules for Document-Level Relation Extraction
AbstractDocument-level relation extraction aims to identify relations between entities in a whole document. Prior efforts to capture long-range dependencies have relied heavily on implicitly powerful representations learned through (graph) neural …...