Текстовые корпуса

Text corpora which are tagged with part-of-speech in- formation are useful in many areas of linguistic re- search. In this paper, a new part-of-speech tagging method hased on neural networks …...

This paper proposes a new unsupervised learning method for obtaining English part-of- speech(POS) disambiguation rules which would improve the accuracy of a POS tagger. This method has been implemented in …...

We present an unsupervised learning al- gorithm that mines large text corpora for patterns that express implicit semantic re- lations. For a given input word pair X :Y with some …...

In this paper, we study the problem of auto- matically segmenting written text into para- graphs. This is inherently a sequence label- ing problem, however, previous approaches ignore this dependency. …...

Collocations constitute a subclass of multi-word expressions that are particu- larly problematic for machine translation, due 1) to their omnipresence in texts, and 2) to their morpho-syntactic proper- ties, allowing …...

Multi-word expressions constitute a sig- nificant portion of the lexicon of every natural language, and handling them cor- rectly is mandatory for various NLP appli- cations. Yet such entities are …...

We introduce a novel approach for build- ing language models based on a system- atic, recursive exploration of skip n-gram models which are interpolated using modi- fied Kneser-Ney smoothing. Our …...

This paper presents predicate-argument structure analysis (PASA) for dialogue systems in Japanese. Conventional PASA and semantic role labeling have been applied to newspaper arti- cles. Because pronominalization and ellipses frequently …...

AbstractThis paper will focus on the evaluation of automatic methods for quantifying language similarity. This is achieved by ascribing language similarity to the similarity of text corpora. This corpus similarity …...

An extensive literature in computational social science examines how features of messages, advertisements, and other cor- pora affect individuals’ decisions, but these analyses must specify the relevant features of the …...

AbstractProbabilistic models are a useful means for analyzing large text corpora. Integrating such models with human interaction enables many new use cases. However, adding human interaction to probabilistic models requires …...

AbstractMost distributional lexico-semantic models derive their representations based on external language resources such as text corpora. In this study, we propose that internal language models, that are more closely aligned …...

AbstractThe Low Resource Language research conducted under DARPA’s Broad Operational Language Translation (BOLT) program required the rapid creation of text corpora of typologically diverse languages (Turkish, Hausa, and Uzbek) which …...

AbstractA taxonomy is a semantic hierarchy, consisting of concepts linked by is-a relations. While a large number of taxonomies have been constructed from human-compiled resources (e.g., Wikipedia), learning taxonomies from …...

AbstractSemantic parsers critically rely on accurate and high-coverage lexicons. However, traditional semantic parsers usually utilize annotated logical forms to learn the lexicon, which often suffer from the lexicon coverage problem. …...

AbstractSEBAMAT (semantics-based MT) is a Marie Curie project intended to con-tribute to the state of the art in machine translation (MT). Current MT systems typically take the semantics of a …...

AbstractLanguage understanding research is held back by a failure to relate language to the physical world it describes and to the social interactions it facilitates. Despite the incredible effectiveness of …...

AbstractAdvances in language modeling architectures and the availability of large text corpora have driven progress in automatic text generation. While this results in models capable of generating coherent texts, it …...

AbstractText corpora annotated with language-related properties are an important resource for the development of Language Technology. The current work contributes a new resource for Chinese Language Technology and for Chinese-English …...