Большие корпуса
Related Papers
Inducing a Semantically Annotated Lexicon via EM-Based Clustering
We present a technique for automatic induction of slot annotations for subcategorization frames, based on induction of hidden classes in the EM framework of statistical estimation. The models are empirically …...
Using Machine Learning to Maintain Rule-based Named-Entity Recognition and Classification Systems
This paper presents a method that as- sists in maintaining a rule-based named-entity recognition and classifi- cation system. The underlying idea is to use a separate system, constructed with the …...
Multi-Engine Machine Translation with Voted Language Model
The paper describes a particular approach to multi- engine machine translation (MEMT), where we make use of voted language models to selectively combine translation outputs from multiple off-the- shelf MT …...
Learning the Structure of Task-Driven Human-Human Dialogs
Data-driven techniques have been used for many computational linguistics tasks. Models derived from data are generally more robust than hand-crafted systems since they better reflect the distribution of the phenomena …...
Scalable Language Processing Algorithms for the Masses: A Case Study in Computing Word Co-occurrence Matrices with MapReduce
This paper explores the challenge of scaling up language processing algorithms to increas- ingly large datasets. While cluster comput- ing has been available in commercial environ- ments for several years, …...
Fast Syntactic Searching in Very Large Corpora for Many Languages
. For many linguistic investigations, the first step is to find examples. In the 21st century, they should all be found, not invented. Thus linguists need flexible tools for finding …...
Large Scale Parallel Document Mining for Machine Translation
A distributed system is described that re- liably mines parallel text from large cor- pora. The approach can be regarded as cross-language near-duplicate detec- tion, enabled by an initial, low-quality …...
The Study of Writing Variants in an Under-resourced Language: Some Evidence from Mobile N-Deletion in Luxembourgish
AbstractThe national language of the Grand-Duchy of Luxembourg, Luxembourgish, has often been characterized as one of Europe's under-described and under-resourced languages. Because of a limited written production of Luxembourgish, poorly …...
Ambiguity Resolution for Vt-N Structures in Chinese
The syntactic ambiguity of a transitive verb (Vt) followed by a noun (N) has long been a problem in Chinese parsing. In this paper, we propose a classifier to resolve …...
Towards an environment for the production and the validation of lexical semantic resources
AbstractWe present the components of a processing chain for the creation, visualization, and validation of lexical resources (formed of terms and relations between terms). The core of the chain is …...
Assigning Fine-grained PoS Tags based on High-precision Coarse-grained Tagging
AbstractWe propose a new approach to PoS tagging where in a first step, we assign a coarse-grained tag corresponding to the main syntactic category. Based on this high-precision decision, in …...
WordRank: Learning Word Embeddings via Robust Ranking
Embedding words in a vector space has gained a lot of attention in recent years. While state- of-the-art methods provide efficient computa- tion of word similarities via a low-dimensional matrix …...
Multi-Reward based Reinforcement Learning for Neural Machine Translation
AbstractReinforcement learning (RL) has made remarkable progress in neural machine translation (NMT). However, it exists the problems with uneven sampling distribution, sparse rewards and high variance in training phase. Therefore, …...