Морфологиялық талдау

This paper presents a disambiguation approach for translating non-segmented-Kana into Kanji. The method consists of two steps. In the first step, an input sentence is analyzed morphologically and ambiguous morphemes …...

A central problem in speech synthesis with unre- stricted vocabulary is the automatic derivation of correct pronunciation from the graphemic form of a text. The software module GRAPHON was developed …...

This paper presents a new, language independent model for analysis and generation of word forms based on Finite State Transducers (FSTs). It has been completely implemented on a PC and …...

: The paper presents an integrated environment for morphological analysis of word-forms of the Slovene language. The system consists of a lexicon input and maintenance module, a lexicon output module …...

Most of tile research on parsing natnral [allguages has beetl concerned with I",nglish, or wil, h other languages nlOrl)hologically similar Io English. Parsing agglntinat.ive word st, ructures ha.s altracted relatively …...

• This paper introduces a spelling correction system which integrates seamlessly with morphological analysis using a multi-tape formalism. Handling of various Semitic er- ror problems is illustrated, with reference to …...

This paper describes a large-scale sys- tem that performs morphological anal- ysis and generation of on-line Arabic words represented in the standard or- thography, whether fully voweled, par- tially voweled …...

The paper describes problems in dis- ambiguating the morphological analysis of Bantu languages by using Swahili as a test language. The main factors of ambiguity in this language group can …...

A layered approach to information retrieval permits the inclusion of multiple search en- gines as well as nmltiple databases, with a natural language layer to convert English queries for use …...

A layered approach to information retrieval permits the inclusion of multiple search en- gines as well as multiple databases, with a natural language layer to convert English queries for use …...

This paper presents a technique to deal with multiword nominal terminology in a compu- tational Lexical Functional Grammar. This method treats multiword terms as single to- kens by modifying the …...

For languages whose character set is very large and whose orthography does not require spac- ing between words, such as Japanese, tokenizing and part-of-speech tagging are often the diffi- cult …...

AbstractThe paper describes an approach to developing an interactive MT system for translating technical texts on the example of translating patent claims between Russian and English. The approach conforms to …...

We present a general architecture for efficient and deterministic morphological analysis based on memory-based learning, and apply it to morphological analysis of Dutch. The system makes direct mappings from letters …...

Agglutinative languages present rich morphology and for some applications they need deep analysis at word level. The work here presented proposes a model for designing a full morpho- logical analyzer. …...

This paper proposes a framework of language inde- pendent morphological analysis and mainly concen- trate on tokenization, the first process of morpholog- ical analysis. Although tokenization is usually not regarded …...

AbstractMachine Translation (MT) systems that process unrestricted text should be able to deal with words that are not found in the MT lexicon. Without some kind of recognition, the parse …...

This paper presents a revision learn- ing method that achieves high per- formance with small computational cost by combining a model with high generalization capacity and a model with small …...

This paper presents a Chinese word segmen- tation system that uses improved source- channel models of Chinese sentence genera- tion. Chinese words are defined as one of the following four …...

Named Entity (NE) extraction is an important subtask of document processing such as in- formation extraction and question answering. A typical method used for NE extraction of Japanese texts is …...

In this paper, we describe a resource-light system for the automatic morphological analysis and tag- ging of Russian. We eschew the use of extensive resources (particularly, large annotated corpora and …...

Automatic word segmentation is a basic re- quirement for unsupervised learning in morpho- logical analysis. In this paper, we formulate a novel recursive method for minimum descrip- tion length (MDL) …...

The morphology of Semitic languages is unique in the sense that the major word-formation mechanism is an inherently non-concatenative process of inter- digitation, whereby two morphemes, a root and a …...

In statistical machine translation, estimat- ing word-to-word alignment probabilities for the translation model can be difficult due to the problem of sparse data: most words in a given corpus occur …...

. Morphological analysis in the current methods, such as finite-state and unification-based, are predominantly effective for handling concatenative morphology (e.g. prefixation and suffixation), although some of these techniques can also …...

. We present an analogical learning model which exploits the notion of formal analogi- cal proportions; this approach requires the ability to define these proportions and to implement them efficiently. …...

. This paper expounds an algorithm for morphological analysis of English language. The algorithm consists of two closely related components: morphological rule learning and morphological analyzing. The morphological rules are …...

Morphological analysis and disambiguation are crucial stages in a variety of natural language processing applications, especially when languages with complex morphology are concerned. We present a system which disambiguates the …...

Morphological analysis is often used during preprocessing in Statistical Machine Trans- lation. Existing work suggests that the bene- fit would be greater for more highly inflected languages, although to our …...

AbstractThis paper describes the University of Maryland statistical machine translation system used in the IWSLT 2007 evaluation. Our focus was threefold: using hierarchical phrase-based models in spoken language translation, the …...

Segmentation is widely used in adapting Statistical Machine Translation to highly inflected languages as Basque. The way this segmentation is carried out impacts on the quality of the translation. In …...

AbstractThis paper describes a method based on morphological analysis of words for a Persian Part-Of-Speech (POS) tagging system. This is a main part of a process for expanding a large …...

AbstractA considerable amount of work has been put into development of stemmers and morphological analysers. The majority of these approaches use hand-crafted suffix-replacement rules but a few try to discover …...

We present a novel Evaluation Metric for Morphological Analysis (EMMA) that is both linguistically appealing and empirically sound. EMMA uses a graph- based assignment algorithm, optimized via integer linear programming, …...

AbstractMany NLP applications need fundamental tools to convert the input text into appropriate form or format and extract the primary linguistic knowledge of words and sentences. These tools perform segmentation …...

AbstractThe Quranic Arabic Dependency Treebank (QADT) is part of the Quranic Arabic Corpus (http://corpus.quran.com), an online linguistic resource organized by the University of Leeds, and developed through online collaborative annotation. …...

We present a novel scheme to apply fac- tored phrase-based SMT to a language pair with very disparate morphological struc- tures. Our approach relies on syntac- tic analysis on the …...

AbstractIn this paper, we introduce the Lefff, a freely available, accurate and large-coverage morphological and syntactic lexicon for French, used in many NLP tools such as large-coverage parsers. We first …...

AbstractThis paper describes the Spanish Resource Grammar, an open-source multi-purpose broad-coverage precise grammar for Spanish. The grammar is implemented on the Linguistic Knowledge Builder (LKB) system, it is grounded in …...

Zulu is an indigenous language of South Africa, and one of the eleven official languages of that country. It is spoken by about 11 million speakers. Although it is similar …...

In the biomedical domain, many terms are neoclassical compounds (composed of several Greek or Latin roots). The study of their morphology is important for numer- ous applications since it makes …...

AbstractArabic is a morphologically rich language, and Arabic texts abound of complex word forms built by concatenation of multiple subparts, corresponding for instance to prepositions, articles, roots prefixes, or suffixes. …...

AbstractWe present a novel tool for morphological analysis of Serbian, which is a low-resource language with rich morphology. Our tool produces lemmatisation and morphological analysis reaching accuracy that is considerably …...

AbstractThis paper presents a linguistic processing pipeline for Bulgarian including morphological analysis, lemmatization and syntactic analysis of Bulgarian texts. The morphological analysis is performed by three modules ― two statistical-based …...

In statistical machine translation, word lattices are used to represent the ambiguities in the preprocessing of the source sentence, such as word segmentation for Chinese or morpholog- ical analysis for …...

In the biomedical field, the key to access information is the use of specialized terms. However, in most of Indo-European languages, these terms are complex morphological structures. The aim of …...

Newspapers remain an important media from which people obtain a wide variety of information. In Japan, there are five major newspapers, having their own opinions and ideologies. Although these are …...

Modern Standard Arabic (MSA) has a wealth of natural language processing (NLP) tools and resources. In comparison, resources for dialectal Arabic (DA), the unstandardized spo- ken varieties of Arabic, are …...

Hungarian is the stereotype of morpholog- ically rich and free word order languages. Here, we introduce magyarlanc, a nat- ural language toolkit developed for the linguistic preprocessing – segmentation, morphological …...

. Analysing lexical complexity is a task that has mainly attracted the attention of psycholinguists and language teachers. More recently, this issue has seen a growing interest in the field …...

In this study, we analyzed the effects of ap- plying different levels of stemming approaches such as fixed-length word truncation and mor- phological analysis for multi-document sum- marization (MDS) on …...

AbstractThe world-wide proliferation of digital communications has created the need for language and speech processing systems for under-resourced languages. Developing such systems is challenging if only small data sets are …...

AbstractIn the present paper, we describe the development of the lexical network DeriNet, which captures core word-formation relations on the set of around 266 thousand Czech lexemes. The network is …...

AbstractMost state-of-the-art systems today produce morphological analysis based only on orthographic patterns. In contrast, we propose a model for unsupervised morphological analysis that integrates orthographic and semantic views of words. …...

We present a new morphological analy- sis model that considers semantic plausi- bility of word sequences by using a re- current neural network language model (RNNLM). In unsegmented languages, since …...

AbstractMorphological analysis is a fundamental task in natural-language processing, which is used in other NLP applications such as part-of-speech tagging, syntactic parsing, information retrieval, machine translation, etc. In this paper, …...

. The medical area conveys very specific terms (p. ex., blepharospasm, appendicec- tomy), which are difficult to understand by people without medical training. We propose an au- tomatic method for …...

AbstractThe CELEX database is one of the standard lexical resources for German. It yields a wealth of data especially for phonological and morphological applications. The morphological part comprises deep-structure morphological …...

AbstractStructured, complete inflectional paradigm data exists for very few of the world’s languages, but is crucial to training morphological analysis tools. We present methods inspired by linguistic fieldwork for gathering …...

AbstractAutomatic natural language processing of large texts often presents recurring challenges in multiple languages: even for most advanced tasks, the texts are first processed by basic processing steps – from …...

AbstractLanguage resources, such as corpora, are important for various natural language processing tasks. Urdu has millions of speakers around the world but it is under-resourced in terms of standard evaluation …...

AbstractWeighted finite automata and transducers (including hidden Markov models and conditional random fields) are widely used in natural language processing (NLP) to perform tasks such as morphological analysis, part-of-speech tagging, …...

AbstractA major motivation for unsupervised morphological analysis is to reduce the sparse data problem in under-resourced languages. Most previous work focus on segmenting surface forms into their constituent morphs (taking: …...

AbstractWe introduce a language-independent, graph-based probabilistic model of morphology, which uses transformation rules operating on whole words instead of the traditional morphological segmentation. The morphological analysis of a set of …...

Following the development of the universal dependencies (UD) framework and the CoNLL 2017 Shared Task on end-to-end UD parsing, we address the need for a universal representation of morphological analysis …...

Lack of parallel training data influences the rare word problem in Neural Machine Translation (NMT) systems, particularly for under- resourced languages. Using synthetic parallel training data (data augmentation) is a …...

This paper presents initial experiments in data-driven morphological analy- sis for Finnish using deep learning methods. Our system uses a character based bidirectional LSTM and pretrained word embeddings to predict …...

Tokenization, or morphological analysis, is a fundamental and important technology for processing a Japanese text, especially for in- dustrial applications. However, we often face many obstacles, such as the inconsistency …...

This article presents a different method for creation of error annotated corpora. The approach suggested in this paper consists of multiple parts - text correction, automated morphological analysis, automated text …...

AbstractWe present the first challenge set and evaluation protocol for the analysis of gender bias in machine translation (MT). Our approach uses two recent coreference resolution datasets composed of English …...

AbstractA large percentage of computational tools are concentrated in a very small subset of the planet’s languages. Compounding the issue, many languages lack the high-quality linguistic annotation necessary for the …...

AbstractFor languages without natural word boundaries, like Japanese and Chinese, word segmentation is a prerequisite for downstream analysis. For Japanese, segmentation is often done jointly with part of speech tagging, …...

AbstractShort-text classification is a challenging task, due to the sparsity and high dimensionality of the feature space. In this study, we aim to analyze and classify Turkish tweets based on …...

AbstractIt has been widely admitted that morphological analysis is an important step in automated text processing for morphologically rich languages. Evenki is a language with rich morphology, therefore a morphological …...

AbstractMorphological analysis is one of the tasks that have been studied for years. Different techniques have been used to develop models for performing morphological analysis. Models based on finite state …...

AbstractThe goal of the EstNLTK Python library is to provide a unified programming interface for natural language processing in Estonian. As such, previous versions of the library have been immensely …...

AbstractText classification tends to be difficult when data are inadequate considering the amount of manually labeled text corpora. For low-resource agglutinative languages including Uyghur, Kazakh, and Kyrgyz (UKK languages), in …...

AbstractThis paper describes a language-independent model for fully unsupervised morphological analysis that exploits a universal framework leveraging morphological typology. By modeling morphological processes including suffixation, prefixation, infixation, and full and …...

AbstractThis paper studies strategies to model word formation in NMT using rich linguistic information, namely a word segmentation approach that goes beyond splitting into substrings by considering fusional morphology. Our …...

AbstractIn this paper we present the first full morphological analysis and disambiguation system for Gulf Arabic. We use an existing state-of-the-art morphological disambiguation system to investigate the effects of different …...

AbstractMorphological analysis and disambiguation is an important task and a crucial preprocessing step in natural language processing of morphologically rich languages. Kinyarwanda, a morphologically rich language, currently lacks tools for …...

The issue of preservation and revitalization of the indigenous languages is gaining attention from the public in recent days. Developing NLP techniques related to the indigenous languages will help to …...

AbstractMorphological analysis (MA) and lexical normalization (LN) are both important tasks for Japanese user-generated text (UGT). To evaluate and compare different MA/LN systems, we have constructed a publicly available Japanese …...

AbstractWe present the Hebrew Essay Corpus: an annotated corpus of Hebrew language argumentative essays authored by prospective higher-education students. The corpus includes both essays by native speakers, written as part …...