Стемминг
Related Papers
Deep Read: A Reading Comprehension System
This paper describes initial work on Deep Read, an automated reading comprehension system that accepts arbitrary text input (a story) and answers questions about it. We have acquired a corpus …...
This Phrase-Based SMT System is Out of Order: Generalised Word Reordering in Machine Translation
Many natural language processes have some degree of preprocessing of data: tokenisation, stemming and so on. In the domain of Statisti- cal Machine Translation it has been shown that word …...
A Discriminative Candidate Generator for String Transformations
String transformation, which maps a source string s into its desirable form t∗, is related to various applications including stemming, lemmatization, and spelling correction. The essential and important step for …...
String Distance-Based Stemming of the Highly Inflected Croatian Language
Stemming refers to the grouping of morphologi- cally related words into so-called stem classes for the purpose of improving information retrieval performance. Traditional approaches to stem- ming are language-specific and …...
Developing Morphological Analysers for South Asian Languages: Experimenting with the Hindi and Gujarati Languages
AbstractA considerable amount of work has been put into development of stemmers and morphological analysers. The majority of these approaches use hand-crafted suffix-replacement rules but a few try to discover …...
The Effect of Automatic Tokenization, Vocalization, Stemming, and POS Tagging on Arabic Dependency Parsing
We use an automatic pipeline of word tokenization, stemming, POS tagging, and vocalization to perform real-world Arabic dependency parsing. In spite of the high accuracy on the modules, the very …...
A Light Weight Stemmer in Kokborok
Started from the very beginning, Stemming has been playing significant roles in several Natural Language Processing Applications such as information retrieval (IR), machine translation (MT), morph analysis and deciding the …...
A set of open source tools for Turkish natural language processing
AbstractThis paper introduces a set of freely available, open-source tools for Turkish that are built around TRmorph, a morphological analyzer introduced earlier in Coltekin (2010). The article first provides an …...
Labeled Morphological Segmentation with Semi-Markov Models
We present labeled morphological segmentation—an alternative view of morphological processing that unifies sev- eral tasks. We introduce a new hierarchy of morphotactic tagsets and CHIPMUNK, a discriminative morphological segmen- tation …...
Stripping Adjectives: Integration Techniques for Selective Stemming in SMT Systems
In this paper we present an approach to re- duce data sparsity problems when translat- ing from morphologically rich languages into less inflected languages by selectively stemming certain word types. …...
Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization
AbstractPreprocessing is a preliminary step in many fields including IR and NLP. The effect of basic preprocessing settings on English for text summarization is well-studied. However, there is no such …...
Leveraging Inflection Tables for Stemming and Lemmatization.
We present several methods for stemming and lemmatization based on discrimina- tive string transduction. We exploit the paradigmatic regularity of semi-structured inflection tables to identify stems in an un- supervised …...
Urdu Summary Corpus
AbstractLanguage resources, such as corpora, are important for various natural language processing tasks. Urdu has millions of speakers around the world but it is under-resourced in terms of standard evaluation …...
Build Fast and Accurate Lemmatization for Arabic
In this paper we describe the complexity of building a lemmatizer for Arabic which has a rich and complex morphology, and show some differences between lemmatization and surface stemming, i.e. …...
Parsivar: A Language Processing Toolkit for Persian
With the growth of Internet usage, a massive amount of textual data is generated on social media and the Web. As the text on the Web are generated by different …...
Aspect-based Sentiment Analysis on Indonesia’s Tourism Destinations Based on Google Maps User Code-Mixed Reviews (Study Case: Borobudur and Prambanan Temples)
In this paper, we conducted an aspect-based sentiment analysis using Google Maps user reviews of Indonesia’s tourism destinations which are Borobudur and Prambanan Temple. The aspects we used are Attractions, …...
Impact of Distance Measures on Urdu Document Clustering
Document Clustering aims to group similar documents based on the distance among them. A wide range of distance measures are available in the literature, and selecting an appropriate distance function …...
Systematic TextRank Optimization in Extractive Summarization
AbstractWith the ever-growing amount of textual data, extractive summarization has become increasingly crucial for efficiently processing information. The TextRank algorithm, a popular unsupervised method, offers excellent potential for this task. …...