method ID: stemming

Related Papers

Deep Read: A Reading Comprehension System

Authors: nan

Publication: TIPSTER (1999)

DOI: nan

This paper describes initial work on Deep Read, an automated reading comprehension system that accepts arbitrary text input (a story) and answers questions about it. We have acquired a corpus …...

35084

This Phrase-Based SMT System is Out of Order: Generalised Word Reordering in Machine Translation

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

Many natural language processes have some degree of preprocessing of data: tokenisation, stemming and so on. In the domain of Statisti- cal Machine Translation it has been shown that word …...

28719

A Discriminative Candidate Generator for String Transformations

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

String transformation, which maps a source string s into its desirable form t∗, is related to various applications including stemming, lemmatization, and spelling correction. The essential and important step for …...

44876

String Distance-Based Stemming of the Highly Inflected Croatian Language

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

Stemming refers to the grouping of morphologi- cally related words into so-called stem classes for the purpose of improving information retrieval performance. Traditional approaches to stem- ming are language-specific and …...

29450

Developing Morphological Analysers for South Asian Languages: Experimenting with the Hindi and Gujarati Languages

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractA considerable amount of work has been put into development of stemmers and morphological analysers. The majority of these approaches use hand-crafted suffix-replacement rules but a few try to discover …...

7903

The Effect of Automatic Tokenization, Vocalization, Stemming, and POS Tagging on Arabic Dependency Parsing

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

We use an automatic pipeline of word tokenization, stemming, POS tagging, and vocalization to perform real-world Arabic dependency parsing. In spite of the high accuracy on the modules, the very …...

42295

A Light Weight Stemmer in Kokborok

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

Started from the very beginning, Stemming has been playing significant roles in several Natural Language Processing Applications such as information retrieval (IR), machine translation (MT), morph analysis and deciding the …...

1267

A set of open source tools for Turkish natural language processing

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

AbstractThis paper introduces a set of freely available, open-source tools for Turkish that are built around TRmorph, a morphological analyzer introduced earlier in Coltekin (2010). The article first provides an …...

16571

Labeled Morphological Segmentation with Semi-Markov Models

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

We present labeled morphological segmentation—an alternative view of morphological processing that unifies sev- eral tasks. We introduce a new hierarchy of morphotactic tagsets and CHIPMUNK, a discriminative morphological segmen- tation …...

42097

Stripping Adjectives: Integration Techniques for Selective Stemming in SMT Systems

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

In this paper we present an approach to re- duce data sparsity problems when translat- ing from morphologically rich languages into less inflected languages by selectively stemming certain word types. …...

3136

Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractPreprocessing is a preliminary step in many fields including IR and NLP. The effect of basic preprocessing settings on English for text summarization is well-studied. However, there is no such …...

15073

Leveraging Inflection Tables for Stemming and Lemmatization.

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

We present several methods for stemming and lemmatization based on discrimina- tive string transduction. We exploit the paradigmatic regularity of semi-structured inflection tables to identify stems in an un- supervised …...

40413

Urdu Summary Corpus

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractLanguage resources, such as corpora, are important for various natural language processing tasks. Urdu has millions of speakers around the world but it is under-resourced in terms of standard evaluation …...

16644

Build Fast and Accurate Lemmatization for Arabic

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

In this paper we describe the complexity of building a lemmatizer for Arabic which has a rich and complex morphology, and show some differences between lemmatization and surface stemming, i.e. …...

17843

Parsivar: A Language Processing Toolkit for Persian

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

With the growth of Internet usage, a massive amount of textual data is generated on social media and the Web. As the text on the Web are generated by different …...

17844

Aspect-based Sentiment Analysis on Indonesia’s Tourism Destinations Based on Google Maps User Code-Mixed Reviews (Study Case: Borobudur and Prambanan Temples)

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

In this paper, we conducted an aspect-based sentiment analysis using Google Maps user reviews of Indonesia’s tourism destinations which are Borobudur and Prambanan Temple. The aspects we used are Attractions, …...

18849

Impact of Distance Measures on Urdu Document Clustering

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

Document Clustering aims to group similar documents based on the distance among them. A wide range of distance measures are available in the literature, and selecting an appropriate distance function …...

28839

Systematic TextRank Optimization in Extractive Summarization

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWith the ever-growing amount of textual data, extractive summarization has become increasingly crucial for efficiently processing information. The TextRank algorithm, a popular unsupervised method, offers excellent potential for this task. …...

19887