Stopwords
Related Papers
Lexicon Effects on Chinese Information Retrieval
We investigate the effects of lexicon size and stopwords on Chinese information retrieval using our method of short-word segmentation based on simple language usage rules and statistics. These rules allow …...
Term Weighting Schemes for Latent Dirichlet Allocation
Many implementations of Latent Dirichlet Al- location (LDA), including those described in Blei et al. (2003), rely at some point on the removal of stopwords, words which are as- sumed …...
Detecting and Reducing Bias in a High Stakes Domain
AbstractGang-involved youth in cities such as Chicago sometimes post on social media to express their aggression towards rival gangs and previous research has demonstrated that a deep learning approach can …...
DUTH at SemEval-2019 Task 8: Part-Of-Speech Features for Question Classification
AbstractThis report describes the methods employed by the Democritus University of Thrace (DUTH) team for participating in SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums. Our team dealt …...
KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi
AbstractRecent progress in text classification has been focused on high-resource languages such as English and Chinese. For low-resource languages, amongst them most African languages, the lack of well-annotated data and …...
PyCantonese: Cantonese Linguistics and NLP in Python
AbstractThis paper introduces PyCantonese, an open-source Python library for Cantonese linguistics and natural language processing. After the library design, implementation, corpus data format, and key datasets included are introduced, the …...