method ID: unigram

Related Papers

Fertility Models for Statistical Natural Language Understanding

Authors: nan

Publication: TIPSTER (1997)

DOI: nan

Several recent efforts in statistical nat- ural language understanding (NLU) have focused on generating clumps of English words from semantic meaning concepts (Miller et al., 1995; Levin and Pierac- cini, …...

43891

Probabilistic and Rule-Based Tagger of an Inflective Language- a Comparison

Authors: nan

Publication: TIPSTER (1997)

DOI: nan

We present results of probabilistic tag- ging of Czech texts in order to show how these techniques work for one of the highly morphologically ambiguous inflective lan- guages. After description …...

41521

Improving Tokenisation by Alternative Treatment of Spaces

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

Tokenisation is the first step in almost all NLP tasks, and state-of-the-art transformer-based language models all use subword tokenisation algorithms to process input text. Existing al- gorithms have problems, often …...

29905