Точность сегментации

For languages without word boundary delimiters, dictionaries are needed for segmenting running texts. This figure makes segmentation accuracy depend significantly on the quality of the dictionary used for analysis. If …...

In this paper we introduce a dynamic programming algorithm to perform lin- ear text segmentation by global mini- mization of a segmentation cost function which consists of: (a) within-segment word …...

During the process of unknown word detection in Chinese word segmentation, many detected word candidates are invalid. These false unknown word candidates deteriorate the overall segmentation accuracy, as it will …...

In this paper, we propose a novel Rhetorical Structure Index (RSI) to measure the struc- tural importance of a word or a phrase. Un- like TF-IDF and other content-driven mea- …...

AbstractWe investigate an automatic dialogue segmentation method using both verbal and non-verbal modalities. Dialogue contents are used for the initial segmentation of dialogue; then, gesture occurrences are used to remove …...

Stress is a useful cue for English word segmentation. A wide range of computa- tional models have found that stress cues enable a 2-10% improvement in segmen- tation accuracy, depending …...

We propose a transition-based model for joint word segmentation, POS tagging and text normalization. Different from pre- vious methods, the model can be trained on standard text corpora, overcoming the …...

AbstractIn American Sign Language (ASL) as well as other signed languages, different classes of signs (e.g., lexical signs, fingerspelled signs, and classifier constructions) have different internal structural properties. Continuous sign …...