Сегментация текста
Related Papers
Automatic Analysis of Descriptive Texts
This paper describes a system that attempts to interpret descriptive texts without the uJe of complex grammars. The purpose of the system is to transform the descriptions to a standard …...
Text Segmentation Using Reiteration and Collocation
A method is presented for segmenting text into subtopic areas. The proportion of related pairwise words is calculated between adjacent windows of text to determine their lexical similarity. The lexical …...
Thematic segmentation of texts: two methods for two kinds of texts
To segment texts in thematic units, we present here how a basic principle relying on word distribution can be applied on different kind of texts. We start from an existing …...
Textual Information Segmentation by Cohesive Ties
This paper proposes a novel approach in clustering texts automatically into coherent segments. A set of mutual linguistic constraints that largely determines the similarity of meaning among lexical items is …...
A Statistical Model for Domain-Independent Text Segmentation
We propose a statistical method that finds the maximum-probability seg- mentation of a given text. This method does not require training data because it estimates probabilities from the given text. …...
Linear Text Segmentation using a Dynamic Programming Algorithm
In this paper we introduce a dynamic programming algorithm to perform lin- ear text segmentation by global mini- mization of a segmentation cost function which consists of: (a) within-segment word …...
Improving Probabilistic Latent Semantic Analysis with Principal Component Analysis
Probabilistic Latent Semantic Analysis (PLSA) models have been shown to pro- vide a better model for capturing poly- semy and synonymy than Latent Seman- tic Analysis (LSA). However, the param- …...
Automatic Editing in a Back-End Speech-to-Text System
Written documents created through dictation differ significantly from a true verbatim tran- script of the recorded speech. This poses an obstacle in automatic dictation systems as speech recognition output needs …...
Using LDA to detect semantically incoherent documents
Detecting the semantic coherence of a doc- ument is a challenging task and has sev- eral applications such as in text segmenta- tion and categorization. This paper is an attempt …...
STeP-1: A Set of Fundamental Tools for Persian Text Processing
AbstractMany NLP applications need fundamental tools to convert the input text into appropriate form or format and extract the primary linguistic knowledge of words and sentences. These tools perform segmentation …...
Inforex – a web-based tool for text corpus management and semantic annotation
AbstractThe aim of this paper is to present a system for semantic text annotation called Inforex. Inforex is a web-based system designed for managing and annotating text corpora on the …...
Automatic News Source Detection in Twitter Based on Text Segmentation
In this paper, we discuss news source detec- tion (NSD), which involves finding additional information of a message generated in so- cial media to understand the original message more deeply. …...
Disunity in Cohesion: How Purpose Affects Methods and Results When AnalyzingLexical Cohesion
Lexical Cohesion is a commonly studied lin- guistic feature as it is easily identified from the surface of a text. However, the purposes for studying lexical cohesion are varied, and …...
Using Text Segmentation Algorithms for the Automatic Generation of E-Learning Courses
With the advent of e-learning, there is a strong demand for tools that help to cre- ate e-learning courses in an automatic or semi-automatic way. While resources for new courses …...
An Annotated Corpus and Method for Analysis of Ad-Hoc Structures Embedded in Text
AbstractWe describe a method for identifying and performing functional analysis of structured regions that are embedded in natural language documents, such as tables or key-value lists. Such regions often encode …...
Unsupervised Text Segmentation Using Semantic Relatedness Graphs
Segmenting text into semantically coher- ent fragments improves readability of text and facilitates tasks like text summariza- tion and passage retrieval. In this pa- per, we present a novel unsupervised …...
A Joint Model for Document Segmentation and Segment Labeling
AbstractText segmentation aims to uncover latent structure by dividing text from a document into coherent sections. Where previous work on text segmentation considers the tasks of document segmentation and segment …...
Books of Hours. the First Liturgical Data Set for Text Segmentation.
AbstractThe Book of Hours was the bestseller of the late Middle Ages and Renaissance. It is a historical invaluable treasure, documenting the devotional practices of Christians in the late Middle …...
Neural Sequence Segmentation as Determining the Leftmost Segments
AbstractPrior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we …...
An Alignment-based Approach to Text Segmentation Similarity Scoring
AbstractText segmentation is a natural language processing task with popular applications, such as topic segmentation, element discourse extraction, and sentence tokenization. Much work has been done to develop accurate segmentation …...
Toward Unifying Text Segmentation and Long Document Summarization
AbstractText segmentation is important for signaling a document’s structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend the text, let alone find …...
Curricular Next Conversation Prediction Pretraining for Transcript Segmentation
AbstractTranscript segmentation is the task of dividing a single continuous transcript into multiple segments. While document segmentation is a popular task, transcript segmentation has significant challenges due to the relatively …...