metric ID: cohenskappa

Related Papers

Using a Word-Space Model to Determine the Relevance of Messages in Anchored Asynchronous Online Discussions

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

. This paper presents results of the first phase of our study aimed at investigating the applicability of word-space models, particularly those generated using Random Indexing (RI) technique, for the …...

18656

Partial Parsing as a Method to Expedite Dependency Annotation of a Hindi Treebank

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractThe paper describes an approach to expedite the process of manual annotation of a Hindi dependency treebank which is currently under development. We propose a way by which consistency among …...

7814

Weighted Krippendorff’s alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

The question of data reliability is of first im- portance to assess the quality of manually an- notated corpora. Although Cohen’s κ is the prevailing reliability measure used in NLP, …...

43486

An Automatic Prosody Tagger for Spontaneous Speech

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractSpeech prosody is known to be central in advanced communication technologies. However, despite the advances of theoretical studies in speech prosody, so far, no large scale prosody annotated resources that …...

4577

Beyond Possession Existence: Duration and Co-Possession

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThis paper introduces two tasks: determining (a) the duration of possession relations and (b) co-possessions, i.e., whether multiple possessors possess a possessee at the same time. We present new annotations …...

37234

Aligning the Romanian Reference Treebank and the Valence Lexicon of Romanian Verbs

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe present here the efforts of aligning two language resources for Romanian: the Romanian Reference Treebank and the Valence Lexicon of Romanian Verbs: for each occurrence of those verbs in …...

14352

Automating Idea Unit Segmentation and Alignment for Assessing Reading Comprehension via Summary Protocol Analysis

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn this paper, we approach summary evaluation from an applied linguistics (AL) point of view. We provide computational tools to AL researchers to simplify the process of Idea Unit (IU) …...

14857

Czech Dataset for Cross-lingual Subjectivity Classification

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn this paper, we introduce a new Czech subjectivity dataset of 10k manually annotated subjective and objective sentences from movie reviews and descriptions. Our prime motivation is to provide a …...

16154