metric ID: factuality

Related Papers

A New Dataset and Evaluation for Belief/Factuality

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

The terms “belief” and “factuality” both re- fer to the intention of the writer to present the propositional content of an utterance as firmly believed by the writer, not firmly …...

26151

GRaSP: A Multilayered Annotation Scheme for Perspectives

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractThis paper presents a framework and methodology for the annotation of perspectives in text. In the last decade, different aspects of linguistic encoding of perspectives have been targeted as separated …...

16469

How Decoding Strategies Affect the Verifiability of Generated Text

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractRecent progress in pre-trained language models led to systems that are able to generate text of an increasingly high quality. While several works have investigated the fluency and grammatical correctness …...

32456

What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractPredicting the political bias and the factuality of reporting of entire news outlets are critical elements of media profiling, which is an understudied but an increasingly important research direction. The …...

37837

A Survey on Multimodal Disinformation Detection

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecent years have witnessed the proliferation of offensive content online such as fake news, propaganda, misinformation, and disinformation. While initially this was mostly about textual content, over time images and …...

4654

ABNIRML: Analyzing the Behavior of Neural IR Models

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractPretrained contextualized language models such as BERT and T5 have established a new state-of-the-art for ad-hoc search. However, it is not yet well understood why these methods are so effective, …...

26773

FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe present FactPEGASUS, an abstractive summarization model that addresses the problem of factuality during pre-training and fine-tuning: (1) We augment the sentence selection strategy of PEGASUS’s (Zhang et al., 2019) …...

21406

Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractGenerating factual, long-form text such as Wikipedia articles raises three key challenges: how to gather relevant evidence, how to structure information into well-formed text, and how to ensure that the …...

37108

GREENER: Graph Neural Networks for News Media Profiling

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe study the problem of profiling news media on the Web with respect to their factuality of reporting and bias. This is an important but under-studied problem related to disinformation …...

30457

Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractLanguage models increasingly rely on massive web crawls for diverse text data. However, these sources are rife with undesirable content. As such, resources like Wikipedia, books, and news often serve …...

31347

A Critical Evaluation of Evaluations for Long-form Question Answering

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractLong-form question answering (LFQA) enables answering a wide range of questions, but its flexibility poses enormous challenges for evaluation. We perform the first targeted study of the evaluation of long-form …...

38676

OpenFact: Factuality Enhanced Open Knowledge Extraction

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWe focus on the factuality property during the extraction of an OpenIE corpus named OpenFact, which contains more than 12 million high-quality knowledge triplets. We break down the factuality property …...

26984