Mean Average Precision

metric ID: meanaverageprecision

Related Papers

Position Specific Posterior Lattices for Indexing Speech

Authors: nan

Publication: TIPSTER (2005)

DOI: nan

The paper presents the Position Specific Posterior Lattice, a novel representation of automatic speech recognition lattices that naturally lends itself to efficient in- dexing of position information and subse- quent …...

36578

Information Retrieval On Empty Fields

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

We explore the problem of retrieving semi-structured documents from a real- world collection using a structured query. We formally develop Structured Rele- vance Models (SRM), a retrieval model that is …...

24173

Korean-Chinese Person Name Translation for Cross Language Information Retrieval

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

. Named entity translation plays an important role in many applications, such as information retrieval and machine translation. In this paper, we focus on translating person names, the most common …...

19391

Metric Learning for Synonym Acquisition

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

The distance or similarity metric plays an important role in many natural language processing (NLP) tasks. Previous stud- ies have demonstrated the effectiveness of a number of metrics such as …...

6400

Entity Extraction via Ensemble Semantics

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

Combining information extraction sys- tems yields significantly higher quality re- sources than each system in isolation. In this paper, we generalize such a mixing of sources and features in a …...

44519

An Associative Concept Dictionary for Verbs and its Application to Elliptical Word Estimation

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractNatural language processing technology has developed remarkably, but it is still difficult for computers to understand contextual meanings as humans do. The purpose of our work has been to construct …...

8425

Dictionary and Monolingual Corpus-based Query Translation for Basque-English CLIR

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractThis paper deals with the main problems that arise in the query translation process in dictionary-based Cross-lingual Information Retrieval (CLIR): translation selection, presence of Out-Of-Vocabulary (OOV) terms and translation of …...

8597

Automatically Building Training Examples for Entity Extraction

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

In this paper we present methods for automat- ically acquiring training examples for the task of entity extraction. Experimental evidence show that: (1) our methods compete with a current heavily …...

42246

Evaluation via Negativa of Chinese Word Segmentation for Information Retrieval

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

. Numerous studies have analyzed the influences of word segmentation (WS) performance on information retrieval (IR) for Mandarin Chinese and have demonstrated a non-monotonic relationship between WS accuracy and IR …...

18859

Rumor has it: Identifying Misinformation in Microblogs

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

A rumor is commonly defined as a state- ment whose true value is unverifiable. Ru- mors may spread misinformation (false infor- mation) or disinformation (deliberately false information) on a network …...

44042

Combining Statistical Translation Techniques for Cross-Language Information Retrieval

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

Cross-language information retrieval today is dominated by techniques that rely principally on context-independent token-to-token mappings despite the fact that state-of-the-art statistical machine translation systems now have far richer translation models …...

5899

Cumulative Progress in Language Models for Information Retrieval

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

The improvements to ad-hoc IR sys- tems over the last decades have been re- cently criticized as illusionary and based on incorrect baseline comparisons. In this paper several improvements to …...

28584

Efficient and Expressive Knowledge Base Completion Using Subgraph Feature Extraction

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

We explore some of the practicalities of using random walk inference meth- ods, such as the Path Ranking Algorithm (PRA), for the task of knowledge base completion. We show that …...

34478

ITNLP-AiKF at SemEval-2016 Task 3 a quesiton answering system using community QA repository

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Community Question Answering (CAQ) sys- tems play an important role in people's lives due to the huge knowledge accumulated in them. In order to take full advantage of the huge …...

22446

Lifted Rule Injection for Relation Embeddings

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Methods based on representation learning cur- rently hold the state-of-the-art in many natural language processing and knowledge base in- ference tasks. Yet, a major challenge is how to efficiently incorporate …...

33580

Rule-based Automatic Multi-word Term Extraction and Lemmatization

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractIn this paper we present a rule-based method for multi-word term extraction that relies on extensive lexical resources in the form of electronic dictionaries and finite-state transducers for modelling various …...

16741

SemEval-2016 Task 3: Community Question Answering

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

This paper describes the SemEval–2016 Task 3 on Community Question Answer- ing, which we offered in English and Ara- bic. For English, we had three sub- tasks: Question–Comment Similarity (subtask …...

22503

Learning What is Essential in Questions

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractQuestion answering (QA) systems are easily distracted by irrelevant or redundant words in questions, especially when faced with long or multi-sentence questions in difficult domains. This paper introduces and studies …...

42067

A Study of Latent Structured Prediction Approaches to Passage Reranking

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThe structured output framework provides a helpful tool for learning to rank problems. In this paper, we propose a structured output approach which regards rankings as latent variables. Our approach …...

22102

Visual Detection with Context for Document Layout Analysis

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe present 1) a work in progress method to visually segment key regions of scientific articles using an object detection technique augmented with contextual features, and 2) a novel dataset …...

9164

Automated Generation of Storytelling Vocabulary from Photographs for use in AAC

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractResearch on the application of NLP in symbol-based Augmentative and Alternative Communication (AAC) tools for improving social interaction support is scarce. We contribute a novel method for generating context-related vocabulary …...

8773

Unification-based Reconstruction of Multi-hop Explanations for Science Questions

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper presents a novel framework for reconstructing multi-hop explanations in science Question Answering (QA). While existing approaches for multi-hop reasoning build explanations considering each question in isolation, we propose …...

42899

Contrastive Error Attribution for Finetuned Language Models

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractRecent work has identified noisy and misannotated data as a core cause of hallucinations and unfaithful outputs in Natural Language Generation (NLG) tasks. Consequently, identifying and removing these examples is …...

38018

Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractDocument-level relation extraction (DocRE) attracts more research interest recently. While models achieve consistent performance gains in DocRE, their underlying decision rules are still understudied: Do they make the right predictions …...

38508