Mean Average Precision
Related Papers
Position Specific Posterior Lattices for Indexing Speech
The paper presents the Position Specific Posterior Lattice, a novel representation of automatic speech recognition lattices that naturally lends itself to efficient in- dexing of position information and subse- quent …...
Information Retrieval On Empty Fields
We explore the problem of retrieving semi-structured documents from a real- world collection using a structured query. We formally develop Structured Rele- vance Models (SRM), a retrieval model that is …...
Korean-Chinese Person Name Translation for Cross Language Information Retrieval
. Named entity translation plays an important role in many applications, such as information retrieval and machine translation. In this paper, we focus on translating person names, the most common …...
Metric Learning for Synonym Acquisition
The distance or similarity metric plays an important role in many natural language processing (NLP) tasks. Previous stud- ies have demonstrated the effectiveness of a number of metrics such as …...
Entity Extraction via Ensemble Semantics
Combining information extraction sys- tems yields significantly higher quality re- sources than each system in isolation. In this paper, we generalize such a mixing of sources and features in a …...
An Associative Concept Dictionary for Verbs and its Application to Elliptical Word Estimation
AbstractNatural language processing technology has developed remarkably, but it is still difficult for computers to understand contextual meanings as humans do. The purpose of our work has been to construct …...
Dictionary and Monolingual Corpus-based Query Translation for Basque-English CLIR
AbstractThis paper deals with the main problems that arise in the query translation process in dictionary-based Cross-lingual Information Retrieval (CLIR): translation selection, presence of Out-Of-Vocabulary (OOV) terms and translation of …...
Automatically Building Training Examples for Entity Extraction
In this paper we present methods for automat- ically acquiring training examples for the task of entity extraction. Experimental evidence show that: (1) our methods compete with a current heavily …...
Evaluation via Negativa of Chinese Word Segmentation for Information Retrieval
. Numerous studies have analyzed the influences of word segmentation (WS) performance on information retrieval (IR) for Mandarin Chinese and have demonstrated a non-monotonic relationship between WS accuracy and IR …...
Rumor has it: Identifying Misinformation in Microblogs
A rumor is commonly defined as a state- ment whose true value is unverifiable. Ru- mors may spread misinformation (false infor- mation) or disinformation (deliberately false information) on a network …...
Combining Statistical Translation Techniques for Cross-Language Information Retrieval
Cross-language information retrieval today is dominated by techniques that rely principally on context-independent token-to-token mappings despite the fact that state-of-the-art statistical machine translation systems now have far richer translation models …...
Cumulative Progress in Language Models for Information Retrieval
The improvements to ad-hoc IR sys- tems over the last decades have been re- cently criticized as illusionary and based on incorrect baseline comparisons. In this paper several improvements to …...
Efficient and Expressive Knowledge Base Completion Using Subgraph Feature Extraction
We explore some of the practicalities of using random walk inference meth- ods, such as the Path Ranking Algorithm (PRA), for the task of knowledge base completion. We show that …...
ITNLP-AiKF at SemEval-2016 Task 3 a quesiton answering system using community QA repository
Community Question Answering (CAQ) sys- tems play an important role in people's lives due to the huge knowledge accumulated in them. In order to take full advantage of the huge …...
Lifted Rule Injection for Relation Embeddings
Methods based on representation learning cur- rently hold the state-of-the-art in many natural language processing and knowledge base in- ference tasks. Yet, a major challenge is how to efficiently incorporate …...
Rule-based Automatic Multi-word Term Extraction and Lemmatization
AbstractIn this paper we present a rule-based method for multi-word term extraction that relies on extensive lexical resources in the form of electronic dictionaries and finite-state transducers for modelling various …...
SemEval-2016 Task 3: Community Question Answering
This paper describes the SemEval–2016 Task 3 on Community Question Answer- ing, which we offered in English and Ara- bic. For English, we had three sub- tasks: Question–Comment Similarity (subtask …...
Learning What is Essential in Questions
AbstractQuestion answering (QA) systems are easily distracted by irrelevant or redundant words in questions, especially when faced with long or multi-sentence questions in difficult domains. This paper introduces and studies …...
A Study of Latent Structured Prediction Approaches to Passage Reranking
AbstractThe structured output framework provides a helpful tool for learning to rank problems. In this paper, we propose a structured output approach which regards rankings as latent variables. Our approach …...
Visual Detection with Context for Document Layout Analysis
AbstractWe present 1) a work in progress method to visually segment key regions of scientific articles using an object detection technique augmented with contextual features, and 2) a novel dataset …...
Automated Generation of Storytelling Vocabulary from Photographs for use in AAC
AbstractResearch on the application of NLP in symbol-based Augmentative and Alternative Communication (AAC) tools for improving social interaction support is scarce. We contribute a novel method for generating context-related vocabulary …...
Unification-based Reconstruction of Multi-hop Explanations for Science Questions
AbstractThis paper presents a novel framework for reconstructing multi-hop explanations in science Question Answering (QA). While existing approaches for multi-hop reasoning build explanations considering each question in isolation, we propose …...
Contrastive Error Attribution for Finetuned Language Models
AbstractRecent work has identified noisy and misannotated data as a core cause of hallucinations and unfaithful outputs in Natural Language Generation (NLG) tasks. Consequently, identifying and removing these examples is …...
Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction
AbstractDocument-level relation extraction (DocRE) attracts more research interest recently. While models achieve consistent performance gains in DocRE, their underlying decision rules are still understudied: Do they make the right predictions …...