Benchmark Dataset

material ID: benchmarkdataset

Related Papers

Resolving PP attachment Ambiguities with Memory-Based Learning

Authors: nan

Publication: TIPSTER (1997)

DOI: nan

In this paper we describe the application of Memory-Based Learning to the problem of Prepositional Phrase attachment disam- biguation. We compare Memory-Based Learning, which stores examples in mem- ory and …...

41400

Accurate Information Extraction from Research Papers using Conditional Random Fields

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

With the increasing use of research paper search engines, such as CiteSeer, for both lit- erature search and hiring decisions, the accu- racy of such systems is of paramount impor- …...

24236

Semi-Supervised Classification for Extracting Protein Interaction Sentences using Dependency Parsing

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

We introduce a relation extraction method to identify the sentences in biomedical text that indicate an interaction among the protein names mentioned. Our approach is based on the analysis of …...

44026

Question Classification using Head Words and their Hypernyms

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

Question classification plays an important role in question answering. Features are the key to obtain an accurate question classifier. In con- trast to Li and Roth (2002)’s approach which makes …...

44827

Bayesian Word Sense Induction

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

Sense induction seeks to automatically identify word senses directly from a cor- pus. A key assumption underlying pre- vious work is that the context surround- ing an ambiguous word is …...

43434

Some Empirical Evidence for Annotation Noise in a Benchmarked Dataset

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

A number of recent articles in computational linguistics venues called for a closer exami- nation of the type of noise present in anno- tated datasets used for benchmarking (Rei- dsma …...

23814

Using Multiple Sources to Construct a Sentiment Sensitive Thesaurus for Cross-Domain Sentiment Classification

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

We describe a sentiment classification method that is applicable when we do not have any la- beled data for a target domain but have some labeled data for multiple other …...

36461

Sorting out the Most Confusing English Phrasal Verbs

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

In this paper, we investigate a full-fledged supervised machine learning framework for identifying English phrasal verbs in a given context. We concentrate on those that we de- fine as the …...

26324

Question Answering Using Enhanced Lexical Semantic Models

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

In this paper, we study the answer sentence selection problem for ques- tion answering. Unlike previous work, which primarily leverages syntactic analy- sis through dependency tree matching, we focus on …...

40115

Scaling Semantic Parsers with On-the-Fly Ontology Matching

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

We consider the challenge of learning seman- tic parsers that scale to large, open-domain problems, such as question answering with Freebase. In such settings, the sentences cover a wide variety …...

34617

Shallow Convolutional Neural Network for Implicit Discourse Relation Recognition

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Implicit discourse relation recognition re- mains a serious challenge due to the ab- sence of discourse connectives. In this pa- per, we propose a Shallow Convolutional Neural Network (SCNN) for …...

34303

Show Me Your Evidence - an Automatic Method for Context Dependent Evidence Detection

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Engaging in a debate with oneself or others to take decisions is an integral part of our day-to- day life. A debate on a topic (say, use of per- formance …...

34845

Towards the Extraction of Customer-to-Customer Suggestions from Reviews

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

State of the art in opinion mining mainly focuses on positive and negative senti- ment summarisation of online customer reviews. We observe that reviewers tend to provide advice, recommendations and …...

34310

Attention-based LSTM Network for Cross-Lingual Sentiment Classification

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Most of the state-of-the-art sentiment classifi- cation methods are based on supervised learn- ing algorithms which require large amounts of manually labeled data. However, the labeled resources are usually imbalanced …...

33701

Effective LSTMs for Target-Dependent Sentiment Classification

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractTarget-dependent sentiment classification remains a challenge: modeling the semantic relatedness of a target with its context words in a sentence. Different context words have different influences on determining the sentiment …...

3694

Sentiment Domain Adaptation with Multiple Sources

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Domain adaptation is an important re- search topic in sentiment analysis area. Existing domain adaptation methods usu- ally transfer sentiment knowledge from only one source domain to target do- main. …...

40570

Bridge Text and Knowledge by Learning Multi-Prototype Entity Mention Embedding

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractIntegrating text and knowledge into a unified semantic space has attracted significant research interests recently. However, the ambiguity in the common space remains a challenge, namely that the same mention …...

39969

Chat Detection in an Intelligent Assistant: Combining Task-oriented and Non-task-oriented Spoken Dialogue Systems

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractRecently emerged intelligent assistants on smartphones and home electronics (e.g., Siri and Alexa) can be seen as novel hybrids of domain-specific task-oriented spoken dialogue systems and open-domain non-task-oriented ones. To …...

39998

Global Normalization of Convolutional Neural Networks for Joint Entity and Relation Classification

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractWe introduce globally normalized convolutional neural networks for joint entity classification and relation extraction. In particular, we propose a way to utilize a linear-chain conditional random field output layer for …...

32866

Stance Classification of Context-Dependent Claims

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractRecent work has addressed the problem of detecting relevant claims for a given controversial topic. We introduce the complementary task of Claim Stance Classification, along with the first benchmark dataset …...

43152

EquGener: A Reasoning Network for Word Problem Solving by Generating Arithmetic Equations

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

Word problem solving has always been a challenging task as it involves reasoning across sentences, identification of operations and their order of application on relevant operands. Most of the earlier …...

18719

Sentence-Level Fluency Evaluation: References Help, But Can Be Spared!

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractMotivated by recent findings on the probabilistic modeling of acceptability judgments, we propose syntactic log-odds ratio (SLOR), a normalized language model score, as a metric for referenceless fluency evaluation of …...

41920

A Modular Architecture for Unsupervised Sarcasm Generation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractIn this paper, we propose a novel framework for sarcasm generation; the system takes a literal negative opinion as input and translates it into a sarcastic version. Our framework does …...

8883

Aligning Cross-Lingual Entities with Multi-Aspect Information

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractMultilingual knowledge graphs (KGs), such as YAGO and DBpedia, represent entities in different languages. The task of cross-lingual entity alignment is to match entities in a source language with their …...

9063

Fact Discovery from Knowledge Base via Facet Decomposition

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractDuring the past few decades, knowledge bases (KBs) have experienced rapid growth. Nevertheless, most KBs still suffer from serious incompletion. Researchers proposed many tasks such as knowledge base completion and …...

21989

Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate “few-shot” models for classes existing …...

21981

OpenCeres: When Open Information Extraction Meets the Semi-Structured Web

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractOpen Information Extraction (OpenIE), the problem of harvesting triples from natural language text whose predicate relations are not aligned to any pre-defined ontology, has been a popular subject of research …...

21976

Self-Adaptation for Unsupervised Domain Adaptation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractLack of labelled data in the target domain for training is a common problem in domain adaptation. To overcome this problem, we propose a novel unsupervised domain adaptation method that …...

19790

Semantic Relatedness Based Re-ranker for Text Spotting

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractApplications such as textual entailment, plagiarism detection or document clustering rely on the notion of semantic similarity, and are usually approached with dimension reduction techniques like LDA or with embedding-based …...

9169

SemEval-2019 Task 9: Suggestion Mining from Online Reviews and Forums

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe present the pilot SemEval task on Suggestion Mining. The task consists of subtasks A and B, where we created labeled data from feedback forum and hotel reviews respectively. Subtask …...

25643

SoftRegex: Generating Regex from Natural Language Descriptions using Softened Regex Equivalence

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe continue the study of generating se-mantically correct regular expressions from natural language descriptions (NL). The current state-of-the-art model SemRegex produces regular expressions from NLs by rewarding the reinforced learning …...

7625

Towards Content Transfer through Grounded Text Generation

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractRecent work in neural generation has attracted significant interest in controlling the form of text, such as style, persona, and politeness. However, there has been less work on controlling neural …...

22015

A Vietnamese Dataset for Evaluating Machine Reading Comprehension

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractOver 97 million inhabitants speak Vietnamese as the native language in the world. However, there are few research studies on machine reading comprehension (MRC) in Vietnamese, the task of understanding …...

4123

Database Search vs. Information Retrieval: A Novel Method for Studying Natural Language Querying of Semi-Structured Data

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThe traditional approach of querying a relational database is via a formal language, namely SQL. Recent developments in the design of natural language interfaces to databases show promising results for …...

15356

Does Gender Matter? Towards Fairness in Dialogue Systems

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractRecently there are increasing concerns about the fairness of Artificial Intelligence (AI) in real-world applications such as computer vision and recommendations. For example, recognition algorithms in computer vision are unfair …...

3975

DRTS Parsing with Structure-Aware Encoding and Decoding

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractDiscourse representation tree structure (DRTS) parsing is a novel semantic parsing task which has been concerned most recently. State-of-the-art performance can be achieved by a neural sequence-to-sequence model, treating the …...

37364

End to End Chinese Lexical Fusion Recognition with Sememe Knowledge

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractIn this paper, we present Chinese lexical fusion recognition, a new task which could be regarded as one kind of coreference recognition. First, we introduce the task in detail, showing …...

4096

Make Templates Smarter: A Template Based Data2Text System Powered by Text Stitch Model

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractNeural network (NN) based data2text models achieve state-of-the-art (SOTA) performance in most metrics, but they sometimes drop or modify the information in the input, and it is hard to control …...

32386

OCR Post Correction for Endangered Language Texts

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThere is little to no data available to build natural language processing models for most endangered languages. However, textual data in these languages often exists in formats that are not …...

30104

Plan-CVAE: A Planning-based Conditional Variational Autoencoder for Story Generation

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractStory generation is a challenging task of automatically creating natural languages to describe a sequence of events, which requires outputting text with not only a consistent topic but also novel …...

5613

Predicting Clickbait Strength in Online Social Media

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractHoping for a large number of clicks and potentially high social shares, journalists of various news media outlets publish sensationalist headlines on social media. These headlines lure the readers to …...

3938

Semi-supervised Domain Adaptation for Dependency Parsing via Improved Contextualized Word Representations

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractIn recent years, parsing performance is dramatically improved on in-domain texts thanks to the rapid progress of deep neural network models. The major challenge for current parsing research is to …...

4023

Small but Mighty: New Benchmarks for Split and Rephrase

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractSplit and Rephrase is a text simplification task of rewriting a complex sentence into simpler ones. As a relatively new task, it is paramount to ensure the soundness of its …...

31022

Understanding Procedural Text using Interactive Entity Networks

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThe task of procedural text comprehension aims to understand the dynamic nature of entities/objects in a process. Here, the key is to track how the entities interact with each other …...

29885

A Fine-Grained Domain Adaption Model for Joint Word Segmentation and POS Tagging

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractDomain adaption for word segmentation and POS tagging is a challenging problem for Chinese lexical processing. Self-training is one promising solution for it, which struggles to construct a set of …...

31810

Few-Shot Upsampling for Protest Size Detection

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

We propose a new task and dataset for a common problem in social science research: “upsampling” coarse document labels to fine- grained labels or spans. We pose the problem in …...

33859

G-Transformer for Document-Level Machine Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractDocument-level MT models are still far from satisfactory. Existing work extend translation unit from single sentence to multiple sentences. However, study shows that when we further enlarge the translation unit …...

8580

GWLAN: General Word-Level AutocompletioN for Computer-Aided Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractComputer-aided translation (CAT), the use of software to assist a human translator in the translation process, has been proven to be useful in enhancing the productivity of human translators. Autocompletion, …...

8397

Implicit Sentiment Analysis with Event-centered Text Representation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractImplicit sentiment analysis, aiming at detecting the sentiment of a sentence without sentiment words, has become an attractive research topic in recent years. In this paper, we focus on event-centric …...

31439

Leveraging Argumentation Knowledge Graph for Interactive Argument Pair Identification

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Interactive argument pair identification is es- sential in the context of dialogical argumenta- tion mining. Existing research treats it as a problem of sentence matching and largely re- lies on …...

33980

On the Use of Context for Predicting Citation Worthiness of Sentences in Scholarly Articles

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractIn this paper, we study the importance of context in predicting the citation worthiness of sentences in scholarly articles. We formulate this problem as a sequence labeling task solved using …...

21493

A Novel Framework Based on Medical Concept Driven Attention for Explainable Medical Code Prediction via External Knowledge

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractMedical code prediction from clinical notes aims at automatically associating medical codes with the clinical notes. Rare code problem, the medical codes with low occurrences, is prominent in medical code …...

32799

Data Augmentation with Dual Training for Offensive Span Detection

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecognizing offensive text is an important requirement for every content management system, especially for social networks. While the majority of the prior work formulate this problem as text classification, i.e., …...

21233

Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis work demonstrates that Legal Judgement Prediction systems without expert-informed adjustments can be vulnerable to shallow, distracting surface signals that arise from corpus construction, case distribution, and confounding factors. To …...

31518

End-to-End Modeling via Information Tree for One-Shot Natural Language Spatial Video Grounding

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractNatural language spatial video grounding aims to detect the relevant objects in video frames with descriptive sentences as the query. In spite of the great advances, most existing methods rely …...

37100

MISC: A Mixed Strategy-Aware Model integrating COMET for Emotional Support Conversation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractApplying existing methods to emotional support conversation—which provides valuable assistance to people who are in need—has two major limitations: (a) they generally employ a conversation-level emotion label, which is too …...

39351

Scientific Paper Extractive Summarization Enhanced by Citation Graphs

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn a citation graph, adjacent paper nodes share related scientific terms and topics. The graph thus conveys unique structure information of document-level relatedness that can be utilized in the paper …...

31053

SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecent work has introduced an important yet relatively under-explored NLP task called Semantic Overlap Summarization (SOS) that entails generating a summary from multiple alternative narratives which conveys the common information …...

31577

Sense Embeddings are also Biased – Evaluating Social Biases in Static and Contextualised Sense Embeddings

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractSense embedding learning methods learn different embeddings for the different senses of an ambiguous word. One sense of an ambiguous word might be socially biased while its other senses remain …...

39243

Summarizing Dialogues with Negative Cues

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractAbstractive dialogue summarization aims to convert a long dialogue content into its short form where the salient information is preserved while the redundant pieces are ignored. Different from the well-structured …...

4695

Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractImage-to-text tasks such as open-ended image captioning and controllable image description have received extensive attention for decades. Here we advance this line of work further, presenting Visual Spatial Description (VSD), …...

31472

WeTS: A Benchmark for Translation Suggestion

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractTranslation suggestion (TS), which provides alternatives for specific words or phrases given the entire documents generated by machine translation (MT), has been proven to play a significant role in post-editing …...

30801

What Makes Reading Comprehension Questions Difficult?

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractFor a natural language understanding benchmark to be useful in research, it has to consist of examples that are diverse and difficult enough to discriminate among current and near-future state-of-the-art …...

38904

Word-Label Alignment for Event Detection: A New Perspective via Optimal Transport

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractEvent Detection (ED) aims to identify mentions/triggers of real world events in text. In the literature, this task is modeled as a sequence-labeling or word-prediction problem. In this work, we …...

26343

Do language models have coherent mental models of everyday things?

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWhen people think of everyday things like an egg, they typically have a mental image associated with it. This allows them to correctly judge, for example, that “the yolk surrounds …...

38755

History Semantic Graph Enhanced Conversational KBQA with Temporal Information Modeling

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractContext information modeling is an important task in conversational KBQA. However, existing methods usually assume the independence of utterances and model them in isolation. In this paper, we propose a …...

38662

PEIT: Bridging the Modality Gap with Pre-trained Models for End-to-End Image Translation

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractImage translation is a task that translates an image containing text in the source language to the target language. One major challenge with image translation is the modality gap between …...

37806