Дәлдік
Related Papers
Evaluating Discourse Processing Algorithms
In order to take steps towards establishing a method- ology for evaluating Natural Language systems, we conducted a case study. We attempt to evaluate two different approaches to anaphoric processing …...
A Simple Rule-Based Part of Speech Tagger
Automatic part of speech tagging is an area of natural language processing where statistical techniques have been more successful than rule- based methods. In this paper, we present a sim- …...
An Algorithm for VP Ellipsis
An algorithm is proposed to determine an- tecedents for VP ellipsis. The algorithm elim- inates impossible antecedents, and then im- poses a preference ordering on possible an- tecedents. The algorithm …...
Efficiency, Robustness and Accuracy in picky Chart Parsing
This paper describes Picky, a probabilistic agenda-based chart parsing algorithm which uses a technique called p~'ob- abilistic prediction to predict which grammar rules are likely to lead to an acceptable …...
Towards History-based Grammars: Using Richer Models for Probabilistic Parsing
We describe a generative probabilistic model of natural lan- guage, which we call HBG, that takes advantage of detailed linguistic information to resolve ambiguity. HBG incorpo- rates lexical, syntactic, semantic, …...
One Sense per Collocation
Previous work [Gale, Church and Yarowsky, 1992] showed that with high probability a polysemous word has one sense per discourse. In this paper we show that for certain definitions of …...
Part-of-Speech Induction From Scratch
This paper presents a method for inducing the parts of speech of a language and part- of-speech labels for individual words from a large text corpus. Vector representations for the …...
The Automatic Acquisition of Frequencies of Verb Subcategorization Frames from Tagged Corpora
We describe a mechanism for automatically acquiring verb subcategorization frames and their frequencies in a large corpus. A tagged corpus is first partially parsed to identify noun phrases and then …...
Bootstrapping Statistical Processing into a Rule-Based Natural Language Parser
This paper describes a "bootstrapping" method which uses a broad-coverage, rule-based parser to compute probabilities while parsing an untagged corpus of NL text, and which then incorporates those probabilities into …...
DECISION LISTS FOR LEXICAL AMBIGUITY RESOLUTION: Application to Accent Restoration in Spanish and French
This paper presents a statistical decision procedure for lexical ambiguity resolution. The algorithm exploits both local syntactic patterns and more distant collo- cational evidence, generating an efficient, effective, and highly …...
Interleaving Syntax and Semantics in an Efficient Bottom-Up Parser
We describe an efficient bottom-up parser that in- terleaves syntactic and semantic structure build- ing. Two techniques are presented for reducing search by reducing local ambiguity: Limited left- context constraints …...
Language Determination: Natural Language Processing from Scanned Document Images
Many documents are available to a computer only as images from paper. However, most nat- ural language processing systems expect their input as character-coded text, which may be difficult or …...
Part-of-Speech Tagging Using a Variable Memory Markov Model
We present a new approach to disambiguating syn- tactically ambiguous words in context, based on Variable Memory Markov (VMM) models. In con- trast to fixed-length Markov models, which predict based …...
Symmetric Pattern Matching Analysis for English Coordinate Structures
The authors propose a model for analyz- ing English sentences including coordinate conjunctions such as "and", "or", "but" and the equivalent words. Syntactic analysis of the English coordinate sentences is …...
Translating Collocations for Use in Bilingual Lexicons
Collocations are notoriously difficult for non-native speakers to translate, primarily because they are opaque and can not be translated on a word by word basis. We describe a program named …...
Prepositional Phrase Attachment through a Backed-off Model
Recent work has considered corpus-based or statistical approaches to the problem of prepositional phrase attachment ambiguity. Typically, ambiguous verb phrases of the form v rip1 p rip2 are resolved through …...
Statistical Decision-Tree Models for Parsing
Syntactic natural language parsers have shown themselves to be inadequate for pro- cessing highly-ambiguous large-vocabulary text, as is evidenced by their poor per- formance on domains like the Wall Street …...
Unsupervised Word Sense Disambiguation Rivaling Supervised Methods
This paper presents an unsupervised learn- ing algorithm for sense disambiguation that, when trained on unannotated English text, rivals the performance of supervised techniques that require time-consuming hand annotations. The …...
Bilingual Knowledge Acquisition from Korean-English Parallel Corpus Using Alignment
This paper snggests a method to align Korean-English parallel corpus. '1?he structural dissimilarity between Korean and Indo-European languages requires more flexible measures to evaluate the alignment candidates between the bilin- …...
Integrating Multiple Knowledge Sources to Disambiguate Word Sense: An Exemplar-Based Approach
In this paper, we present a new approach for word sense disambiguation (WSD) us- ing an exemplar-based learning algorithm. This approach integrates a diverse set of knowledge sources to disambiguate …...
Using Parsed Corpora for Structural Disambiguation in the TRAINS Domain
This paper describes a prototype disam- biguation module, KANKEI, which was tested on two corpora of the TRAINS project. In ambiguous verb phrases of form V ... NP PP or …...
A Comparison of Head Transducers and Transfer for a Limited Domain Translation Application
We compare the effectiveness of two related • machine translation models applied to the same limited-domain task. One is a trans- fer model with monolingual head automata for analysis and …...
Combining Unsupervised Lexical Knowledge Methods for Word Sense Disambiguation
This paper presents a method to combine a set of unsupervised algorithms that can accurately disambiguate word senses in a large, completely untagged corpus. Al- though most of the techniques …...
Detecting Subject Boundaries Within Text: A Language Independent Statistical Approach
We describe here an algorithm for detect- ing subject boundaries within text based on a statistical lexical similarity measure. Hearst has already tackled this problem with good results (Hearst, 1994). …...
Predicting the Semantic Orientation of Adjectives
We identify and validate from a large cor- pus constraints from conjunctions on the positive or negative semantic orientation of the conjoined adjectives. A log-linear regression model uses these constraints …...
Combining Stochastic and Rule-Based Methods for Disambiguation in Agglutinative Languages
In this paper we present the results of the combination of stochastic and rule-based disambiguation methods applied to Basque languagel. The methods we have used in disambiguation are Constraint Grammar …...
Combining Stochastic and Rule-Based Methods for Disambiguation in Agglutinative Languages
In this paper we present the results of the combination of stochastic and rule-based disambiguation methods applied to Basque languagel. The methods we have used in disambiguation are Constraint Grammar …...
Implementing a Sense Tagger in a General Architecture for Text Engineering
We describe two systems: GATE (General Ar- chitecture for Text Engineering), an architec- ture to aid in the production and delivery of language engineering systems which signifi- cantly reduces development …...
Spoken Dialogue Interpretation with the DOP Model
We show how the DOP model can be used for fast and robust processing of spoken input in a practical spoken dialogue system called OVIS. OVIS, Openbaar Vervoer Informatie Systeem …...
Spoken Dialogue Interpretation with the DOP Model
We show how the DOP model can be used for fast and robust processing of spoken input in a practical spoken dialogue system called OVIS. OVIS, Openbaar Vervoer Informatie Systeem …...
A Knowledge-free Method for Capitalized Word Disambiguation
In this paper we present an approach to the dis- ambiguation of capitalized words when they are used in the positions where capitalization is ex- pected, such as the first …...
An Unsupervised Model for Statistically Determining Coordinate Phrase Attachment
This paper examines the use of an unsuper- vised statistical model for determining the at- tachment of ambiguous coordinate phrases (CP) of the form nl p n2 cc n3. The …...
Corpus-Based Learning for Noun Phrase Coreference Resolution
In this paper, we present a learning approach for coreference resolution of noun phrases in unrestricted text. The approach learns from a small, annotated corpus and the task in- cludes …...
Mapping Multilingual Hierarchies Using Relaxation Labeling
This paper explores the automatic construction of a multilingual Lexical Knowledge Base from pre-existing lexical resources. We present a new and robust approach for linking already existing lexical/semantic hierarchies. We …...
PP-Attachment: A Committee Machine Approach
In this paper we use various methods for multiple neural network combination in tasks of prepo- sitional phrase attachment. Experiments with aggregation functions such as unweighted and weighted average, OWA …...
Automatic Refinement of a POS Tagger Using a Reliable Parser and Plain Text Corpora
This paper proposes a new unsupervised learning method for obtaining English part-of- speech(POS) disambiguation rules which would improve the accuracy of a POS tagger. This method has been implemented in …...
Compound Noun Segmentation Based on Lexical Data Extracted from Corpus
Compound noun analysis is one of the crucial prob- lems in Korean language processing because a series of nouns in Korean may appear without white space in real texts, which …...
Dependency of context-based Word Sense Disambiguation from representation and domain complexity
Word Sense Disambiguation (WSD) is a central task in the area of Natural Language Processing. In the past few years several context-based probabilistic and machine learning methods for WSD have …...
Detection of Language (Model) Errors
The bigram language models are popular, in much language processing applications, in both Indo-European and Asian languages. However, when the language model for Chinese is applied in a novel domain, …...
Reducing Parsing Complexity by Intra-Sentence Segmentation based on Maximum Entropy Model
Long sentence analysis has been a critical problem because of high complexity. This pa- per addresses the reduction of parsing com- plexity by intra-sentence segmentation, and presents maximum entropy model …...
Reusing an ontology to generate numeral classifiers
In this paper, we present a solution to the prob- lem of generating Japanese numeral classifiers us- ing semantic classes from an ontology. Most nouns must take a numeral classifier …...
Chunking with Support Vector Machines
We apply Support Vector Machines (SVMs) to identify English base phrases (chunks). SVMs are known to achieve high generalization perfor- mance even with input data of high dimensional feature spaces. …...
Empirically Estimating Order Constraints for Content Planning in Generation
In a language generation system, a content planner embodies one or more “plans” that are usually hand–crafted, sometimes through manual analysis of target text. In this paper, we present a …...
Locating Boundaries for Prosodic Constituents in Unrestricted Mandarin Texts
This paper proposes a three-tier prosodic hierarchy, including prosodic word, intermediate phrase and intonational phrase tiers, for Mandarin that emphasizes the use of the prosodic word instead of the lexical …...
Pronominal anaphora resolution in KANTOO English-to-Spanish machine translation system
AbstractWe describe the automatic resolution of pronominal anaphora using KANT Controlled English (KCE) and the KANTOO English-to-Spanish MT system. Our algorithm is based on a robust, syntax-based approach that applies …...
The Japanese Translation Task: Lexical and Structural Perspectives
This paper describes two distinct attempts at the SENSEVAL-2 Japanese translation task. The first im- plementation is based on lexical similarity and builds on the results of Baldwin (2001b; 2001a), …...
Toward a Bilingual Legal Term Glossary from Context Profiles
We propose an algorithm for the automatic acquisition of a bilingual lexicon in the legal domain. We make use of a parallel corpus of bilingual court judgments, aligned to the …...
A Graph Model for Unsupervised Lexical Acquisition
This paper presents an unsupervised method for assembling semantic knowledge from a part-of- speech tagged corpus using graph algorithms. The graph model is built by linking pairs of words which …...
An Analysis of the AskMSR Question-Answering System
We describe the architecture of the AskMSR question answering system and systematically evaluate contributions of different system components to accuracy. The system differs from most question answering systems in its …...
An Empirical Evaluation of Knowledge Sources and Learning Algorithms for Word Sense Disambiguation
In this paper, we evaluate a vari- ety of knowledge sources and super- vised learning algorithms for word sense disambiguation on SENSEVAL-2 and SENSEVAL-1 data. Our knowledge sources include the …...
An Empirical Study of Active Learning with Support Vector Machines forJapanese Word Segmentation
We explore how active learning with Sup- port Vector Machines works well for a non-trivial task in natural language pro- cessing. We use Japanese word segmenta- tion as a test …...
Base Noun Phrase Translation Using Web Data and the EM Algorithm
We consider here the problem of Base Noun Phrase translation. We propose a new method to perform the task. For a given Base NP, we first search its translation candidates …...
Covering Ambiguity Resolution in Chinese Word Segmentation Based on Contextual Information
Covering ambiguity is one of the two basic types of ambiguities in Chinese word segmentation. We regard its resolution as equivalent to word sense disambiguation, and make use of the …...
Example-based Speech Intention Understanding and Its Application to In-Car Spoken Dialogue System
This paper proposes a method of speech inten- tion understanding based on dialogue examples. The method uses a spoken dialogue corpus with intention tags to regard the intention of each …...
Extracting Important Sentences with Support Vector Machines
Extracting sentences that contain important in- formation from a document is a form of text summarization. The technique is the key to the automatic generation of summaries similar to those …...
Fast LR parsing Using Rich (Tree Adjoining) Grammars
We describe an LR parser of parts-of- speech (and punctuation labels) for Tree Adjoining Grammars (TAGs), that solves table conflicts in a greedy way, with lim- ited amount of backtracking. …...
Location Normalization for Information Extraction
Ambiguity is very high for location names. For example, there are 23 cities named ‘Buffalo’ in the U.S. Country names such as ‘Canada’, ‘Brazil’ and ‘China’ are also city names …...
Scaling Context Space
Context is used in many NLP systems as an indicator of a term’s syntactic and se- mantic function. The accuracy of the sys- tem is dependent on the quality and …...
Semi-Supervised Maximum Entropy Based Approach to Acronym and Abbreviation Normalization in Medical Texts
Text normalization is an important aspect of successful information retrieval from medical documents such as clinical notes, radiology reports and discharge summaries. In the medical domain, a significant part of …...
Semiautomatic Labelling of Semantic Features
This paper presents the strategy and design of a highly efficient semiautomatic method for labelling the semantic features of common nouns, using semantic relationships between words, and based on the …...
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
This paper presents a simple unsupervised learning algorithm for classifying reviews as recommended (thumbs up) or not rec- ommended (thumbs down). The classifi- cation of a review is predicted by …...
Word Sense Disambiguation and Sense-Based NV Event Frame Identifier
Word sense is ambiguous in natural language processing (NLP). This phenomenon is particularly keen in cases involving noun-verb (NV) word-pairs. This paper describes a sense-based noun-verb event frame (NVEF) identifier …...
A SNoW Based Supertagger with Application to NP Chunking
Supertagging is the tagging process of assigning the correct elementary tree of LTAG, or the correct supertag, to each word of an input sentence1. In this pa- per we propose …...
Application of search algorithms to natural language processing
Currently, the most common technique for Natural Language parsing is done by using pattern matching through references to a database with the aid of grammatical structures models. But the huge …...
Closing the Gap: Learning-Based Information Extraction Rivaling Knowledge-Engineering Methods
In this paper, we present a learning ap- proach to the scenario template task of information extraction, where information filling one template could come from mul- tiple sentences. When tested …...
Exploiting Parallel Texts for Word Sense Disambiguation: An Empirical Study
A central problem of word sense disam- biguation (WSD) is the lack of manually sense-tagged data required for supervised learning. In this paper, we evaluate an ap- proach to automatically …...
Fast Methods for Kernel-Based Text Analysis
Kernel-based learning (e.g., Support Vec- tor Machines) has been successfully ap- plied to many hard problems in Natural Language Processing (NLP). In NLP, al- though feature combinations are crucial to …...
Preposition Semantic Classification via Treebank and FrameNet
This paper reports on experiments in clas- sifying the semantic role annotations as- signed to prepositional phrases in both the PENN TREEBANK and FRAMENET. In both cases, experiments are done …...
Topic Segmentation for Short Texts
Topic segmentation, which aims to fmd the boundaries between topic blocks in a text, is an important task for semantic analysis of texts. Although different solutions have been proposed for …...
Unsupervised methods for developing taxonomies by combining syntactic and statistical information
This paper describes an unsupervised algo- rithm for placing unknown words into a taxon- omy and evaluates its accuracy on a large and varied sample of words. The algorithm works …...
Using Zero Anaphora Resolution to Improve Text Categorization
In Chinese, anaphors are frequently omitted, termed zero anaphor (ZA), from text due to their prominence. Thus the information carried by ZAs in text can not be used to contribute …...
A Geometric View on Bilingual Lexicon Extraction from Comparable Corpora
We present a geometric view on bilingual lexicon extraction from comparable corpora, which allows to re-interpret the methods proposed so far and iden- tify unresolved problems. This motivates three new …...
A Linear Programming Formulation for Global Inference in Natural Language Tasks
Given a collection of discrete random variables representing outcomes of learned local predic- tors in natural language, e.g., named entities and relations, we seek an optimal global as- signment to …...
Acquiring the Meaning of Discourse Markers
This paper applies machine learning techniques to acquiring aspects of the meaning of discourse mark- ers. Three subtasks of acquiring the meaning of a discourse marker are considered: learning its …...
Automatic Paragraph Identification: A Study across Languages and Domains
In this paper we investigate whether paragraphs can be identifi ed automatically in different languages and domains. We propose a machine learning ap- proach which exploits textual and discourse cues …...
Combining Lexical and Syntactic Features for Supervised Word Sense Disambiguation
The success of supervised learning approaches to word sense disambiguation is largely de- pendent on the features used to represent the context in which an ambiguous word occurs. Previous work …...
Detecting Emotions in Mandarin Speech
. In this paper, a Mandarin speech based emotion classification method is presented. Five primary human emotions including anger, boredom, happiness, neutral and sadness are investigated. For speech emotion recognition, …...
High WSD Accuracy Using Naive Bayesian Classifier with Rich Features
Word Sense Disambiguation (WSD) is the task of choosing the right sense of an ambiguous word given a context. Using Naive Bayesian (NB) classifiers is known as one of the …...
Identifying Agreement and Disagreement in Conversational Speech: Use of Bayesian Networks to Model Pragmatic Dependencies
We describe a statistical approach for modeling agreements and disagreements in conversational in- teraction. Our approach first identifies adjacency pairs using maximum entropy ranking based on a set of lexical, …...
Inferring Sentence-internal Temporal Relations
In this paper we propose a data intensive ap- proach for inferring sentence-internal tempo- ral relations, which relies on a simple prob- abilistic model and assumes no manual cod- ing. …...
Learning Hebrew Roots: Machine Learning with Linguistic Constraints
The morphology of Semitic languages is unique in the sense that the major word-formation mechanism is an inherently non-concatenative process of inter- digitation, whereby two morphemes, a root and a …...
Linear-Time Dependency Analysis for Japanese
We present a novel algorithm for Japanese dependency analysis. The algorithm allows us to analyze dependency structures of a sentence in linear-time while keeping a state-of-the-art accuracy. In this paper, …...
Named Entity Discovery Using Comparable News Articles
In this paper we describe a way to discover Named Entities by using the distribution of words in news articles. Named Entity recog- nition is an important task for today’s …...
PageRank on Semantic Networks, with Application to Word Sense Disambiguation
This paper presents a new open text word sense disambiguation method that combines the use of logical inferences with PageRank-style algo- rithms applied on graphs extracted from natu- ral language …...
Paraphrasing Predicates from Written Language to Spoken Language Using the Web
There are a lot of differences between expres- sions used in written language and spoken lan- guage. It is one of the reasons why speech syn- thesis applications are prone …...
Part-of-Speech Tagging in Context
We present a new HMM tagger that exploits context on both sides of a word to be tagged, and evaluate it in both the unsupervised and supervised case. Along the …...
The Importance of Supertagging for Wide-Coverage CCG Parsing
This paper describes the role of supertagging in a wide-coverage CCG parser which uses a log-linear model to select an analysis. The supertagger reduces the derivation space over which model …...
Towards an automated evaluation of an embedded MT system
. How can recent advances in automating the evaluation of machine translation (MT) engines be applied to automate the evaluation of more complex embedded MT systems? In this paper, we …...
Towards Terascale Semantic Acquisition
Although vast amounts of textual data are freely available, many NLP algorithms exploit only a minute percentage of it. In this paper, we study the challenges of working at the …...
Why Nitpicking Works: Evidence for Occam’s Razor in Error Correctors
Empirical experience and observations have shown us when powerful and highly tunable classifiers such as maximum en- tropy classifiers, boosting and SVMs are applied to language processing tasks, it is …...
A Preliminary Work on Classifying Time Granularities of Temporal Questions
. Temporal question classification assigns time granularities to tempo- ral questions ac-cording to their anticipated answers. It is very important for an- swer extraction and verification in the literature of …...
A Quantitative Analysis of Lexical Differences Between Genders in Telephone Conversations
In this work, we provide an empiri- cal analysis of differences in word use between genders in telephone conversa- tions, which complements the consid- erable body of work in sociolinguistics …...
Classification of Multiple-Sentence Questions
. Conventional QA systems cannot answer to the questions composed of two or more sentences. Therefore, we aim to construct a QA system that can answer such multiple-sentence questions. As …...
Data-Defined Kernels for Parse Reranking Derived from Probabilistic Models
Previous research applying kernel meth- ods to natural language parsing have fo- cussed on proposing kernels over parse trees, which are hand-crafted based on do- main knowledge and computational con- …...
Data-driven Approaches for Information Structure Identification
This paper investigates automatic identi- fication of Information Structure (IS) in texts. The experiments use the Prague Dependency Treebank which is annotated with IS following the Praguian approach of Topic …...
Detecting Article Errors Based on the Mass Count Distinction
. This paper proposes a method for detecting errors concern- ing article usage and singular/plural usage based on the mass count distinction. Although the mass count distinction is particularly impor- …...
Extracting Semantic Orientations of Words using Spin Model
We propose a method for extracting se- mantic orientations of words: desirable or undesirable. Regarding semantic ori- entations as spins of electrons, we use the mean field approximation to compute …...
Finding Taxonomical Relation from an MRD for Thesaurus Extension
. Building a thesaurus is very costly and time-consuming task. To alleviate this problem, this paper proposes a new method for extending a thesaurus by adding taxonomic information automatically extracted …...
Language Identification for Person Names Based on Statistical Information
Language identification has been an interesting and fascinating issue in natural language processing for decades, and there have been many researches on it. However, most of the researches are for …...
Modeling Local Coherence: An Entity-Based Approach
This paper considers the problem of auto- matic assessment of local coherence. We present a novel entity-based representa- tion of discourse which is inspired by Cen- tering Theory and can …...
Non-Projective Dependency Parsing using Spanning Tree Algorithms
We formalize weighted dependency pars- ing as searching for maximum spanning trees (MSTs) in directed graphs. Using this representation, the parsing algorithm of Eisner (1996) is sufficient for search- ing …...
Recognising Textual Entailment with Logical Inference
We use logical inference techniques for recognising textual entailment. As the performance of theorem proving turns out to be highly dependent on not read- ily available background knowledge, we incorporate …...
Towards Robust High Performance Word Sense Disambiguation of English Verbs Using Rich Linguistic Features
. This paper shows that our WSD system using rich linguistic features achieved high accuracy in the classification of English SENSEVAL2 verbs for both fine-grained (64.6%) and coarse-grained (73.7%) senses. …...
Unsupervised Learning of Field Segmentation Models for Information Extraction
The applicability of many current information ex- traction techniques is severely limited by the need for supervised training data. We demonstrate that for certain field structured extraction tasks, such as …...
Using a Partially Annotated Corpus to Build a Dependency Parser for Japanese
. We explore the use of a partially annotated corpus to build a depen- dency parser for Japanese. We examine two types of partially annotated corpora. It is found that …...
A Bootstrapping Approach to Unsupervised Detection of Cue Phrase Variants
We investigate the unsupervised detection of semi-fixed cue phrases such as “This paper proposes a novel approach. . . 1” from unseen text, on the basis of only a handful …...
Acquiring Inference Rules with Temporal Constraints by Using Japanese Coordinated Sentences and Noun-Verb Co-occurrences
This paper shows that inference rules with temporal constraints can be acquired by us- ing verb-verb co-occurrences in Japanese coordinated sentences and verb-noun co- occurrences. For example, our unsuper- vised …...
Automatic Construction of Predicate-argument Structure Patterns for Biomedical Information Extraction
This paper presents a method of automat- ically constructing information extraction patterns on predicate-argument structures (PASs) obtained by full parsing from a smaller training corpus. Because PASs represent generalized structures …...
Automatic Target Word Disambiguation Using Syntactic Relationships
. Multiple target translations are due to several meanings of source words, and various target word equivalents depending on the context of the source word. Thus, an automated approach is …...
Classifying Speech Acts using Verbal Response Modes
The driving vision for our work is to provide intelligent, automated assistance to users in understanding the status of their email conversations. Our approach is to create tools that enable …...
Extremely Lexicalized Models for Accurate and Fast HPSG Parsing
This paper describes an extremely lexi- calized probabilistic model for fast and accurate HPSG parsing. In this model, the probabilities of parse trees are de- fined with only the probabilities …...
Inducing Temporal Graphs
We consider the problem of constructing a directed acyclic graph that encodes tem- poral relations found in a text. The unit of our analysis is a temporal segment, a frag- …...
Learning Information Status of Discourse Entities
In this paper we address the issue of au- tomatically assigning information status to discourse entities. Using an annotated cor- pus of conversational English and exploit- ing morpho-syntactic and lexical …...
Learning Morphological Disambiguation Rules for Turkish
In this paper, we present a rule based model for morphological disambiguation of Turkish. The rules are generated by a novel decision list learning algorithm us- ing supervised training. Morphological …...
Methods for Using Textual Entailment in Open-Domain Question Answering
Work on the semantics of questions has argued that the relation between a ques- tion and its answer(s) can be cast in terms of logical entailment. In this paper, we …...
Paraphrase Recognition via Dissimilarity Significance Classification
We propose a supervised, two-phase framework to address the problem of para- phrase recognition (PR). Unlike most PR systems that focus on sentence similarity, our framework detects dissimilarities be- tween …...
Paraphrasing for Automatic Evaluation
This paper studies the impact of para- phrases on the accuracy of automatic eval- uation. Given a reference sentence and a machine-generated sentence, we seek to find a paraphrase of …...
Research on Hypothesizing and Sorting the Eg Candidates in Chinese Semantic Parsing
. This paper introduced a semantic parsing model constructed above a symbolic system of concepts for understanding natural language. Based on the model a sentence can be mapped into the …...
Time Period Identification of Events in Text
This study aims at identifying when an event written in text occurs. In particular, we classify a sentence for an event into four time-slots; morning, daytime, eve- ning, and night. …...
Towards Robust Context-Sensitive Sentence Alignment for Monolingual Corpora
Aligning sentences belonging to compa- rable monolingual corpora has been sug- gested as a first step towards training text rewriting algorithms, for tasks such as summarization or paraphrasing. We present …...
Translation Context Sensitive WSD
While it is generally agreed that Word Sense Disambiguation (WSD) is an application-dependent task, the great majority of systems pursue application-independent approaches. We propose a strategy to support WSD for …...
CLaC and CLaC-NB: Knowledge-based and corpus-based approaches to sentiment tagging
For the Affective Text task at Semeval- 1/Senseval-4, the CLaC team compared a knowledge-based, domain-independent ap- proach and a standard, statistical machine learning approach to ternary sentiment an- notation of …...
Crystal: Analyzing Predictive Opinions on the Web
In this paper, we present an election predic- tion system (Crystal) based on web users’ opinions posted on an election prediction website. Given a prediction message, Crys- tal first identifies …...
Domain Adaptation with Active Learning for Word Sense Disambiguation
When a word sense disambiguation (WSD) system is trained on one domain but ap- plied to a different domain, a drop in ac- curacy is frequently observed. This high- lights …...
Extending a Thesaurus in the Pan-Chinese Context
In this paper, we address a unique problem in Chinese language processing and report on our study on extending a Chinese the- saurus with region-specific words, mostly from the financial …...
Fast Semantic Extraction Using a Novel Neural Network Architecture
We describe a novel neural network archi- tecture for the problem of semantic role la- beling. Many current solutions are compli- cated, consist of several stages and hand- built features, …...
FUH (FernUniversität in Hagen): Metonymy Recognition Using Different Kinds of Context for a Memory-Based Learner
For the metonymy resolution task SemEval-2007, the use of a memory-basedat learner to train classifiers for the identifica- tion of metonymic location names is inves- tigated. Metonymy is resolved on …...
Japanese Dependency Analysis Using the Ancestor-Descendant Relation
We propose a novel method for Japanese de- pendency analysis, which is usually reduced to the construction of a dependency tree. In deterministic approaches to this task, depen- dency trees …...
Learning Expressive Models for Word Sense Disambiguation
We present a novel approach to the word sense disambiguation problem which makes use of corpus-based evidence com- bined with background knowledge. Em- ploying an inductive logic programming algorithm, the …...
Learning Predictive Structures for Semantic Role Labeling of NomBank
This paper presents a novel application of Alternating Structure Optimization (ASO) to the task of Semantic Role Labeling (SRL) of noun predicates in NomBank. ASO is a recently proposed linear …...
Mandarin Part-of-Speech Tagging and Discriminative Reranking
We present in this paper methods to improve HMM-based part-of-speech (POS) tagging of Mandarin. We model the emission prob- ability of an unknown word using all the characters in the …...
Modelling Polysemy in Adjective Classes by Multi-Label Classification
This paper assesses the role of multi-label classification in modelling polysemy for lan- guage acquisition tasks. We focus on the ac- quisition of semantic classes for Catalan ad- jectives, and …...
Morphological Disambiguation of Hebrew: A Case Study in Classifier Combination
Morphological analysis and disambiguation are crucial stages in a variety of natural language processing applications, especially when languages with complex morphology are concerned. We present a system which disambiguates the …...
Movie Review Classification Based on a Multiple Classifier
. In this paper, we propose a method to classify movie review documents into positive or negative opinions. There are several approaches to classify documents. The previous studies, however, used …...
Semantic Class Induction and Coreference Resolution
This paper examines whether a learning- based coreference resolver can be improved using semantic class knowledge that is au- tomatically acquired from a version of the Penn Treebank in which …...
Structured Prediction Models via the Matrix-Tree Theorem
This paper provides an algorithmic frame- work for learning statistical models involv- ing directed spanning trees, or equivalently non-projective dependency structures. We show how partition functions and marginals for directed …...
UIUC: A Knowledge-rich Approach to Identifying Semantic Relations between Nominals
This paper describes a supervised, knowledge-intensive approach to the auto- matic identification of semantic relations between nominals in English sentences. The system employs different sets of new and previously used …...
UP13: Knowledge-poor Methods (Sometimes) Perform Poorly
This short paper presents a system developed at the Université Paris 13 for the Semeval 2007 Metonymy Resolution Task (task #08, location name track; see Markert and Nissim, 2007). The …...
UPAR7: A knowledge-based system for headline sentiment tagging
For the Affective Text task at SemEval- 2007, University Paris 7’s system first evaluates emotion and valence on all words of a news headline (using enriched versions of SentiWordNet and …...
USP-IBM-1 and USP-IBM-2: The ILP-based Systems for Lexical Sample WSD in SemEval-2007
We describe two systems participating of the English Lexical Sample task in SemEval- 2007. The systems make use of Inductive Logic Programming for supervised learning in two different ways: (a) …...
Why Doesn’t EM Find Good HMM POS-Taggers?
This paper investigates why the HMMs es- timated by Expectation-Maximization (EM) produce such poor results as Part-of-Speech (POS) taggers. We find that the HMMs es- timated by EM generally assign …...
A Joint Model of Text and Aspect Ratings for Sentiment Summarization
Online reviews are often accompanied with numerical ratings provided by users for a set of service or product aspects. We propose a statistical model which is able to discover corresponding …...
A Semantic Composition Method for Deriving Sense Representations of Determinative-Measure Compounds in E-HowNet
In this paper, we take Determinative-Measure Compounds as an example to demonstrate how the E-HowNet semantic composition mechanism works in deriving the sense representations for all determinative-measure (DM) compounds which …...
A Supervised Algorithm for Verb Disambiguation into VerbNet Classes
VerbNet (VN) is a major large-scale En- glish verb lexicon. Mapping verb instances to their VN classes has been proven use- ful for several NLP tasks. However, verbs are polysemous …...
A Tale of Two Parsers: Investigating and Combining Graph-based and Transition-based Dependency Parsing
Graph-based and transition-based approaches to dependency parsing adopt very different views of the problem, each view having its own strengths and limitations. We study both approaches under the framework of …...
All, and only, the Errors: more Complete and Consistent Spelling and OCR-Error Correction Evaluation
AbstractSome time in the future, some spelling error correction system will correct all the errors, and only the errors. We need evaluation metrics that will tell us when this has …...
Automatic induction of FrameNet lexical units
Most attempts to integrate FrameNet in NLP systems have so far failed because of its lim- ited coverage. In this paper, we investigate the applicability of distributional and WordNet- based …...
Construction of an Idiom Corpus and its Application to Idiom Identification based on WSD Incorporating Idiom-Specific Features
Some phrases can be interpreted either id- iomatically (figuratively) or literally in con- text, and the precise identification of idioms is indispensable for full-fledged natural lan- guage processing (NLP). To …...
Determining the Unithood of Word Sequences Using a Probabilistic Approach
Most research related to unithood were con- ducted as part of a larger effort for the deter- mination of termhood. Consequently, nov- elties are rare in this small sub-field of …...
Discriminative vs. Generative Approaches in Semantic Role Labeling
This paper describes the two algorithms we developed for the CoNLL 2008 Shared Task “Joint learning of syntactic and se- mantic dependencies”. Both algorithms start parsing the sentence using the …...
Hybrid Learning of Dependency Structures from Heterogeneous Linguistic Resources
In this paper we present our syntactic and semantic dependency parsing system par- ticipated in both closed and open compe- titions of the CoNLL 2008 Shared Task. By combining the …...
Inducing Gazetteers for Named Entity Recognition by Large-Scale Clustering of Dependency Relations
We propose using large-scale clustering of de- pendency relations between verbs and multi- word nouns (MNs) to construct a gazetteer for named entity recognition (NER). Since depen- dency relations capture …...
Jointly Combining Implicit Constraints Improves Temporal Ordering
Previous work on ordering events in text has typically focused on local pairwise decisions, ignoring globally inconsistent labels. How- ever, temporal ordering is the type of domain in which global …...
Large Scale Acquisition of Paraphrases for Learning Surface Patterns
Paraphrases have proved to be useful in many applications, including Machine Translation, Question Answering, Summarization, and In- formation Retrieval. Paraphrase acquisition methods that use a single monolingual corpus often produce …...
Learning to Rank Answers on Large Online QA Collections
This work describes an answer ranking engine for non-factoid questions built using a large online community-generated question-answer collection (Yahoo! Answers). We show how such collections may be used to effectively …...
Learning with Compositional Semantics as Structural Inference for Subsentential Sentiment Analysis
Determining the polarity of a sentiment- bearing expression requires more than a sim- ple bag-of-words approach. In particular, words or constituents within the expression can interact with each other to …...
LTAG Dependency Parsing with Bidirectional Incremental Construction
In this paper, we first introduce a new archi- tecture for parsing, bidirectional incremental parsing. We propose a novel algorithm for in- cremental construction, which can be applied to many …...
Name Origin Recognition Using Maximum Entropy Model and Diverse Features
Name origin recognition is to identify the source language of a personal or location name. Some early work used either rule- based or statistical methods with single knowledge source. In …...
Other-Anaphora Resolution in Biomedical Texts with Automatically Mined Patterns
This paper proposes an other-anaphora resolution approach in bio-medical texts. It utilizes automatically mined patterns to discover the semantic relation between an anaphor and a candidate antecedent. The knowledge from …...
Question Classification using Head Words and their Hypernyms
Question classification plays an important role in question answering. Features are the key to obtain an accurate question classifier. In con- trast to Li and Roth (2002)’s approach which makes …...
Resolving Personal Names in Email Using Context Expansion
This paper describes a computational ap- proach to resolving the true referent of a named mention of a person in the body of an email. A generative model of mention …...
Summarizing Emails with Conversational Cohesion and Subjectivity
In this paper, we study the problem of sum- marizing email conversations. We first build a sentence quotation graph that captures the conversation structure among emails. We adopt three cohesion …...
Task-oriented Evaluation of Syntactic Parsers and Their Representations
This paper presents a comparative evalua- tion of several state-of-the-art English parsers based on different frameworks. Our approach is to measure the impact of each parser when it is used …...
Two-Phased Event Relation Acquisition: Coupling the Relation-Oriented and Argument-Oriented Approaches
Addressing the task of acquiring semantic relations between events from a large cor- pus, we first argue the complementarity be- tween the pattern-based relation-oriented approach and the anchor-based argument- oriented …...
What’s the Date? High Accuracy Interpretation of Weekday Names
In this paper we present a study on the interpretation of weekday names in texts. Our algorithm for assigning a date to a weekday name achieves 95.91% accuracy on a …...
When Specialists and Generalists Work Together: Overcoming Domain Dependence in Sentiment Tagging
This study presents a novel approach to the problem of system portability across differ- ent domains: a sentiment annotation system that integrates a corpus-based classifier trained on a small set …...
A Cascade Approach to Extracting Medication Events
Information Extraction, from the electronic clinical record is a comparatively new topic for computational linguists. In order to utilize the records to improve the efficiency and quality of health care, …...
A Sentiment Detection Engine for Internet Stock Message Boards
Financial investors trade on the basis of infor- mation, and in particular, on the likelihood that a piece of information will impact the mar- ket. The ability to predict this …...
Bilingually-Constrained (Monolingual) Shift-Reduce Parsing
Jointly parsing two languages has been shown to improve accuracies on either or both sides. However, its search space is much bigger than the monolingual case, forcing existing approaches to …...
Coupling an Annotated Corpus and a Morphosyntactic Lexicon for State-of-the-Art POS Tagging with Less Human Effort
. This paper investigates how to best couple hand-annotated data with information extracted from an external lexical resource to improve POS tagging performance. Focusing on French tagging, we introduce a …...
EEG responds to conceptual stimuli and corpus semantics
Mitchell et al. (2008) demonstrated that corpus-extracted models of semantic knowledge can predict neural activation patterns recorded using fMRI. This could be a very powerful technique for evaluating conceptual models …...
Evaluation of Generic Relation Identification
Generic relation identification (GRI) aims to build models of relation-forming entity pairs that can be transferred across domains without modification of model parameters. GRI has high utility in terms of …...
Extracting Social Meaning: Identifying Interactional Style in Spoken Conversation
Automatically extracting social meaning and intention from spoken dialogue is an impor- tant task for dialogue systems and social com- puting. We describe a system for detecting elements of interactional …...
Faster parsing and supertagging model estimation
Parsers are often the bottleneck for data ac- quisition, processing text too slowly to be widely applied. One way to improve the efficiency of parsers is to construct more confident …...
Improving Dependency Parsing with Subtrees from Auto-Parsed Data
This paper presents a simple and effective approach to improve dependency parsing by using subtrees from auto-parsed data. First, we use a baseline parser to parse large-scale unannotated data. Then …...
It’s Not You, it’s Me: Detecting Flirting and its Misperception in Speed-Dates
Automatically detecting human social in- tentions from spoken conversation is an important task for dialogue understand- ing. Since the social intentions of the speaker may differ from what is perceived …...
Japanese Query Alteration Based on Lexical Semantic Similarity
We propose a unified approach to web search query alterations in Japanese that is not lim- ited to particular character types or ortho- graphic similarity between a query and its …...
Language-Independent Bilingual Terminology Extraction from a Multilingual Parallel Corpus
We present a language-pair independent terminology extraction module that is based on a sub-sentential alignment sys- tem that links linguistically motivated phrases in parallel texts. Statistical filters are applied on …...
Large Vocabulary Continuous Speech Recognition for Bulgarian
The paper presents the results of a project com- pleted by the authors for realizing a contin- uous speech recognition system for Bulgarian. The state-of-the-art speech recognition technol- ogy used …...
Large-Coverage Root Lexicon Extraction for Hindi
This paper describes a method using mor- phological rules and heuristics, for the au- tomatic extraction of large-coverage lexi- cons of stems and root word-forms from a raw text corpus. …...
Learning Phoneme Mappings for Transliteration without Parallel Data
We present a method for performing machine transliteration without any parallel resources. We frame the transliteration task as a deci- pherment problem and show that it is possi- ble to …...
Mining the Web for Reciprocal Relationships
In this paper we address the problem of identifying reciprocal relationships in English. In particular we introduce an algorithm that semi-automatically discovers patterns encod- ing reciprocity based on a set …...
Person Identification from Text and Speech Genre Samples
In this paper, we describe experiments con- ducted on identifying a person using a novel unique correlated corpus of text and audio samples of the person’s communication in six genres. …...
Polynomial to Linear: Efficient Classification with Conjunctive Features
This paper proposes a method that speeds up a classifier trained with many con- junctive features: combinations of (prim- itive) features. The key idea is to pre- compute as partial …...
Projecting Parameters for Multilingual Word Sense Disambiguation
We report in this paper a way of doing Word Sense Disambiguation (WSD) that has its ori- gin in multilingual MT and that is cognizant of the fact that parallel …...
Syntactic and Semantic Kernels for Short Text Pair Categorization
Automatic detection of general relations between short texts is a complex task that cannot be carried out only relying on lan- guage models and bag-of-words. There- fore, learning methods to …...
Voted Approach for Part of Speech Tagging in Bengali
. Part of Speech (POS) tagging is the task of labeling each word in a sentence with its appropriate syntactic category called part of speech. POS tagging is a very …...
WikiSense: Supersense Tagging of Wikipedia Named Entities Based WordNet
. In this paper, we introduce a minimally supervised method for learning to classify named-entity titles in a given encyclopedia into broad semantic categories in an existing ontology. Our main …...
A Probabilistic Morphological Analyzer for Syriac
We define a probabilistic morphological ana- lyzer using a data-driven approach for Syriac in order to facilitate the creation of an annotated corpus. Syriac is an under-resourced Semitic language for …...
A Semi-Supervised Approach to Improve Classification of Infrequent Discourse Relations Using Feature Vector Extension
Several recent discourse parsers have em- ployed fully-supervised machine learning ap- proaches. These methods require human an- notators to beforehand create an extensive training corpus, which is a time-consuming and …...
A Study of Information Retrieval Weighting Schemes for Sentiment Analysis
Most sentiment analysis approaches use as baseline a support vector machines (SVM) classifier with binary unigram weights. In this paper, we explore whether more sophisticated feature weighting schemes from Information …...
ADN-Classifier:Automatically Assigning Denotation Types to Nominalizations
AbstractThis paper presents the ADN-Classifier, an Automatic classification system of Spanish Deverbal Nominalizations aimed at identifying its semantic denotation (i.e. event, result, underspecified, or lexicalized). The classifier can be used …...
An Efficient Algorithm for Unsupervised Word Segmentation with Branching Entropy and MDL
This paper proposes a fast and simple unsuper- vised word segmentation algorithm that uti- lizes the local predictability of adjacent char- acter sequences, while searching for a least- effort representation …...
An Unsupervised Approach for Semantic Relation Interpretation
AbstractIn this work we propose a hybrid unsupervised approach for semantic relation extraction from Italian and English texts. The system takes as input pairs of ""distributionally similar"" terms, possibly involved …...
Arabic Word Segmentation for Better Unit of Analysis
AbstractThe Arabic language has a very rich morphology where a word is composed of zero or more prefixes, a stem and zero or more suffixes. This makes Arabic data sparse …...
AUTOLEX: An Automatic Lexicon Builder for Minority Languages Using an Open Corpus
: The aim of this study is to build natural language resources for languages with limited resources or minority languages. Manually building these resources is tedious and costly. These natural …...
Can Recognising Multiword Expressions Improve Shallow Parsing?
There is significant evidence in the literature that integrating knowledge about multiword expressions can improve shallow parsing ac- curacy. We present an experimental study to quantify this improvement, focusing on …...
Classification of Prosodic Events using Quantized Contour Modeling
We present Quantized Contour Modeling (QCM), a Bayesian approach to the classification of acoustic contours. We evaluate the performance of this tech- nique in the classification of prosodic events. We …...
Corpus Based Classification of Text in Australian Contracts
Written contracts are a fundamental framework for commercial and coopera- tive transactions and relationships. Lim- ited research has been published on the ap- plication of machine learning and natural language …...
Creating a Reusable English-Chinese Parallel Corpus for Bilingual Dictionary Construction
AbstractThis paper first describes an experiment to construct an English-Chinese parallel corpus, then applying the Uplug word alignment tool on the corpus and finally produce and evaluate an English-Chinese word …...
Creating Robust Supervised Classifiers via Web-Scale N-Gram Data
In this paper, we systematically assess the value of using web-scale N-gram data in state-of-the-art supervised NLP classifiers. We compare classifiers that include or ex- clude features for the counts …...
Detecting Emails Containing Requests for Action
Automatically finding email messages that contain requests for action can provide valu- able assistance to users who otherwise strug- gle to give appropriate attention to the ac- tionable tasks in …...
Detection of Users Suspected of Pretending to Be Other Users in a Community Site by Using Messages Submitted to Non-Target Categories
. Some users abuse the anonymity and disrupt communications in a community site. Authorship identification based on analyzing stylistic features of messages is effective in detecting these inadequate users. However, …...
Extracting Phrase Patterns with Minimum Redundancy for Unsupervised Speaker Role Classification
This paper addresses the problem of learning phrase patterns for unsupervised speaker role classification. Phrase patterns are automati- cally extracted from large corpora, and redun- dant patterns are removed via …...
Improving Information Extraction Using Knowledge Model
. This paper describes the work on automated Information Extraction that accepts arbitrary text and extracts information from the text. A new approach to implement Information Extraction system is proposed …...
Incorporating Extra-Linguistic Information into Reference Resolution in Collaborative Task Dialogue
This paper proposes an approach to ref- erence resolution in situated dialogues by exploiting extra-linguistic information. Recently, investigations of referential be- haviours involved in situations in the real world have …...
JU_CSE_TEMP: A First Step towards Evaluating Events, Time Expressions and Temporal Relations
Temporal information extraction is a popular and interesting research field in the area of Natural Language Processing (NLP). In this paper, we report our works on TempEval-2 shared task. This …...
Learning Arguments and Supertypes of Semantic Relations Using Recursive Patterns
A challenging problem in open informa- tion extraction and text mining is the learn- ing of the selectional restrictions of se- mantic relations. We propose a mini- mally supervised bootstrapping …...
Learning to Link Entities with Knowledge Base
This paper address the problem of entity link- ing. Specifically, given an entity mentioned in unstructured texts, the task is to link this entity with an entry stored in the …...
Learning to Mine Definitions from Slovene Structured and Unstructured Knowledge-Rich Resources
AbstractThe paper presents an innovative approach to extract Slovene definition candidates from domain-specific corpora using morphosyntactic patterns, automatic terminology recognition and semantic tagging with wordnet senses. First, a classification model …...
Learning to Predict Readability using Diverse Linguistic Features
In this paper we consider the problem of building a system to predict readability of natural-language documents. Our sys- tem is trained using diverse features based on syntax and language …...
Learning Translation Boundaries for Phrase-Based Decoding
Constrained decoding is of great importance not only for speed but also for translation qual- ity. Previous efforts explore soft syntactic con- straints which are based on constituent bound- aries …...
Lessons Learned in Part-of-Speech Tagging of Conversational Speech
This paper examines tagging models for spon- taneous English speech transcripts. We ana- lyze the performance of state-of-the-art tag- ging models, either generative or discrimi- native, left-to-right or bidirectional, with …...
POS Multi-tagging Based on Combined Models
AbstractIn the POS tagging task, there are two kinds of statistical models: one is generative model, such as the HMM, the others are discriminative models, such as the Maximum Entropy …...
Predicting the Semantic Compositionality of Prefix Verbs
In many applications, replacing a complex word form by its stem can reduce sparsity, re- vealing connections in the data that would not otherwise be apparent. In this paper, we …...
Recognition of Affect, Judgment, and Appreciation in Text
The main task we address in our research is classification of text using fine-grained attitude labels. The developed @AM sys- tem relies on the compositionality prin- ciple and a novel …...
The Acquisition of Imperfective Aspect Marking in Korean as a Second Language by Japanese Learners
. This paper investigates the developmental process through which L2 learners acquire two „imperfective‟ aspect markers in Korean, -ko iss- (progressive and resultative) and -a iss- (resultative) which attempts to …...
The Development of a Morphosyntactic Tagset for Afrikaans and its Use with Statistical Tagging
AbstractIn this paper, we present a morphosyntactic tagset for Afrikaans based on the guidelines developed by the Expert Advisory Group on Language Engineering Standards (EAGLES). We compare our slim yet …...
Top Accuracy and Fast Dependency Parsing is not a Contradiction
In addition to a high accuracy, short pars- ing and training times are the most impor- tant properties of a parser. However, pars- ing and training times are still relatively …...
Training Paradigms for Correcting Errors in Grammar and Usage
This paper proposes a novel approach to the problem of training classifiers to detect and correct grammar and usage errors in text by selectively introducing mistakes into the train- ing …...
Uptraining for Accurate Deterministic Question Parsing
It is well known that parsing accuracies drop significantly on out-of-domain data. What is less known is that some parsers suffer more from domain shifts than others. We show that …...
Using Smaller Constituents Rather Than Sentences in Active Learning for Japanese Dependency Parsing
We investigate active learning methods for Japanese dependency parsing. We propose active learning methods of using partial dependency relations in a given sentence for parsing and evaluate their effective- ness …...
Using Unknown Word Techniques to Learn Known Words
Unknown words are a hindrance to the perfor- mance of hand-crafted computational gram- mars of natural language. However, words with incomplete and incorrect lexical entries pose an even bigger problem …...
Viterbi Training Improves Unsupervised Dependency Parsing
We show that Viterbi (or “hard”) EM is well-suited to unsupervised grammar in- duction. It is more accurate than standard inside-outside re-estimation (classic EM), significantly faster, and simpler. Our ex- …...
A Fast and Accurate Method for Approximate String Search
This paper proposes a new method for ap- proximate string search, specifically candidate generation in spelling error correction, which is a task as follows. Given a misspelled word, the system …...
A Weakly-supervised Approach to Argumentative Zoning of Scientific Documents
Argumentative Zoning (AZ) – analysis of the argumentative structure of a scientific paper – has proved useful for a number of informa- tion access tasks. Current approaches to AZ rely …...
A word-based approach for diacritic restoration in Māori
This paper describes a supervised algorithm for diacritic restoration based on naive Bayes classifiers that act at word- level. Classifications are based on a rich set of features, extracted automatically …...
Age Prediction in Blogs: A Study of Style, Content, and Online Behavior in Pre- and Post-Social Media Generations
We investigate whether wording, stylistic choices, and online behavior can be used to predict the age category of blog authors. Our hypothesis is that significant changes in writing style distinguish …...
Automatic Grading of Evidence: the 2011 ALTA Shared Task
The ALTA shared tasks are programming competitions where all participants attempt to solve the same problem, and the winner is the system with the best results. The 2011 ALTA shared …...
Constructing Linguistically Motivated Structures from Statistical Grammars
This paper discusses two Hidden Markov Models (HMM) for linking linguistically motivated XTAG grammar and the auto- matically extracted LTAG used by MICA parser. The former grammar is a detailed …...
Exploiting Parse Structures for Native Language Identification
Attempts to profile authors according to their characteristics extracted from textual data, in- cluding native language, have drawn attention in recent years, via various machine learn- ing approaches utilising mostly …...
Joint Bilingual Sentiment Classification with Unlabeled Parallel Corpora
Most previous work on multilingual sentiment analysis has focused on methods to adapt sentiment resources from resource-rich languages to resource-poor languages. We present a novel approach for joint bilingual sentiment …...
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
Information extraction (IE) holds the promise of generating a large-scale knowledge base from the Web’s natural language text. Knowledge-based weak supervision, using structured data to heuristically label a training corpus, …...
Large-Scale Cross-Document Coreference Using Distributed Inference and Hierarchical Models
Cross-document coreference, the task of grouping all the mentions of each entity in a document collection, arises in information ex- traction and automated knowledge base con- struction. For large collections, …...
Learning Discriminative Projections for Text Similarity Measures
Traditional text similarity measures consider each term similar only to itself and do not model semantic relatedness of terms. We pro- pose a novel discriminative training method that projects the …...
Pause and Stop Labeling for Chinese Sentence Boundary Detection
The fuzziness of Chinese sentence boundary makes discourse analysis more challenging. Moreover, many articles posted on the Internet are even lack of punctuation marks. In this pa- per, we collect …...
Robust Disambiguation of Named Entities in Text
Disambiguating named entities in natural- language text maps mentions of ambiguous names onto canonical entities like people or places, registered in a knowledge base such as DBpedia or YAGO. This …...
Shift-Reduce CCG Parsing
CCGs are directly compatible with binary- branching bottom-up parsing algorithms, in particular CKY and shift-reduce algorithms. While the chart-based approach has been the dominant approach for CCG, the shift-reduce method …...
Underspecifying and Predicting Voice for Surface Realisation Ranking
This paper addresses a data-driven surface realisation model based on a large-scale re- versible grammar of German. We investigate the relationship between the surface realisa- tion performance and the character …...
Using Bilingual Parallel Corpora for Cross-Lingual Textual Entailment
This paper explores the use of bilingual par- allel corpora as a source of lexical knowl- edge for cross-lingual textual entailment. We claim that, in spite of the inherent difficul- …...
Using Large Monolingual and Bilingual Corpora to Improve Coordination Disambiguation
Resolving coordination ambiguity is a clas- sic hard problem. This paper looks at co- ordination disambiguation in complex noun phrases (NPs). Parsers trained on the Penn Treebank are reporting impressive …...
Using Second-order Vectors in a Knowledge-based Method for Acronym Disambiguation
In this paper, we introduce a knowledge-based method to disambiguate biomedical acronyms using second-order co-occurrence vectors. We create these vectors using information about a long-form obtained from the Unified Medical …...
A Corpus-based Study of the German Recipient Passive
AbstractIn this paper, we investigate the usage of a non-canonical German passive alternation for ditransitive verbs, the recipient passive, in naturally occuring corpus data. We propose a classifier that predicts …...
A Light Weight Stemmer in Kokborok
Started from the very beginning, Stemming has been playing significant roles in several Natural Language Processing Applications such as information retrieval (IR), machine translation (MT), morph analysis and deciding the …...
A Transition-Based System for Joint Part-of-Speech Tagging and Labeled Non-Projective Dependency Parsing
Most current dependency parsers presuppose that input words have been morphologically disambiguated using a part-of-speech tagger before parsing begins. We present a transition- based system for joint part-of-speech tagging and …...
Bilingual Lexicon Construction from Comparable Corpora via Dependency Mapping
Bilingual lexicon construction (BLC) from comparable corpora is based on the idea that bilingual similar words tend to occur in similar contexts, usually of words. This, however, introduces noise and …...
Constructing a Question Corpus for Textual Semantic Relations
AbstractFinding useful questions is a challenging task in Community Question Answering (CQA). There are two key issues need to be resolved: 1) what is a useful question to the given …...
Correction Detection and Error Type Selection as an ESL Educational Aid
We present a classifier that discriminates be- tween types of corrections made by teachers of English in student essays. We define a set of linguistically motivated feature templates for a …...
Cost and Benefit of Using WordNet Senses for Sentiment Analysis
AbstractTypically, accuracy is used to represent the performance of an NLP system. However, accuracy attainment is a function of investment in annotation. Typically, the more the amount and sophistication of …...
Cross-lingual Word Clusters for Direct Transfer of Linguistic Structure
It has been established that incorporating word cluster features derived from large unlabeled corpora can significantly improve prediction of linguistic structure. While previous work has focused primarily on English, we …...
Development and Testing of Transcription Software for a Southern Min Spoken Corpus
The usual challenges of transcribing spoken language are compounded for Southern Min (Taiwanese) because it lacks a generally accepted orthography. This study reports the development and testing of software tools …...
Efficient Discrimination Between Closely Related Languages
In this paper, we revisit the problem of language identification with the focus on proper discrimination between closely related languages. Strong similarities between certain languages make it very hard to …...
Entity Set Expansion using Interactive Topic Information
We propose a new method for entity set expan- sion that achieves highly accurate extraction by suppressing the effect of semantic drift; it requires a small amount of interactive infor- …...
Exploiting Reducibility in Unsupervised Dependency Parsing
The possibility of deleting a word from a sen- tence without violating its syntactic correct- ness belongs to traditionally known manifes- tations of syntactic dependency. We introduce a novel unsupervised …...
Harnessing the CRF Complexity with Domain-Specific Constraints. The Case of Morphosyntactic Tagging of a Highly Inflected Language
We describe a domain-specific method of adapting conditional random fields (CRFs) to mor- phosyntactic tagging of highly-inflectional languages. The solution involves extending CRFs with additional, position-wise restrictions on the output …...
Hello, Who is Calling?: Can Words Reveal the Social Nature of Conversations?
This study aims to infer the social nature of conversations from their content automat- ically. To place this work in context, our moti- vation stems from the need to understand …...
Identification of Manner in Bio-Events
AbstractDue to the rapid growth in the volume of biomedical literature, there is an increasing requirement for high-performance semantic search systems, which allow biologists to perform precise searches for events …...
JU_CSE_NLP: Language Independent Cross-lingual Textual Entailment System
This article presents the experiments car- ried out at Jadavpur University as part of the participation in Cross-lingual Textual Entailment for Content Synchronization (CLTE) of task 8 @ Semantic Evaluation …...
Learning Syntactic Categories Using Paradigmatic Representations of Word Context
We investigate paradigmatic representations of word context in the domain of unsupervised syntactic category acquisition. Paradigmatic representations of word context are based on potential substitutes of a word in contrast …...
Lexical Differences in Autobiographical Narratives from Schizophrenic Patients and Healthy Controls
We present a system for automatic identification of schizophrenic patients and healthy controls based on narratives the subjects recounted about emotional experiences in their own life. The focus of the …...
Native Tongues, Lost and Found: Resources and Empirical Evaluations in Native Language Identification
In this paper we present work on the task of Native Language Identification (NLI). We present an alternative corpus to the ICLE which has been used in most work up …...
NeoTag: a POS Tagger for Grammatical Neologism Detection
AbstractPOS Taggers typically fail to correctly tag grammatical neologisms: for known words, a tagger will only take known tags into account, and hence discard any possibility that the word is …...
Pattern Matching Refinements to Dictionary-Based Code-Switching Point Detection
This study presents the development and evaluation of pattern matching refinements (PMRs) to automatic code switching point (CSP) detection. With all PMRs, evaluation showed an accuracy of 94.51%. This is …...
Predicting Answer Location Using Shallow Semantic Analogical Reasoning in a Factoid Question Answering System
In this paper we report our work on a factoid question answering task that avoids named- entity recognition tool in the answer selection process. We use semantic analogical reason- ing …...
Relating Dominance of Dialogue Participants with their Verbal Intelligence Scores
AbstractIn this work we investigated whether there is a relationship between dominant behaviour of dialogue participants and their verbal intelligence. The analysis is based on a corpus containing 56 dialogues …...
Rule-Based Detection of Clausal Coordinate Ellipsis
AbstractWith our experiment, we show how we can detect and annotate clausal coordinate ellipsis with Constraint Grammar rules. We focus on such an elliptical structure in which there are two …...
Selecting Corpus-Semantic Models for Neurolinguistic Decoding
Neurosemantics aims to learn the mapping between concepts and the neural activity which they elicit during neuroimaging ex- periments. Different approaches have been used to represent individual concepts, but current …...
Sorting out the Most Confusing English Phrasal Verbs
In this paper, we investigate a full-fledged supervised machine learning framework for identifying English phrasal verbs in a given context. We concentrate on those that we de- fine as the …...
Stylometric Analysis of Scientific Articles
We present an approach to automatically re- cover hidden attributes of scientific articles, such as whether the author is a native English speaker, whether the author is a male or …...
The Best of Both Worlds – A Graph-based Completion Model for Transition-based Parsers
Transition-based dependency parsers are often forced to make attachment deci- sions at a point when only partial infor- mation about the relevant graph configu- ration is available. In this paper, …...
The Problem with Kappa
It is becoming clear that traditional evaluation measures used in Computational Linguistics (including Error Rates, Accuracy, Recall, Precision and F-measure) are of limited value for unbiased evaluation of systems, and …...
The Utility of Discourse Structure in Identifying Resolved Threads in Technical User Forums
Online discussion forums are a valuable means for users to resolve specific information needs, both interactively for the participants and statically for users who search/browse over historical thread data. However, …...
Towards a model of formal and informal address in English
Informal and formal (“T/V”) address in dia- logue is not distinguished overtly in mod- ern English, e.g. by pronoun choice like in many other languages such as French (“tu”/“vous”). Our …...
Towards Using EEG to Improve ASR Accuracy
We report on a pilot experiment to improve the per- formance of an automatic speech recognizer (ASR) by using a single-channel EEG signal to classify the speaker’s mental state as …...
UniDic for Early Middle Japanese: a Dictionary for Morphological Analysis of Classical Japanese
AbstractIn order to construct an annotated diachronic corpus of Japanese, we propose to create a new dictionary for morphological analysis of Early Middle Japanese (Classical Japanese) based on UniDic, a …...
ALTN: Word Alignment Features for Cross-lingual Textual Entailment
We present a supervised learning approach to cross-lingual textual entailment that explores statistical word alignment models to predict entailment relations between sentences writ- ten in different languages. Our approach is …...
Authorship Attribution of Micro-Messages
Work on authorship attribution has tradition- ally focused on long texts. In this work, we tackle the question of whether the author of a very short text can be successfully …...
Automatic Interpretation of the English Possessive
The English ’s possessive construction oc- curs frequently in text and can encode several different semantic relations; how- ever, it has received limited attention from the computational linguistics community. This …...
Breaking Out of Local Optima with Count Transforms and Model Recombination: A Study in Grammar Induction
Many statistical learning problems in NLP call for local model search methods. But accu- racy tends to suffer with current techniques, which often explore either too narrowly or too broadly: …...
bwbaugh : Hierarchical sentiment analysis with partial self-training
Using labeled Twitter training data from SemEval-2013, we train both a subjectivity classifier and a polarity classifier separately, and then combine the two into a single hier- archical classifier. Using …...
Dependency Language Models for Sentence Completion
Sentence completion is a challenging seman- tic modeling task in which models must choose the most appropriate word from a given set to complete a sentence. Although a variety of …...
Detecting Promotional Content in Wikipedia
This paper presents an approach for detecting promotional content in Wikipedia. By incor- porating stylometric features, including fea- tures based on n-gram and PCFG language models, we demonstrate improved accuracy …...
Dudley North visits North London: Learning When to Transliterate to Arabic
We report the results of our work on automat- ing the transliteration decision of named en- tities for English to Arabic machine trans- lation. We construct a classification-based framework to …...
Dynamic Feature Selection for Dependency Parsing
Feature computation and exhaustive search have significantly restricted the speed of graph-based dependency parsing. We propose a faster framework of dynamic feature selec- tion, where features are added sequentially as …...
IIRG: A Naive Approach to Evaluating Phrasal Semantics
This paper describes the IIRG 1 system en- tered in SemEval-2013, the 7th International Workshop on Semantic Evaluation. We partic- ipated in Task 5 Evaluating Phrasal Semantics. We have adopted …...
Joint Morphological and Syntactic Analysis for Richly Inflected Languages
AbstractJoint morphological and syntactic analysis has been proposed as a way of improving parsing accuracy for richly inflected languages. Starting from a transition-based model for joint part-of-speech tagging and dependency …...
Joint Parsing and Disfluency Detection in Linear Time
We introduce a novel method to jointly parse and detect disfluencies in spoken utterances. Our model can use arbitrary features for pars- ing sentences and adapt itself with out-of- domain …...
KLUE: Simple and robust methods for polarity classification
This paper describes our approach to the SemEval-2013 task on “Sentiment Analysis in Twitter”. We use simple bag-of-words mod- els, a freely available sentiment dictionary auto- matically extended with distributionally …...
Metaphor Identification as Interpretation
Automatic metaphor identification and inter- pretation in text have been traditionally con- sidered as two separate tasks in natural lan- guage processing (NLP) and addressed in- dividually within computational frameworks. …...
Microblog Entity Linking by Leveraging Extra Posts
Linking name mentions in microblog posts to a knowledge base, namely microblog entity linking, is useful for text mining tasks on mi- croblog. Entity linking in long text has been …...
Modelling Annotator Bias with Multi-task Gaussian Processes: An Application to Machine Translation Quality Estimation
Annotating linguistic data is often a com- plex, time consuming and expensive en- deavour. Even with strict annotation guidelines, human subjects often deviate in their analyses, each bringing different biases, …...
Morphological Analysis and Disambiguation for Dialectal Arabic
The many differences between Dialectal Ara- bic and Modern Standard Arabic (MSA) pose a challenge to the majority of Arabic natural language processing tools, which are designed for MSA. In …...
Philosophers are Mortal: Inferring the Truth of Unseen Facts
Large databases of facts are prevalent in many applications. Such databases are accurate, but as they broaden their scope they become increasingly incomplete. In contrast to extending such a database, …...
Temporal Relation Classification in Persian and English contexts
This paper introduces the first pattern-based Persian Temporal Relation Classifier (PTRC) that finds the type of temporal relations between pairs of events in the Persian texts. The proposed system uses …...
The Haves and the Have-Nots: Leveraging Unlabelled Corpora for Sentiment Analysis
Expensive feature engineering based on WordNet senses has been shown be useful for document level sentimentto classification. A plausible reason for such a performance improvement is the reduction in data …...
Ubertagging: Joint Segmentation and Supertagging for English
A precise syntacto-semantic analysis of En- glish requires a large detailed lexicon with the possibility of treating multiple tokens as a sin- gle meaning-bearing unit, a word-with-spaces. However parsing with …...
UNAL: Discriminating between Literal and Figurative Phrasal Usage Using Distributional Statistics and POS tags
In this paper we describe the system used to participate in the sub task 5b in the Phrasal Se- mantics challenge (task 5) in SemEval 2013. This sub task consists …...
UNITOR-CORE_TYPED: Combining Text Similarity and Semantic Filters through SV Regression
This paper presents the UNITOR system that participated in the *SEM 2013 shared task on Semantic Textual Similarity (STS). The task is modeled as a Support Vector (SV) regression problem, …...
Unsupervised Induction of Contingent Event Pairs from Film Scenes
Human engagement in narrative is partially driven by reasoning about discourse relations between narrative events, and the expectations about what is likely to happen next that results from such reasoning. …...
Use of Combined Topic Models in Unsupervised Domain Adaptation for Word Sense Disambiguation
Topic models can be used in an unsuper- vised domain adaptation for Word Sense Disambiguation (WSD). In the domain adaptation task, three types of topic mod- els are available: (1) …...
Using a Weighted Semantic Network for Lexical Semantic Relatedness
The measurement of semantic relatedness between two words is an important met- ric for many natural language processing applications. In this paper, we present a novel approach for measuring semantic …...
Using Paraphrases and Lexical Semantics to Improve the Accuracy and the Robustness of Supervised Models in Situated Dialogue Systems
This paper explores to what extent lemmati- sation, lexical resources, distributional seman- tics and paraphrases can increase the accuracy of supervised models for dialogue manage- ment. The results suggest that …...
Using Pivot-Based Paraphrasing and Sentiment Profiles to Improve a Subjectivity Lexicon for Essay Data
AbstractWe demonstrate a method of improving a seed sentiment lexicon developed on essay data by using a pivot-based paraphrasing system for lexical expansion coupled with sentiment profile enrichment using crowdsourcing. …...
USNA: A Dual-Classifier Approach to Contextual Sentiment Analysis
This paper describes a dual-classifier ap- proach to contextual sentiment analysis at the SemEval-2013 Task 2. Contextual analysis of polarity focuses on a word or phrase, rather than the broader …...
Where Not to Eat? Improving Public Policy by Predicting Hygiene Inspections Using Online Reviews
This paper offers an approach for governments to harness the information contained in social media in order to make public inspections and disclosure more efficient. As a case study, we …...
A Large Scale Database of Strongly-related Events in Japanese
AbstractThe knowledge about the relation between events is quite useful for coreference resolution, anaphora resolution, and several NLP applications such as dialogue system. This paper presents a large scale database …...
A Linear-Time Bottom-Up Discourse Parser with Constraints and Post-Editing
Text-level discourse parsing remains a challenge. The current state-of-the-art overall accuracy in relation assignment is 55.73%, achieved by Joty et al. (2013). However, their model has a high order of …...
A Model of Individual Differences in Gaze Control During Reading
We develop a statistical model of saccadic eye movements during reading of isolated sentences. The model is focused on rep- resenting individual differences between readers and supports the inference of …...
A Tagged Corpus and a Tagger for Urdu
AbstractIn this paper, we describe a release of a sizeable monolingual Urdu corpus automatically tagged with part-of-speech tags. We extend the work of Jawaid and Bojar (2012) who use three …...
An open source part-of-speech tagger for Norwegian: Building on existing language resources
AbstractThis paper presents an open source part-of-speech tagger for the Norwegian language. It describes how an existing language processing library (FreeLing) was used to build a new part-of-speech tagger for …...
Augmenting English Adjective Senses with Supersenses
AbstractWe develop a supersense taxonomy for adjectives, based on that of GermaNet, and apply it to English adjectives in WordNet using human annotation and supervised classification. Results show that accuracy …...
Automatic Detection of Document Organizational Structure from Visual and Lexical Markers (Détection automatique de la structure organisationnelle de documents à partir de marqueurs visuels et lexicaux) [in French]
. The process of understanding a document uses both visual, logic and discursive information along with the mutual relationships between those levels. Most approaches studying those relationships were conducted in …...
Automatic Prediction of Aesthetics and Interestingness of Text Passages
This paper investigates the problem of automated text aesthetics prediction. The avail- ability of user generated content and ratings, e.g. Flickr, has induced research in aesthet- ics prediction for non-text …...
Bilingual Dictionary Induction as an Optimization Problem
AbstractBilingual dictionaries are vital in many areas of natural language processing, but such resources are rarely available for lower-density language pairs, especially for those that are closely related. Pivot-based induction …...
Cipher Type Detection
Manual analysis and decryption of enci- phered documents is a tedious and error prone work. Often—even after spend- ing large amounts of time on a par- ticular cipher—no decipherment can …...
CNRC-TMT: Second Language Writing Assistant System Description
We describe the system entered by the National Research Council Canada in the SemEval-2014 L2 writing assistant task. Our system relies on a standard Phrase-Based Statistical Machine Transla- tion trained …...
Combining Natural and Artificial Examples to Improve Implicit Discourse Relation Identification
This paper presents the first experiments on identifying implicit discourse relations (i.e., relations lacking an overt discourse connective) in French. Given the little amount of annotated data for this task, …...
Comparing Multi-label Classification with Reinforcement Learning for Summarisation of Time-series Data
We present a novel approach for automatic report generation from time-series data, in the context of student feedback genera- tion. Our proposed methodology treats content selection as a multi-label (ML) …...
Conversational Strategies for Robustly Managing Dialog in Public Spaces
Open environments present an attention management challenge for conversational systems. We describe a kiosk system (based on Ravenclaw–Olympus) that uses simple auditory and visual information to interpret human presence and …...
Crowdsourcing for the identification of event nominals: an experiment
AbstractThis paper presents the design and results of a crowdsourcing experiment on the recognition of Italian event nominals. The aim of the experiment was to assess the feasibility of crowdsourcing …...
Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts
Sentiment analysis of short texts such as single sentences and Twitter messages is challenging because of the limited contextual information that they normally contain. Effectively solving this task requires strategies …...
Detecting Learner Errors in the Choice of Content Words Using Compositional Distributional Semantics
We describe a novel approach to error detection in adjective–noun combinations. We present and release a new dataset of annotated errors where the examples are extracted from learner texts and …...
Enriching Wikipedia’s Intra-language Links by their Cross-language Transfer
Although hyperlinks enhance the utility of Wikipedia, embedding them in articles imposes a burden on contributors. To alleviate this burden as well as enrich hyperlinks in Wikipedia articles, we propose …...
Extraction of Daily Changing Words for Question Answering
AbstractThis paper proposes a method for extracting Daily Changing Words (DCWs), words that indicate which questions are real-time dependent. Our approach is based on two types of template matching using …...
Finding Good Enough: A Task-Based Evaluation of Query Biased Summarization for Cross-Language Information Retrieval
In this paper we present our task-based evaluation of query biased summarization for cross-language information retrieval (CLIR) using relevance prediction. We de- scribe our 13 summarization methods each from one …...
FLORS: Fast and Simple Domain Adaptation for Part-of-Speech Tagging
AbstractWe present FLORS, a new part-of-speech tagger for domain adaptation. FLORS uses robust representations that work especially well for unknown words and for known words with unseen tags. FLORS is …...
Hybrid Approach to Zero Subject Resolution for multilingual MT - Spanish-to-KoreanCases -
The current paper proposes a novel approach to Spanish zero pronoun resolution in the context of Spanish to Korean Machine Translation (MT). Spanish is one of the well-known 'pro-drop' languages …...
Identifier les relations discursives implicites en combinant données naturelles et données artificielles [Identifying implicit discourse relations by combining natural and artificial data]
. This paper presents the first experiments on French in automatic identification of implicit discourse relations (i.e. relations that lack an overt connective). Our systems exploit hand-labeled implicit examples, along …...
IITP: A Supervised Approach for Disorder Mention Detection and Disambiguation
In this paper we briefly describe our super- vised machine learning approach for dis- order mention detection system that we submitted as part of our participation in the SemEval-2014 Shared …...
IITP: Supervised Machine Learning for Aspect based Sentiment Analysis
The shared task on Aspect based Senti- ment Analysis primarily focuses on mining relevant information from the thousands of online reviews available for a popular product or service. In this …...
Improving Open Relation Extraction via Sentence Re-Structuring
AbstractInformation Extraction is an important task in Natural Language Processing, consisting of finding a structured representation for the information expressed in natural language text. Two key steps in information extraction …...
Joint Inference and Disambiguation of Implicit Sentiments via Implicature Constraints
This paper addresses implicit opinions expressed via inference over explicit sentiments and events that positively/negatively affect entities (goodFor/badFor, gfbf events). We incorporate the inferences developed by implicature rules into an …...
Knowledge Graph and Text Jointly Embedding
We examine the embedding approach to reason new relational facts from a large- scale knowledge graph and a text corpus. We propose a novel method of jointly em- bedding entities …...
KUNLPLab:Sentiment Analysis on Twitter Data
This paper presents the system submitted by KUNLPLab for SemEval-2014 Task9 - Subtask B: Message Polarity on Twitter data. Lexicon features and bag-of-words features are mainly used to represent the …...
Learning to Solve Arithmetic Word Problems with Verb Categorization
This paper presents a novel approach to learning to solve simple arithmetic word problems. Our system, ARIS, analyzes each of the sentences in the problem state- ment to identify the …...
Meta-Classifiers Easily Improve Commercial Sentiment Detection Tools
AbstractIn this paper, we analyze the quality of several commercial tools for sentiment detection. All tools are tested on nearly 30,000 short texts from various sources, such as tweets, news, …...
Minimally Supervised Classification to Semantic Categories using Automatically Acquired Symmetric Patterns
Classifying nouns into semantic categories (e.g., animals, food) is an important line of research in both cognitive science and natural language processing. We present a minimally supervised model for noun …...
Modeling Biological Processes for Reading Comprehension
Machine reading calls for programs that read and understand text, but most current work only attempts to extract facts from redundant web-scale corpora. In this pa- per, we focus on …...
Modeling Newswire Events using Neural Networks for Anomaly Detection
Automatically identifying anomalous newswire events is a hard problem. We discuss the com- plexity of the problem and introduce a novel technique to model events based on recursive neural networks …...
Modeling the Use of Graffiti Style Features to Signal Social Relations within a Multi-Domain Learning Paradigm
In this paper, we present a series of experiments in which we analyze the usage of graffiti style features for signaling personal gang identification in a large, online street gangs …...
Modelling Irony in Twitter: Feature Analysis and Evaluation
AbstractIrony, a creative use of language, has received scarce attention from the computational linguistics research point of view. We propose an automatic system capable of detecting irony with good accuracy …...
Morphological Analysis for Japanese Noisy Text based on Character-level and Word-level Normalization
Social media texts are often written in a non-standard style and include many lexical variants such as insertions, phonetic substitutions, abbreviations that mimic spoken language. The nor- malization of such …...
On the Use of Speech Recognition Techniques to Identify Bird Species
Wild bird watching has become a popular leisure activity in recent years. Very often, people can see birds or hear their sounds, but have no idea what kind of bird …...
Predicting Dialect Variation in Immigrant Contexts Using Light Verb Constructions
Languages spoken by immigrants change due to contact with the local languages. Capturing these changes is problematic for current language technologies, which are typically developed for speakers of the standard …...
Randomized Significance Tests in Machine Translation
Randomized methods of significance test- ing enable estimation of the probability that an increase in score has occurred sim- ply by chance. In this paper, we examine the accuracy of …...
Reconstructing Native Language Typology from Foreign Language Usage
Linguists and psychologists have long been studying cross-linguistic transfer, the influence of native language properties on linguistic performance in a foreign lan- guage. In this work we provide empirical evidence …...
ReNew: A Semi-Supervised Framework for Generating Domain-Specific Lexicons and Sentiment Analysis
The sentiment captured in opinionated text provides interesting and valuable informa- tion for social media services. However, due to the complexity and diversity of linguistic representations, it is challeng- ing …...
Resolving Referring Expressions in Conversational Dialogs for Natural User Interfaces
Unlike traditional over-the-phone spoken dialog systems (SDSs), modern dialog systems tend to have visual rendering on the device screen as an additional modal- ity to communicate the system’s response to …...
Resolving Shell Nouns
Shell nouns, such as fact and problem, oc- cur frequently in all kinds of texts. These nouns themselves are unspecific, and can only be interpreted together with the shell content. …...
Semi-supervised learning of morphological paradigms and lexicons
We present a semi-supervised approach to the problem of paradigm induction from inflection tables. Our system ex- tracts generalizations from inflection ta- bles, representing the resulting paradigms in an abstract …...
ShrdLite: Semantic Parsing Using a Handmade Grammar
This paper describes my approach for parsing robot commands, which was task 6 at SemEval 2014. My solution is to manually create a compact unifica- tion grammar. The grammar is …...
Supervised Methods for Aspect-Based Sentiment Analysis
In this paper, we present our contribution in SemEval2014 ABSA task, some supervised methods for Aspect-Based Sentiment Analysis of restaurant and laptop reviews are proposed, im- plemented and evaluated. We …...
The Meaning Factory: Formal Semantics for Recognizing Textual Entailment and Determining Semantic Similarity
Shared Task 1 of SemEval-2014 com- prised two subtasks on the same dataset of sentence pairs: recognizing textual en- tailment and determining textual similar- ity. We used an existing system …...
Turkish Treebank as a Gold Standard for Morphological Disambiguation and Its Influence on Parsing
AbstractSo far predicted scenarios for Turkish dependency parsing have used a morphological disambiguator that is trained on the data distributed with the tool(Sak et al., 2008). Although models trained on …...
Unsupervised Instance-Based Part of Speech Induction Using Probable Substitutes
We develop an instance (token) based extension of the state of the art word (type) based part-of- speech induction system introduced in (Yatbaz et al., 2012). Each word instance is …...
Using Spreading Activation to Evaluate and Improve Ontologies
In this paper, we explore the relationship between the human-encoded semantics of ontologies and their application to natural language processing (NLP) tasks, such as word-sense disambig- uation (WSD), for which …...
Using Structured Events to Predict Stock Price Movement: An Empirical Investigation
It has been shown that news events influ- ence the trends of stock price movements. However, previous work on news-driven stock market prediction rely on shallow features (such as bags-of-words, …...
What Can We Get From 1000 Tokens? A Case Study of Multilingual POS Tagging For Resource-Poor Languages
In this paper we address the problem of multilingual part-of-speech tagging for resource-poor languages. We use par- allel data to transfer part-of-speech in- formation from resource-rich to resource- poor languages. …...
Zero-shot Entity Extraction from Web Pages
In order to extract entities of a fine-grained category from semi-structured data in web pages, existing information extraction sys- tems rely on seed examples or redundancy across multiple web pages. …...
A Comparison of Word Similarity Performance Using Explanatory and Non-explanatory Texts
Vectorial representations of words derived from large current events datasets have been shown to perform well on word similarity tasks. This paper shows vectorial representa- tions derived from substantially smaller …...
A distributed inflection model for translating into morphologically rich languages
Lexical sparsity is a major challenge for machine translation into morphologically rich lan- guages. We address this problem by modeling sequences of fine-grained morphological tags in a bilingual context. To …...
A Methodology for Word Sense Disambiguation at 90% based on large-scale CrowdSourcing
Word Sense Disambiguation has been stuck for many years. In this paper we explore the use of large-scale crowdsourcing to cluster senses that are often confused by non-expert annotators. We …...
A Tableau Prover for Natural Logic and Language
Modeling the entailment relation over sen- tences is one of the generic problems of natural language understanding. In or- der to account for this problem, we de- sign a theorem …...
AIDA2: A Hybrid Approach for Token and Sentence Level Dialect Identification in Arabic
In this paper, we present a hybrid approach for performing token and sentence levels Dialect Identification in Arabic. Specifi- cally we try to identify whether each to- ken in a …...
Al-Bayan: A Knowledge-based System for Arabic Answer Selection
This paper describes Al-Bayan team participa- tion in SemEval-2015 Task 3, Subtask A. Task 3 targets semantic solutions for answer selec- tion in community question answering systems. We propose a …...
Automatic recognition of habituals: a three-way classification of clausal aspect
This paper provides the first fully au- tomatic approach for classifying clauses with respect to their aspectual properties as habitual, episodic or static. We bring together two strands of previous …...
Can Symbol Grounding Improve Low-Level NLP? Word Segmentation as a Case Study
We propose a novel framework for im- proving a word segmenter using informa- tion acquired from symbol grounding. We generate a term dictionary in three steps: generating a pseudo-stochastically seg- …...
Design of a Learner Corpus for Listening and Speaking Performance
A learner corpus is a useful resource for developing automatic assessment techniques for implementation in a computer-assisted language learning system. However, presently, learner corpora are only helpful in terms of …...
Exploring Markov Logic Networks for Question Answering
Elementary-level science exams pose sig- nificant knowledge acquisition and rea- soning challenges for automatic question answering. We develop a system that rea- sons with knowledge derived from text- books, represented …...
Extracting Human Temporal Orientation from Facebook Language
People vary widely in their temporal orientation—how often they emphasize the past, present, and future—and this affects their finances, health, and happiness. Traditionally, temporal orientation has been assessed by self-report …...
Graph-based Coherence Modeling For Assessing Readability
Readability depends on many factors rang- ing from shallow features like word length to semantic ones like coherence. We intro- duce novel graph-based coherence features based on frequent subgraphs and …...
Improving Arabic Diacritization through Syntactic Analysis
We present an approach to Arabic auto- matic diacritization that integrates syntac- tic analysis with morphological tagging through improving the prediction of case and state features. Our best system in- …...
Improving Word Sense Disambiguation with Linguistic Knowledge from a Sense Annotated Treebank
In this paper we present an approach for the enrichment of WSD knowledge bases with data-driven relations from a gold standard corpus (annotated with word senses, valency information, syntactic analyses, …...
Large-scale Dictionary Construction via Pivot-based Statistical Machine Translation with Significance Pruning and Neural Network Features
We present our ongoing work on large-scale Japanese-Chinese bilingual dictionary con- struction via pivot-based statistical machine translation. We utilize statistical significance pruning to control noisy translation pairs that are induced …...
Learn to Solve Algebra Word Problems Using Quadratic Programming
This paper presents a new algorithm to automatically solve algebra word prob- lems. Our algorithm solves a word prob- lem via analyzing a hypothesis space con- taining all possible equation …...
Learning Sentence Ordering for Opinion Generation of Debate
We propose a sentence ordering method to help compose persuasive opinions for debat- ing. In debate texts, support of an opinion such as evidence and reason typically follows the main …...
Learning the Impact and Behavior of Syntactic Structure: A Case Study in Semantic Textual Similarity
We present a case study on the role of syn- tactic structures towards resolving the Se- mantic Textual Similarity (STS) task. Al- though various approaches have been pro- posed, the …...
Model Selection for Type-Supervised Learning with Application to POS Tagging
Model selection (picking, for example, the feature set and the regularization strength) is crucial for building high-accuracy NLP models. In supervised learning, we can es- timate the accuracy of a …...
Molding CNNs for text: non-linear, non-consecutive convolutions
The success of deep learning often de- rives from well-chosen operational build- ing blocks. In this work, we revise the temporal convolution operation in CNNs to better adapt it to …...
Motivating Personality-aware Machine Translation
Language use is known to be influenced by personality traits as well as by socio- demographic characteristics such as age or mother tongue. As a result, it is possible to …...
Name List Only? Target Entity Disambiguation in Short Texts
Target entity disambiguation (TED), the task of identifying target entities of the same domain, has been recognized as a critical step in various important applica- tions. In this paper, we …...
Part-of-speech Taggers for Low-resource Languages using CCA Features
In this paper, we address the challenge of creating accurate and robust part- of-speech taggers for low-resource lan- guages. We propose a method that lever- ages existing parallel data between …...
POS Tagging for Arabic Tweets
Part-of-Speech (POS) tagging is a key step in many NLP algorithms. However, tweets are difficult to POS tag because there are many phenomena that frequently appear in Twitter that are …...
Reordering Grammar Induction
We present a novel approach for unsu- pervised induction of a Reordering Gram- mar using a modified form of permuta- tion trees (Zhang and Gildea, 2007), which we apply to …...
SemEval-2015 Task 14: Analysis of Clinical Text
We describe two tasks—named entity recog- nition (Task 1) and template slot filling (Task 2)—for clinical texts. The tasks leverage an- notations from the ShARe corpus, which con- sists of …...
Semi-supervised Dependency Parsing using Bilexical Contextual Features from Auto-Parsed Data
We present a semi-supervised approach to improve dependency parsing accuracy by using bilexical statistics derived from auto-parsed data. The method is based on estimating the attachment potential of head-modifier words, …...
Semi-Supervised Word Sense Disambiguation Using Word Embeddings in General and Specific Domains
One of the weaknesses of current supervised word sense disambiguation (WSD) systems is that they only treat a word as a discrete en- tity. However, a continuous-space represen- tation of …...
Sentiue: Target and Aspect based Sentiment Analysis in SemEval-2015 Task 12
This paper describes our participation in SemEval-2015 Task 12, and the opinion min- ing system sentiue. The general idea is that systems must determine the polarity of the sentiment expressed …...
SLSA: A Sentiment Lexicon for Standard Arabic
Sentiment analysis has been a major area of interest, for which the existence of high- quality resources is crucial. In Arabic, there is a reasonable number of sentiment lexicons but …...
Solving Geometry Problems: Combining Text and Diagram Interpretation
This paper introduces GEOS, the first au- tomated system to solve unaltered SAT ge- ometry questions by combining text un- derstanding and diagram interpretation. We model the problem of understanding …...
Spelling Correction of User Search Queries through Statistical Machine Translation
We use character-based statistical machine translation in order to correct user search queries in the e-commerce domain. The training data is automatically extracted from event logs where users re-issue their …...
Statistical Sandhi Splitter and its Effect on NLP Applications
This paper revisits the work of (Kuncham et al., 2015) which developed a statistical sandhi splitter (SSS) for agglutinative languages that was tested for Telugu and Malayalam lan- guages. Handling …...
Syntactic Parse Fusion
Model combination techniques have con- sistently shown state-of-the-art perfor- mance across multiple tasks, including syntactic parsing. However, they dramat- ically increase runtime and can be diffi- cult to employ in …...
Topic Model for Identifying Suicidal Ideation in Chinese Microblog
Suicide is one of major public health problems worldwide. Traditionally, suicidal ideation is assessed by surveys or interviews, which lacks of a real-time assessment of personal men- tal state. Online …...
Traversing Knowledge Graphs in Vector Space
Path queries on a knowledge graph can be used to answer compositional ques- tions such as “What languages are spoken by people living in Lisbon?”. However, knowledge graphs often have …...
Word Transformation Heuristics Agains Lexicons for Cognate Detection
One of the most common lexical transfor- mations between cognates in French and English is the presence or absence of a ter- minal “e”. However, many other transfor- mations exist, …...
Zero Object Resolution in Korean
Korean is one of the well-known „pro-drop‟ languages. When translating Korean zero object into languages in which objects have to be overtly expressed, the resolution of zero object is …...
“All I know about politics is what I read in Twitter”: Weakly Supervised Models for Extracting Politicians’ Stances From Twitter
AbstractDuring the 2016 United States presidential election, politicians have increasingly used Twitter to express their beliefs, stances on current political issues, and reactions concerning national and international events. Given the …...
A Japanese Chess Commentary Corpus
AbstractIn recent years there has been a surge of interest in the natural language prosessing related to the real world, such as symbol grounding, language generation, and nonlinguistic data search …...
A Neural Lemmatizer for Bengali
AbstractWe propose a novel neural lemmatization model which is language independent and supervised in nature. To handle the words in a neural framework, word embedding technique is used to represent …...
A Neural Network Architecture for Multilingual Punctuation Generation
Even syntactically correct sentences are per- ceived as awkward if they do not contain cor- rect punctuation. Still, the problem of au- tomatic generation of punctuation marks has been largely …...
A Paraphrase and Semantic Similarity Detection System for User Generated Short-Text Content on Microblogs
AbstractExisting systems deliver high accuracy and F1-scores for detecting paraphrase and semantic similarity on traditional clean-text corpus. For instance, on the clean-text Microsoft Paraphrase benchmark database, the existing systems attain …...
A Semi-Supervised Approach for Gender Identification
AbstractIn most of the research studies on Author Profiling, large quantities of correctly labeled data are used to train the models. However, this does not reflect the reality in forensic …...
AFET: Automatic Fine-Grained Entity Typing by Hierarchical Partial-Label Embedding
Distant supervision has been widely used in current systems of fine-grained entity typ- ing to automatically assign categories (en- tity types) to entity mentions. However, the types so obtained from …...
An Effect of Background Population Sample Size on the Performance of a Likelihood Ratio-based Forensic Text Comparison System: A Monte Carlo Simulation with Gaussian Mixture Model
This is a Monte Carlo simulation-based study that explores the effect of the sample size of the background database on a likelihood ratio (LR)-based forensic text comparison (FTC) system built …...
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
AbstractThe success of long short-term memory (LSTM) neural networks in language processing is typically attributed to their ability to capture long-distance statistical regularities. Linguistic regularities are often sensitive to syntactic …...
Assessing the Potential of Metaphoricity of verbs using corpus data
AbstractThe paper investigates the relation between metaphoricity and distributional characteristics of verbs, introducing POM, a corpus-derived index that can be used to define the upper bound of metaphoricity of any …...
Automatic Prediction of Linguistic Decline in Writings of Subjects with Degenerative Dementia
Given the limited success of medication in re- versing the effects of Alzheimer’s and other dementias, a lot of the neuroscience research has been focused on early detection, in order …...
Bad Company—Neighborhoods in Neural Embedding Spaces Considered Harmful
AbstractWe assess the reliability and accuracy of (neural) word embeddings for both modern and historical English and German. Our research provides deeper insights into the empirically justified choice of optimal …...
Bilbo-Val: Automatic Identification of Bibliographical Zone in Papers
AbstractIn this paper, we present the automatic annotation of bibliographical references’ zone in papers and articles of XML/TEI format. Our work is applied through two phases: first, we use machine …...
Building an Evaluation Scale using Item Response Theory
Evaluation of NLP methods requires test- ing against a previously vetted gold-standard test set and reporting standard metrics (ac- curacy/precision/recall/F1). The current as- sumption is that all items in a …...
CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases
How can we enable computers to automat- ically answer questions like “Who created the character Harry Potter”? Carefully built knowledge bases provide rich sources of facts. However, it remains a …...
Compositional Learning of Embeddings for Relation Paths in Knowledge Base and Text
Modeling relation paths has offered sig- nificant gains in embedding models for knowledge base (KB) completion. How- ever, enumerating paths between two en- tities is very expensive, and existing ap- …...
Convolutional Neural Networks vs. Convolution Kernels: Feature Engineering for Answer Sentence Reranking
In this paper, we study, compare and combine two state-of-the-art approaches to automatic feature engineering: Convolution Tree Ker- nels (CTKs) and Convolutional Neural Net- works (CNNs) for learning to rank …...
Detecting Word Usage Errors in Chinese Sentences for Learning Chinese as a Foreign Language
AbstractAutomated grammatical error detection, which helps users improve their writing, is an important application in NLP. Recently more and more people are learning Chinese, and an automated error detection system …...
Differentia compositionem facit. A Slower-Paced and Reliable Parser for Latin
AbstractThe Index Thomisticus Treebank is the largest available treebank for Latin; it contains Medieval Latin texts by Thomas Aquinas. After experimenting on its data with a number of dependency parsers …...
Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States
AbstractTransition-based approaches based on local classification are attractive for dependency parsing due to their simplicity and speed, despite producing results slightly below the state-of-the-art. In this paper, we propose a …...
Emergent: a novel data-set for stance classification
We present Emergent, a novel data-set de- rived from a digital journalism project for ru- mour debunking. The data-set contains 300 rumoured claims and 2,595 associated news articles, collected and …...
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
State-of-the-art sequence labeling systems traditionally require large amounts of task- specific knowledge in the form of hand- crafted features and data pre-processing. In this paper, we introduce a novel neu- …...
Exploiting Arabic Diacritization for High Quality Automatic Annotation
AbstractWe present a novel technique for Arabic morphological annotation. The technique utilizes diacritization to produce morphological annotations of quality comparable to human annotators. Although Arabic text is generally written without …...
Graph-Based Induction of Word Senses in Croatian
AbstractWord sense induction (WSI) seeks to induce senses of words from unannotated corpora. In this paper, we address the WSI task for the Croatian language. We adopt the word clustering …...
Inter-document Contextual Language model
In this paper, we examine the impact of employing contextual, structural information from a tree-structured document set to derive a language model. Our results show that this in- formation significantly …...
Learning Natural Language Inference with LSTM
Natural language inference (NLI) is a funda- mentally important task in natural language processing that has many applications. The recently released Stanford Natural Language Inference (SNLI) corpus has made it …...
Learning Term Embeddings for Taxonomic Relation Identification Using Dynamic Weighting Neural Network
Taxonomic relation identification aims to rec- ognize the ‘is-a’ relation between two terms. Previous works on identifying taxonomic re- lations are mostly based on statistical and lin- guistic approaches, but …...
Learning To Use Formulas To Solve Simple Arithmetic Problems
Solving simple arithmetic word problems is one of the challenges in Natural Lan- guage Understanding. This paper presents a novel method to learn to use formulas to solve simple arithmetic …...
Learning Tone and Attribution for Financial Text Mining
AbstractAttribution bias refers to the tendency of people to attribute successes to their own abilities but failures to external factors. In a business context an internal factor might be the …...
MAZA at SemEval-2016 Task 11: Detecting Lexical Complexity Using a Decision Stump Meta-Classifier
This paper describes team MAZA entries for the 2016 SemEval Task 11: Complex Word Identification (CWI). The task is a binary clas- sification task in which systems are trained to …...
Name Translation based on Fine-grained Named Entity Recognition in a Single Language
AbstractWe propose named entity abstraction methods with fine-grained named entity labels for improving statistical machine translation (SMT). The methods are based on a bilingual named entity recognizer that uses a …...
Neural Scoring Function for MST Parser
AbstractContinuous word representations appeared to be a useful feature in many natural language processing tasks. Using fixed-dimension pre-trained word embeddings allows avoiding sparse bag-of-words representation and to train models with …...
OCR++: A Robust Framework For Information Extraction from Scholarly Articles
AbstractThis paper proposes OCR++, an open-source framework designed for a variety of information extraction tasks from scholarly articles including metadata (title, author names, affiliation and e-mail), structure (section headings and …...
Parallel Sentence Extraction from Comparable Corpora with Neural Network Features
AbstractParallel corpora are crucial for machine translation (MT), however they are quite scarce for most language pairs and domains. As comparable corpora are far more available, many studies have been …...
Probabilistic Prototype Model for Serendipitous Property Mining
AbstractBesides providing the relevant information, amusing users has been an important role of the web. Many web sites provide serendipitous (unexpected but relevant) information to draw user traffic. In this …...
Quantificational features in distributional word representations
Do distributional word representations en- code the linguistic regularities that theo- ries of meaning argue they should encode? We address this question in the case of the logical properties (monotonicity, …...
Real-Time Speech Emotion and Sentiment Recognition for Interactive Dialogue Systems
In this paper, we describe our approach of en- abling an interactive dialogue system to rec- ognize user emotion and sentiment in real- time. These modules allow otherwise con- ventional …...
Regularizing Text Categorization with Clusters of Words
Regularization is a critical step in supervised learning to not only address overfitting, but also to take into account any prior knowledge we may have on the features and their …...
Relation Schema Induction using Tensor Factorization with Side Information
Given a set of documents from a specific do- main (e.g., medical research journals), how do we automatically build a Knowledge Graph (KG) for that domain? Automatic identifica- tion of …...
Resolving Language and Vision Ambiguities Together: Joint Segmentation & Prepositional Attachment Resolution in Captioned Scenes
We present an approach to simultaneously per- form semantic segmentation and prepositional phrase attachment resolution for captioned images. Some ambiguities in language can- not be resolved without simultaneously rea- soning …...
Revisiting Taxonomy Induction over Wikipedia
AbstractGuided by multiple heuristics, a unified taxonomy of entities and categories is distilled from the Wikipedia category network. A comprehensive evaluation, based on the analysis of upward generalization paths, demonstrates …...
SemEval-2016 Task 3: Community Question Answering
This paper describes the SemEval–2016 Task 3 on Community Question Answer- ing, which we offered in English and Ara- bic. For English, we had three sub- tasks: Question–Comment Similarity (subtask …...
Sentiment Composition of Words with Opposing Polarities
In this paper, we explore sentiment composi- tion in phrases that have at least one positive and at least one negative word—phrases like happy accident and best winter break. We …...
Splitting compounds with ngrams
AbstractCompound words with unmarked word boundaries are problematic for many tasks in NLP and computational linguistics, including information extraction, machine translation, and syllabification. This paper introduces a simple, proof-of-concept language …...
Stack-propagation: Improved Representation Learning for Syntax
Traditional syntax models typically lever- age part-of-speech (POS) information by constructing features from hand-tuned templates. We demonstrate that a better approach is to utilize POS tags as a reg- ularizer …...
Subtask Mining from Search Query Logs for How-Knowledge Acceleration
AbstractHow-knowledge is indispensable in daily life, but has relatively less quantity and poorer quality than what-knowledge in publicly available knowledge bases. This paper first extracts task-subtask pairs from wikiHow, then …...
Syntactic Analysis of Phrasal Compounds in Corpora: a Challenge for NLP Tools
AbstractThe paper introduces a “train once, use many” approach for the syntactic analysis of phrasal compounds (PC) of the type XP+N like “Would you like to sit on my knee?” …...
Textual complexity as a predictor of difficulty of listening items in language proficiency tests
AbstractIn this paper we explore to what extent the difficulty of listening items in an English language proficiency test can be predicted by the textual properties of the prompt. We …...
The Effects of the Content of FOMC Communications on US Treasury Rates
This study measures the effects of Federal Open Market Committee text content on the direction of short- and medium-term interest rate movements. Because the words relevant to short- and medium-term …...
Towards Sub-Word Level Compositions for Sentiment Analysis of Hindi-English Code Mixed Text
AbstractSentiment analysis (SA) using code-mixed data from social media has several applications in opinion mining ranging from customer satisfaction to social campaign analysis in multilingual societies. Advances in this area …...
Tweet Sarcasm Detection Using Deep Neural Network
AbstractSarcasm detection has been modeled as a binary document classification task, with rich features being defined manually over input documents. Traditional models employ discrete manual features to address the task, …...
UTCNN: a Deep Learning Model of Stance Classification on Social Media Text
AbstractMost neural network models for document classification on social media focus on text information to the neglect of other information on these platforms. In this paper, we classify post stance …...
What a Nerd! Beating Students and Vector Cosine in the ESL and TOEFL Datasets
AbstractIn this paper, we claim that Vector Cosine ― which is generally considered one of the most efficient unsupervised measures for identifying word similarity in Vector Space Models ― can …...
A Convolutional Encoder Model for Neural Machine Translation
AbstractThe prevalent approach to neural machine translation relies on bi-directional LSTMs to encode the source sentence. We present a faster and simpler architecture based on a succession of convolutional layers. …...
A Hybrid Model for Quality Assessment of Wikipedia Articles
The task of document quality assessment is a highly complex one, which draws on analysis of aspects including linguistic content, document structure, fact correct- ness, and community norms. We explore …...
A phoneme clustering algorithm based on the obligatory contour principle
AbstractThis paper explores a divisive hierarchical clustering algorithm based on the well-known Obligatory Contour Principle in phonology. The purpose is twofold: to see if such an algorithm could be used …...
A Sub-Character Architecture for Korean Language Processing
AbstractWe introduce a novel sub-character architecture that exploits a unique compositional structure of the Korean language. Our method decomposes each character into a small set of primitive phonetic units called …...
Accurate Supervised and Semi-Supervised Machine Reading for Long Documents
AbstractWe introduce a hierarchical architecture for machine reading capable of extracting precise information from long documents. The model divides the document into small, overlapping windows and encodes all windows in …...
Acquiring Predicate Paraphrases from News Tweets
AbstractWe present a simple method for ever-growing extraction of predicate paraphrases from news headlines in Twitter. Analysis of the output of ten weeks of collection shows that the accuracy of …...
Adullam at SemEval-2017 Task 4: Sentiment Analyzer Using Lexicon Integrated Convolutional Neural Networks with Attention
AbstractWe propose a sentiment analyzer for the prediction of document-level sentiments of English micro-blog messages from Twitter. The proposed method is based on lexicon integrated convolutional neural networks with attention …...
Adversarial Examples for Evaluating Reading Comprehension Systems
AbstractStandard accuracy metrics indicate that reading comprehension systems are making rapid progress, but the extent to which these systems truly understand language remains unclear. To reward systems with real language …...
An analysis of eye-movements during reading for the detection of mild cognitive impairment
AbstractWe present a machine learning analysis of eye-tracking data for the detection of mild cognitive impairment, a decline in cognitive abilities that is associated with an increased risk of developing …...
Apples to Apples: Learning Semantics of Common Entities Through a Novel Comprehension Task
AbstractUnderstanding common entities and their attributes is a primary requirement for any system that comprehends natural language. In order to enable learning about common entities, we introduce a novel machine …...
Automatic Categorization of Tagalog Documents Using Support Vector Machines
Automatic document classification is now a growing research topic in Natural Language Processing. Several techniques were incorporated to build a classifier that can categorize documents written in specific languages into …...
Deep Learning in Semantic Kernel Spaces
AbstractKernel methods enable the direct usage of structured representations of textual data during language learning and inference tasks. Expressive kernels, such as Tree Kernels, achieve excellent performance in NLP. On …...
Detecting Hate Speech in Social Media
AbstractIn this paper we examine methods to detect hate speech in social media, while distinguishing this from general profanity. We aim to establish lexical baselines for this task by applying …...
Don’t Throw Those Morphological Analyzers Away Just Yet: Neural Morphological Disambiguation for Arabic
AbstractThis paper presents a model for Arabic morphological disambiguation based on Recurrent Neural Networks (RNN). We train Long Short-Term Memory (LSTM) cells in several configurations and embedding levels to model …...
EICA Team at SemEval-2017 Task 3: Semantic and Metadata-based Features for Community Question Answering
AbstractWe describe our system for participating in SemEval-2017 Task 3 on Community Question Answering. Our approach relies on combining a rich set of various types of features: semantic and metadata. …...
Exploiting Morphological Regularities in Distributional Word Representations
AbstractWe present an unsupervised, language agnostic approach for exploiting morphological regularities present in high dimensional vector spaces. We propose a novel method for generating embeddings of words from their morphological …...
From Word Segmentation to POS Tagging for Vietnamese
This paper presents an empirical com- parison of two strategies for Vietnamese Part-of-Speech (POS) tagging from unseg- mented text: (i) a pipeline strategy where we consider the output of a …...
HumorHawk at SemEval-2017 Task 6: Mixing Meaning and Sound for Humor Recognition
AbstractThis paper describes the winning system for SemEval-2017 Task 6: #HashtagWars: Learning a Sense of Humor. Humor detection has up until now been predominantly addressed using feature-based approaches. Our system …...
Improved Neural Relation Detection for Knowledge Base Question Answering
AbstractRelation detection is a core component of many NLP applications including Knowledge Base Question Answering (KBQA). In this paper, we propose a hierarchical recurrent neural network enhanced by residual learning …...
Joint Modeling of Topics, Citations, and Topical Authority in Academic Corpora
AbstractMuch of scientific progress stems from previously published findings, but searching through the vast sea of scientific publications is difficult. We often rely on metrics of scholarly authority to find …...
KGEval: Accuracy Estimation of Automatically Constructed Knowledge Graphs
AbstractAutomatic construction of large knowledge graphs (KG) by mining web-scale text datasets has received considerable attention recently. Estimating accuracy of such automatically constructed KGs is a challenging problem due to …...
LanideNN: Multilingual Language Identification on Character Window
AbstractIn language identification, a common first step in natural language processing, we want to automatically determine the language of some input text. Monolingual language identification assumes that the given document …...
Learning Fine-Grained Expressions to Solve Math Word Problems
AbstractThis paper presents a novel template-based method to solve math word problems. This method learns the mappings between math concept phrases in math word problems and their math expressions from …...
Learning Fine-grained Relations from Chinese User Generated Categories
AbstractUser generated categories (UGCs) are short texts that reflect how people describe and organize entities, expressing rich semantic relations implicitly. While most methods on UGC relation extraction are based on …...
Lemmatization of Multi-word Common Noun Phrases and Named Entities in Polish
AbstractIn the paper we present a tool for lemmatization of multi-word common noun phrases and named entities for Polish called LemmaPL. The tool is based on a set of manually …...
Macro Grammars and Holistic Triggering for Efficient Semantic Parsing
AbstractTo learn a semantic parser from denotations, a learning algorithm must search over a combinatorially large space of logical forms for ones consistent with the annotated denotations. We propose a …...
Mama Edha at SemEval-2017 Task 8: Stance Classification with CNN and Rules
AbstractFor the competition SemEval-2017 we investigated the possibility of performing stance classification (support, deny, query or comment) for messages in Twitter conversation threads related to rumours. Stance classification is interesting …...
Monolingual Phrase Alignment on Parse Forests
AbstractWe propose an efficient method to conduct phrase alignment on parse forests for paraphrase detection. Unlike previous studies, our method identifies syntactic paraphrases under linguistically motivated grammar. In addition, it …...
NLM_NIH at SemEval-2017 Task 3: from Question Entailment to Question Similarity for Community Question Answering
AbstractThis paper describes our participation in SemEval-2017 Task 3 on Community Question Answering (cQA). The Question Similarity subtask (B) aims to rank a set of related questions retrieved by a …...
NNEMBs at SemEval-2017 Task 4: Neural Twitter Sentiment Classification: a Simple Ensemble Method with Different Embeddings
AbstractRecently, neural twitter sentiment classification has become one of state-of-thearts, which relies less feature engineering work compared with traditional methods. In this paper, we propose a simple and effective ensemble …...
Nonparametric Bayesian Semi-supervised Word Segmentation
AbstractThis paper presents a novel hybrid generative/discriminative model of word segmentation based on nonparametric Bayesian methods. Unlike ordinary discriminative word segmentation which relies only on labeled data, our semi-supervised model …...
One-Shot Neural Cross-Lingual Transfer for Paradigm Completion
AbstractWe present a novel cross-lingual transfer method for paradigm completion, the task of mapping a lemma to its inflected forms, using a neural encoder-decoder model, the state of the art …...
Ontology-Aware Token Embeddings for Prepositional Phrase Attachment
AbstractType-level word embeddings use the same set of parameters to represent all instances of a word regardless of its context, ignoring the inherent lexical ambiguity in language. Instead, we embed …...
Predicting Counselor Behaviors in Motivational Interviewing Encounters
AbstractAs the number of people receiving psycho-therapeutic treatment increases, the automatic evaluation of counseling practice arises as an important challenge in the clinical domain. In this paper, we address the …...
Robust Coreference Resolution and Entity Linking on Dialogues: Character Identification on TV Show Transcripts
AbstractThis paper presents a novel approach to character identification, that is an entity linking task that maps mentions to characters in dialogues from TV show transcripts. We first augment and …...
SRHR at SemEval-2017 Task 6: Word Associations for Humour Recognition
AbstractThis paper explores the role of semantic relatedness features, such as word associations, in humour recognition. Specifically, we examine the task of inferring pairwise humour judgments in Twitter hashtag wars. …...
SVNIT @ SemEval 2017 Task-6: Learning a Sense of Humor Using Supervised Approach
AbstractThis paper describes the system devel-oped for SemEval 2017 task 6: #HashTagWars -Learning a Sense of Hu-mor. Learning to recognize sense of hu-mor is the important task for language understanding …...
Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification with Branch-LSTM
AbstractThis paper describes team Turing’s submission to SemEval 2017 RumourEval: Determining rumour veracity and support for rumours (SemEval 2017 Task 8, Subtask A). Subtask A addresses the challenge of rumour …...
Universal Dependencies Parsing for Colloquial Singaporean English
AbstractSinglish can be interesting to the ACL community both linguistically as a major creole based on English, and computationally for information extraction and sentiment analysis of regional social media. We …...
以知識表徵方法建構台語聲調群剖析器 (A Knowledge Representation Method to Implement A Taiwanese Tone Group Parser) [In Chinese]
A tone group parser could be one of the most important components of the Taiwanese text-to-speech system. In this paper, we offered the hypothesis of tonal government to emphasis the …...
A Large Self-Annotated Corpus for Sarcasm
We introduce the Self-Annotated Reddit Corpus (SARC), a large corpus for sarcasm research and for training and evaluating systems for sarcasm detection. The corpus has 1.3 million sarcastic statements — …...
A Large-Scale Test Set for the Evaluation of Context-Aware Pronoun Translation in Neural Machine Translation
AbstractThe translation of pronouns presents a special challenge to machine translation to this day, since it often requires context outside the current sentence. Recent work on models that have access …...
Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text
AbstractChinese word segmentation (CWS) trained from open source corpus faces dramatic performance drop when dealing with domain text, especially for a domain with lots of special terms and diverse writing …...
AmritaNLP at SemEval-2018 Task 10: Capturing discriminative attributes using convolution neural network over global vector representation.
AbstractThe “Capturing Discriminative Attributes” sharedtask is the tenth task, conjoint with SemEval2018. The task is to predict if a word can capture distinguishing attributes of one word from another. We …...
Authorship Identification for Literary Book Recommendations
AbstractBook recommender systems can help promote the practice of reading for pleasure, which has been declining in recent years. One factor that influences reading preferences is writing style. We propose …...
Automated Scoring: Beyond Natural Language Processing
AbstractIn this position paper, we argue that building operational automated scoring systems is a task that has disciplinary complexity above and beyond standard competitive shared tasks which usually involve applying …...
Automatic Detection of Fake News
AbstractThe proliferation of misleading information in everyday access media outlets such as social media feeds, news blogs, and online newspapers have made it challenging to identify trustworthy news sources, thus …...
Automatic Focus Annotation: Bringing Formal Pragmatics Alive in Analyzing the Information Structure of Authentic Data
AbstractAnalyzing language in context, both from a theoretical and from a computational perspective, is receiving increased interest. Complementing the research in linguistics on discourse and information structure, in computational linguistics …...
BLCU_NLP at SemEval-2018 Task 12: An Ensemble Model for Argument Reasoning Based on Hierarchical Attention
AbstractTo comprehend an argument and fill the gap between claims and reasons, it is vital to find the implicit supporting warrants behind. In this paper, we propose a hierarchical attention …...
Bringing Order to Neural Word Embeddings with Embeddings Augmented by Random Permutations (EARP)
AbstractWord order is clearly a vital part of human language, but it has been used comparatively lightly in distributional vector models. This paper presents a new method for incorporating word …...
Can Recurrent Neural Networks Learn Nested Recursion?
AbstractContext-free grammars (CFG) were one of the first formal tools used to model natural languages, and they remain relevant today as the basis of several frameworks. A key ingredient of …...
Character-Level Feature Extraction with Densely Connected Networks
AbstractGenerating character-level features is an important step for achieving good results in various natural language processing tasks. To alleviate the need for human labor in generating hand-crafted features, methods that …...
CitiusNLP at SemEval-2018 Task 10: The Use of Transparent Distributional Models and Salient Contexts to Discriminate Word Attributes
AbstractThis article describes the unsupervised strategy submitted by the CitiusNLP team to the SemEval 2018 Task 10, a task which consists of predict whether a word is a discriminative attribute …...
Classifying and Extracting Data from Facebook Posts for Online Persona Identification
Large amount of user-generated data are posted online in social media platforms, in- cluding user preferences, dining and leisure activities, events, news and personal blogs. This resulted in varying efforts …...
Collective Entity Disambiguation with Structured Gradient Tree Boosting
AbstractWe present a gradient-tree-boosting-based structured learning model for jointly disambiguating named entities in a document. Gradient tree boosting is a widely used machine learning algorithm that underlies many top-performing natural …...
Constructing Datasets for Multi-hop Reading Comprehension Across Documents
AbstractMost Reading Comprehension methods limit themselves to queries which can be answered using a single sentence, paragraph, or document. Enabling models to combine disjoint pieces of textual evidence would extend …...
Context Encoder for Analogies on Strings
We propose a model based on context en- coder to solve formal analogies on strings like aaabbbccc : aaaabbbbcccc :: abc : x ⇒ x = aabbcc or ubid : …...
Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos
AbstractEmotion recognition in conversations is crucial for the development of empathetic machines. Present methods mostly ignore the role of inter-speaker dependency relations while classifying emotions in conversations. In this paper, …...
Deep Enhanced Representation for Implicit Discourse Relation Recognition
AbstractImplicit discourse relation recognition is a challenging task as the relation prediction without explicit connectives in discourse parsing needs understanding of text spans and cannot be easily derived from surface …...
Discriminating between Similar Languages on Imbalanced Conversational Texts
Discriminating between similar languages (DSL) on conversational texts is a challenging task. This paper aims at discriminating between limited-resource languages on short conversational texts, like Uyghur and Kazakh. Considering that …...
ECNU at SemEval-2018 Task 12: An End-to-End Attention-based Neural Network for the Argument Reasoning Comprehension Task
AbstractThis paper presents our submissions to SemEval 2018 Task 12: the Argument Reasoning Comprehension Task. We investigate an end-to-end attention-based neural network to represent the two lexically close candidate warrants. …...
Efficient Sequence Learning with Group Recurrent Networks
AbstractRecurrent neural networks have achieved state-of-the-art results in many artificial intelligence tasks, such as language modeling, neural machine translation, speech recognition and so on. One of the key factors to …...
Event Time Extraction with a Decision Tree of Neural Classifiers
AbstractExtracting the information from text when an event happened is challenging. Documents do not only report on current events, but also on past events as well as on future events. …...
Fine-Grained Arabic Dialect Identification
AbstractPrevious work on the problem of Arabic Dialect Identification typically targeted coarse-grained five dialect classes plus Standard Arabic (6-way classification). This paper presents the first results on a fine-grained dialect …...
Graph Based Semi-Supervised Learning Approach for Tamil POS tagging
Parts of Speech (POS) tagging is an important pre-requisite for various Natural Language Processing tasks. POS tagging is rather challenging for morphologically rich languages such as Tamil. Being low-resourced, Tamil …...
Handling Homographs in Neural Machine Translation
AbstractHomographs, words with different meanings but the same surface form, have long caused difficulty for machine translation systems, as it is difficult to select the correct translation based on the …...
Identifying Computer-Translated Paragraphs using Coherence Features
We have developed a method for extracting the coherence features from a paragraph by matching similar words in its sentences. We conducted an experiment with a parallel Ger- man corpus …...
Inducing Temporal Relations from Time Anchor Annotation
AbstractRecognizing temporal relations among events and time expressions has been an essential but challenging task in natural language processing. Conventional annotation of judging temporal relations puts a heavy load on …...
Integrating Tree Structures and Graph Structures with Neural Networks to Classify Discussion Discourse Acts
AbstractWe proposed a model that integrates discussion structures with neural networks to classify discourse acts. Several attempts have been made in earlier works to analyze texts that are used in …...
Is it worth it? Budget-related evaluation metrics for model selection
Projects that set out to create a linguistic resource often do so by using a machine learning model that pre-annotates or filters the content that goes through to a human …...
Lyb3b at SemEval-2018 Task 12: Ensemble-based Deep Learning Models for Argument Reasoning Comprehension Task
AbstractReasoning is a crucial part of natural language argumentation. In order to comprehend an argument, we have to reconstruct and analyze its reasoning. In this task, given a natural language …...
MITRE at SemEval-2018 Task 11: Commonsense Reasoning without Commonsense Knowledge
AbstractThis paper describes MITRE’s participation in SemEval-2018 Task 11: Machine Comprehension using Commonsense Knowledge. The techniques explored range from simple bag-of-ngrams classifiers to neural architectures with varied attention and alignment …...
Multi-Source Neural Machine Translation with Data Augmentation
AbstractMulti-source translation systems translate from multiple languages to a single target language. By using information from these multiple sources, these systems achieve large gains in accuracy. To train these systems, …...
Neural Japanese Zero Anaphora Resolution using Smoothed Large-scale Case Frames with Word Embedding
This paper presents a Japanese zero anaphora resolution model which deals with both intra- and inter-sentential zero anaphora. Solving inter-sentential anaphora needs to consider a large number of antecedent candidates …...
NIHRIO at SemEval-2018 Task 3: A Simple and Accurate Neural Network Model for Irony Detection in Twitter
AbstractThis paper describes our NIHRIO system for SemEval-2018 Task 3 “Irony detection in English tweets.” We propose to use a simple neural network architecture of Multilayer Perceptron with various types …...
Novelty Goes Deep. A Deep Neural Solution To Document Level Novelty Detection
AbstractThe rapid growth of documents across the web has necessitated finding means of discarding redundant documents and retaining novel ones. Capturing redundancy is challenging as it may involve investigating at …...
Part-of-Speech Tagging on an Endangered Language: a Parallel Griko-Italian Resource
AbstractMost work on part-of-speech (POS) tagging is focused on high resource languages, or examines low-resource and active learning settings through simulated studies. We evaluate POS tagging techniques on an actual …...
QUEST: A Natural Language Interface to Relational Databases
Natural language interfaces to databases systems allow the user to use natural language to interrogate a database. Current systems mainly focus on simple queries but neglect nested queries, which are …...
Reusable workflows for gender prediction
This paper presents a system for author profiling (AP) modeling that reduces the complexity and time of building a sophisticated model for a number of different AP tasks. The system …...
SemEval-2018 Task 12: The Argument Reasoning Comprehension Task
AbstractA natural language argument is composed of a claim as well as reasons given as premises for the claim. The warrant explaining the reasoning is usually left implicit, as it …...
Sentiment-Stance-Specificity (SSS) Dataset: Identifying Support-based Entailment among Opinions.
Computational argumentation aims to model arguments as a set of premises that either support each other or collectively support a conclusion. We prepare three datasets of text-hypothesis pairs with support-based …...
Simplification Using Paraphrases and Context-Based Lexical Substitution
AbstractLexical simplification involves identifying complex words or phrases that need to be simplified, and recommending simpler meaning-preserving substitutes that can be more easily understood. We propose a complex word identification …...
TakeLab at SemEval-2018 Task12: Argument Reasoning Comprehension with Skip-Thought Vectors
AbstractThis paper describes our system for the SemEval-2018 Task 12: Argument Reasoning Comprehension Task. We utilize skip-thought vectors, sentence-level distributional vectors inspired by the popular word embeddings and the skip-gram …...
Towards an Automatic Text Comprehension for the Arabic Question-Answering: Semantic and Logical Representation of Texts
Automatic text comprehension is an arduous task of automatic natural language processing. This task has been addressed in several NLP applications, namely, question-answering, information retrieval, etc. In some cases, these …...
Unsupervised Korean Word Sense Disambiguation using CoreNet
In this study, we investigated unsupervised learning based Korean word sense disambiguation (WSD) using CoreNet, a Korean lexical semantic network. To facilitate the application of WSD to practical natural language …...
A Holistic Natural Language Generation Framework for the Semantic Web
AbstractWith the ever-growing generation of data for the Semantic Web comes an increasing demand for this data to be made available to non-semantic Web experts. One way of achieving this …...
A Surprisingly Robust Trick for the Winograd Schema Challenge
AbstractThe Winograd Schema Challenge (WSC) dataset WSC273 and its inference counterpart WNLI are popular benchmarks for natural language understanding and commonsense reasoning. In this paper, we show that the performance …...
Alignment over Heterogeneous Embeddings for Question Answering
AbstractWe propose a simple, fast, and mostly-unsupervised approach for non-factoid question answering (QA) called Alignment over Heterogeneous Embeddings (AHE). AHE simply aligns each word in the question and candidate answer …...
Automatic Detection of Translation Direction
AbstractParallel corpora are crucial resources for NLP applications, most notably for machine translation. The direction of the (human) translation of parallel corpora has been shown to have significant implications for …...
Beyond task success: A closer look at jointly learning to see, ask, and GuessWhat
AbstractWe propose a grounded dialogue state encoder which addresses a foundational issue on how to integrate visual grounding with dialogue system components. As a test-bed, we focus on the GuessWhat?! …...
Bilingual Lexicon Induction through Unsupervised Machine Translation
AbstractA recent research line has obtained strong results on bilingual lexicon induction by aligning independently trained word embeddings in two languages and using the resulting cross-lingual embeddings to induce word …...
Box of Lies: Multimodal Deception Detection in Dialogues
AbstractDeception often takes place during everyday conversations, yet conversational dialogues remain largely unexplored by current work on automatic deception detection. In this paper, we address the task of detecting multimodal …...
Classification of Micro-Texts Using Sub-Word Embeddings
AbstractExtracting features and writing styles from short text messages is always a challenge. Short messages, like tweets, do not have enough data to perform statistical authorship attribution. Besides, the vocabulary …...
ColumbiaNLP at SemEval-2019 Task 8: The Answer is Language Model Fine-tuning
AbstractCommunity Question Answering forums are very popular nowadays, as they represent effective means for communities to share information around particular topics. But the information shared on these forums are often …...
Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge
AbstractWinograd Schema Challenge (WSC) is a pronoun resolution task which seems to require reasoning with commonsense knowledge. The needed knowledge is not present in the given text. Automatic extraction of …...
Constraint-based Learning of Phonological Processes
AbstractPhonological processes are context-dependent sound changes in natural languages. We present an unsupervised approach to learning human-readable descriptions of phonological processes from collections of related utterances. Our approach builds upon …...
Continuous Learning for Large-scale Personalized Domain Classification
AbstractDomain classification is the task to map spoken language utterances to one of the natural language understanding domains in intelligent personal digital assistants (IPDAs). This is observed in mainstream IPDAs …...
Detecting Causal Language Use in Science Findings
AbstractCausal interpretation of correlational findings from observational studies has been a major type of misinformation in science communication. Prior studies on identifying inappropriate use of causal language relied on manual …...
Detecting Toxicity in News Articles: Application to Bulgarian
AbstractOnline media aim for reaching ever bigger audience and for attracting ever longer attention span. This competition creates an environment that rewards sensational, fake, and toxic news. To help limit …...
Dick-Preston and Morbo at SemEval-2019 Task 4: Transfer Learning for Hyperpartisan News Detection
AbstractIn a world of information operations, influence campaigns, and fake news, classification of news articles as following hyperpartisan argumentation or not is becoming increasingly important. We present a deep learning-based …...
Discovering the Latent Writing Style from Articles: A Contextualized Feature Extraction Approach
With the growth of the Internet, the ready accessibility and generation of online information has created the issue of determining how accurate or truthful that information is. The rapid speed …...
Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing
AbstractA major hurdle on the road to conversational interfaces is the difficulty in collecting data that maps language utterances to logical forms. One prominent approach for data collection has been …...
Fermi at SemEval-2019 Task 4: The sarah-jane-smith Hyperpartisan News Detector
AbstractThis paper describes our system (Fermi) for Task 4: Hyper-partisan News detection of SemEval-2019. We use simple text classification algorithms by transforming the input features to a reduced feature set. …...
Generalizing Unmasking for Short Texts
AbstractAuthorship verification is the problem of inferring whether two texts were written by the same author. For this task, unmasking is one of the most robust approaches as of today …...
Harvey Mudd College at SemEval-2019 Task 4: The Clint Buchanan Hyperpartisan News Detector
AbstractWe investigate the recently developed Bidi- rectional Encoder Representations from Transformers (BERT) model (Devlin et al. 2018) for the hyperpartisan news detection task. Using a subset of hand-labeled articles from …...
HELP: A Dataset for Identifying Shortcomings of Neural Models in Monotonicity Reasoning
AbstractLarge crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including …...
Integrating Semantic Knowledge to Tackle Zero-shot Text Classification
AbstractInsufficient or even unavailable training data of emerging classes is a big challenge of many classification tasks, including text classification. Recognising text documents of classes that have never been seen …...
jhan014 at SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media
AbstractIn this paper, we present two methods to identify and categorize the offensive language in Twitter. In the first method, we establish a probabilistic model to evaluate the sentence offensiveness …...
Lijunyi at SemEval-2019 Task 9: An attention-based LSTM and ensemble of different models for suggestion mining from online reviews and forums
AbstractIn this paper, we describe a suggestion mining system that participated in SemEval 2019 Task 9, SubTask A - Suggestion Mining from Online Reviews and Forums. Given some suggestions from …...
Paraphrase-Sense-Tagged Sentences
AbstractMany natural language processing tasks require discriminating the particular meaning of a word in context, but building corpora for developing sense-aware models can be a challenge. We present a large …...
PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification
AbstractMost existing work on adversarial data generation focuses on English. For example, PAWS (Paraphrase Adversaries from Word Scrambling) consists of challenging English paraphrase identification pairs from Wikipedia and Quora. We …...
PAWS: Paraphrase Adversaries from Word Scrambling
AbstractExisting paraphrase identification datasets lack sentence pairs that have high lexical overlap without being paraphrases. Models trained on such data fail to distinguish pairs like flights from New York to …...
Procedural Reasoning Networks for Understanding Multimodal Procedures
AbstractThis paper addresses the problem of comprehending procedural commonsense knowledge. This is a challenging task as it requires identifying key entities, keeping track of their state changes, and understanding temporal …...
Reranking for Neural Semantic Parsing
AbstractSemantic parsing considers the task of transducing natural language (NL) utterances into machine executable meaning representations (MRs). While neural network-based semantic parsers have achieved impressive improvements over previous methods, results …...
Roll Call Vote Prediction with Knowledge Augmented Models
AbstractThe official voting records of United States congresspeople are preserved as roll call votes. Prediction of voting behavior of politicians for whom no voting record exists, such as individuals running …...
Rouletabille at SemEval-2019 Task 4: Neural Network Baseline for Identification of Hyperpartisan Publishers
AbstractThis paper describes the Rouletabille participation to the Hyperpartisan News Detection task. We propose the use of different text classification methods for this task. Preliminary experiments using a similar collection …...
Semantically-Aligned Equation Generation for Solving and Reasoning Math Word Problems
AbstractSolving math word problems is a challenging task that requires accurate natural language understanding to bridge natural language texts and math expressions. Motivated by the intuition about how human generates …...
SemEval-2019 Task 10: Math Question Answering
AbstractWe report on the SemEval 2019 task on math question answering. We provided a question set derived from Math SAT practice exams, including 2778 training questions and 1082 test questions. …...
SemEval-2019 Task 4: Hyperpartisan News Detection
AbstractHyperpartisan news is news that takes an extreme left-wing or right-wing standpoint. If one is able to reliably compute this meta information, news articles may be automatically tagged, this way …...
Show Some Love to Your n-grams: A Bit of Progress and Stronger n-gram Language Modeling Baselines
AbstractIn recent years neural language models (LMs) have set the state-of-the-art performance for several benchmarking datasets. While the reasons for their success and their computational demand are well-documented, a comparison …...
SINAI-DL at SemEval-2019 Task 7: Data Augmentation and Temporal Expressions
AbstractThis paper describes the participation of the SINAI-DL team at RumourEval (Task 7 in SemEval 2019, subtask A: SDQC). SDQC addresses the challenge of rumour stance classification as an indirect …...
Small and Practical BERT Models for Sequence Labeling
AbstractWe propose a practical scheme to train a single multilingual sequence labeling model that yields state of the art results and is small and fast enough to run on a …...
SParC: Cross-Domain Semantic Parsing in Context
AbstractWe present SParC, a dataset for cross-domainSemanticParsing inContext that consists of 4,298 coherent question sequences (12k+ individual questions annotated with SQL queries). It is obtained from controlled user interactions with …...
SSN_NLP at SemEval-2019 Task 6: Offensive Language Identification in Social Media using Traditional and Deep Machine Learning Approaches
AbstractOffensive language identification (OLI) in user generated text is automatic detection of any profanity, insult, obscenity, racism or vulgarity that degrades an individual or a group. It is helpful for …...
sthruggle at SemEval-2019 Task 5: An Ensemble Approach to Hate Speech Detection
AbstractIn this paper, we present our approach to detection of hate speech against women and immigrants in tweets for our participation in the SemEval-2019 Task 5. We trained an SVM …...
STUFIIT at SemEval-2019 Task 5: Multilingual Hate Speech Detection on Twitter with MUSE and ELMo Embeddings
AbstractWe present a number of models used for hate speech detection for Semeval 2019 Task-5: Hateval. We evaluate the viability of multilingual learning for this task. We also experiment with …...
Table Structure Recognition Based on Cell Relationship, a Bottom-Up Approach
AbstractIn this paper, we present a relationship extraction based methodology for table structure recognition in PDF documents. The proposed deep learning-based method takes a bottom-up approach to table recognition in …...
Task Refinement Learning for Improved Accuracy and Stability of Unsupervised Domain Adaptation
AbstractPivot Based Language Modeling (PBLM) (Ziser and Reichart, 2018a), combining LSTMs with pivot-based methods, has yielded significant progress in unsupervised domain adaptation. However, this approach is still challenged by the …...
Team Fernando-Pessa at SemEval-2019 Task 4: Back to Basics in Hyperpartisan News Detection
AbstractThis paper describes our submission to the SemEval 2019 Hyperpartisan News Detection task. Our system aims for a linguistics-based document classification from a minimal set of interpretable features, while maintaining …...
Team Howard Beale at SemEval-2019 Task 4: Hyperpartisan News Detection with BERT
AbstractThis paper describes our system for SemEval-2019 Task 4: Hyperpartisan News Detection (Kiesel et al., 2019). We use pretrained BERT (Devlin et al., 2018) architecture and investigate the effect of …...
Team Kermit-the-frog at SemEval-2019 Task 4: Bias Detection Through Sentiment Analysis and Simple Linguistic Features
AbstractIn this paper we describe our participation in the SemEval 2019 shared task on hyperpartisan news detection. We present the system that we submitted for final evaluation and the three …...
Team Peter Brinkmann at SemEval-2019 Task 4: Detecting Biased News Articles Using Convolutional Neural Networks
AbstractIn this paper, we present an approach for classifying news articles as biased (i.e., hyperpartisan) or unbiased, based on a convolutional neural network. We experiment with various embedding methods (pretrained …...
Team QCRI-MIT at SemEval-2019 Task 4: Propaganda Analysis Meets Hyperpartisan News Detection
AbstractWe describe our submission to SemEval-2019 Task 4 on Hyperpartisan News Detection. We rely on a variety of engineered features originally used to detect propaganda. This is based on the …...
Team Xenophilius Lovegood at SemEval-2019 Task 4: Hyperpartisanship Classification using Convolutional Neural Networks
AbstractThis paper describes our system for the SemEval 2019 Task 4 on hyperpartisan news detection. We build on an existing deep learning approach for sentence classification based on a Convolutional …...
Tom Jumbo-Grumbo at SemEval-2019 Task 4: Hyperpartisan News Detection with GloVe vectors and SVM
AbstractIn this paper, we describe our attempt to learn bias from news articles. From our experiments, it seems that although there is a correlation between publisher bias and article bias, …...
Towards Automating Healthcare Question Answering in a Noisy Multilingual Low-Resource Setting
AbstractWe discuss ongoing work into automating a multilingual digital helpdesk service available via text messaging to pregnant and breastfeeding mothers in South Africa. Our anonymized dataset consists of short informal …...
Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation
AbstractWe present a neural approach called IRNet for complex and cross-domain Text-to-SQL. IRNet aims to address two challenges: 1) the mismatch between intents expressed in natural language (NL) and the …...
Tree Communication Models for Sentiment Analysis
AbstractTree-LSTMs have been used for tree-based sentiment analysis over Stanford Sentiment Treebank, which allows the sentiment signals over hierarchical phrase structures to be calculated simultaneously. However, traditional tree-LSTMs capture only …...
Validation of Facts Against Textual Sources
AbstractIn today’s digital world of information, a fact verification system to disprove assertions made in speech, print media or online content is the need of the hour. We propose a …...
Vernon-fenwick at SemEval-2019 Task 4: Hyperpartisan News Detection using Lexical and Semantic Features
AbstractIn this paper, we present our submission for SemEval-2019 Task 4: Hyperpartisan News Detection. Hyperpartisan news articles are sharply polarized and extremely biased (onesided). It shows blind beliefs, opinions and …...
White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks
AbstractAdversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming …...
A Broad-Coverage Deep Semantic Lexicon for Verbs
AbstractProgress on deep language understanding is inhibited by the lack of a broad coverage lexicon that connects linguistic behavior to ontological concepts and axioms. We have developed COLLIE-V, a deep …...
A Method for Building a Commonsense Inference Dataset based on Basic Events
AbstractWe present a scalable, low-bias, and low-cost method for building a commonsense inference dataset that combines automatic extraction from a corpus and crowdsourcing. Each problem is a multiple-choice question that …...
A Simple and Effective Approach to Robust Unsupervised Bilingual Dictionary Induction
AbstractUnsupervised Bilingual Dictionary Induction methods based on the initialization and the self-learning have achieved great success in similar language pairs, e.g., English-Spanish. But they still fail and have an accuracy …...
Active Imitation Learning with Noisy Guidance
AbstractImitation learning algorithms provide state-of-the-art results on many structured prediction tasks by learning near-optimal search policies. Such algorithms assume training-time access to an expert that can provide the optimal action …...
AIN: Fast and Accurate Sequence Labeling with Approximate Inference Network
AbstractThe linear-chain Conditional Random Field (CRF) model is one of the most widely-used neural sequence labeling approaches. Exact probabilistic inference algorithms such as the forward-backward and Viterbi algorithms are typically …...
An Element-aware Multi-representation Model for Law Article Prediction
AbstractExisting works have proved that using law articles as external knowledge can improve the performance of the Legal Judgment Prediction. However, they do not fully use law article information and …...
Blank Language Models
AbstractWe propose Blank Language Model (BLM), a model that generates sequences by dynamically creating and filling in blanks. The blanks control which part of the sequence to expand, making BLM …...
Bootstrapping Techniques for Polysynthetic Morphological Analysis
AbstractPolysynthetic languages have exceptionally large and sparse vocabularies, thanks to the number of morpheme slots and combinations in a word. This complexity, together with a general scarcity of written data, …...
CEASE, a Corpus of Emotion Annotated Suicide notes in English
AbstractA suicide note is usually written shortly before the suicide and it provides a chance to comprehend the self-destructive state of mind of the deceased. From a psychological point of …...
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation
AbstractNatural language is characterized by compositionality: the meaning of a complex expression is constructed from the meanings of its constituent parts. To facilitate the evaluation of the compositional abilities of …...
Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering
AbstractCommonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, …...
Contextual Embeddings: When Are They Worth It?
AbstractWe study the settings for which deep contextual embeddings (e.g., BERT) give large improvements in performance relative to classic pretrained embeddings (e.g., GloVe), and an even simpler baseline—random word embeddings—focusing …...
Crawling and Preprocessing Mailing Lists At Scale for Dialog Analysis
AbstractThis paper introduces the Webis Gmane Email Corpus 2019, the largest publicly available and fully preprocessed email corpus to date. We crawled more than 153 million emails from 14,699 mailing …...
Cross-Lingual Suicidal-Oriented Word Embedding toward Suicide Prevention
AbstractEarly intervention for suicide risks with social media data has increasingly received great attention. Using a suicide dictionary created by mental health experts is one of the effective ways to …...
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher
AbstractCross-lingual text classification alleviates the need for manually labeled documents in a target language by leveraging labeled documents from other languages. Existing approaches for transferring supervision across languages require expensive …...
Cross-lingual Transfer Learning for Grammatical Error Correction
AbstractIn this study, we explore cross-lingual transfer learning in grammatical error correction (GEC) tasks. Many languages lack the resources required to train GEC models. Cross-lingual transfer learning from high-resource languages …...
Cross-Linguistic Syntactic Evaluation of Word Prediction Models
AbstractA range of studies have concluded that neural word prediction models can distinguish grammatical from ungrammatical sentences with high accuracy. However, these studies are based primarily on monolingual evidence from …...
DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering
AbstractTransformer-based QA models use input-wide self-attention – i.e. across both the question and the input passage – at all layers, causing them to be slow and memory-intensive. It turns out …...
DiaSense at SemEval-2020 Task 1: Modeling Sense Change via Pre-trained BERT Embeddings
AbstractThis paper describes DiaSense, a system developed for Task 1 ‘Unsupervised Lexical Semantic Change Detection’ of SemEval 2020. In DiaSense, contextualized word embeddings are used to model word sense changes. …...
Disentangling dialects: a neural approach to Indo-Aryan historical phonology and subgrouping
AbstractThis paper seeks to uncover patterns of sound change across Indo-Aryan languages using an LSTM encoder-decoder architecture. We augment our models with embeddings represent-ing language ID, part of speech, and …...
Document Classification for COVID-19 Literature
AbstractThe global pandemic has made it more important than ever to quickly and accurately retrieve relevant scientific literature for effective consumption by researchers in a wide range of fields. We …...
Duluth at SemEval-2020 Task 12: Offensive Tweet Identification in English with Logistic Regression
AbstractThis paper describes the Duluth systems that participated in SemEval–2020 Task 12, Multilingual Offensive Language Identification in Social Media (OffensEval–2020). We participated in the three English language tasks. Our systems …...
Elhuyar submission to the Biomedical Translation Task 2020 on terminology and abstracts translation
AbstractThis article describes the systems submitted by Elhuyar to the 2020 Biomedical Translation Shared Task, specifically the systems presented in the subtasks of terminology translation for English-Basque and abstract translation …...
Enhance Robustness of Sequence Labelling with Masked Adversarial Training
AbstractAdversarial training (AT) has shown strong regularization effects on deep learning algorithms by introducing small input perturbations to improve model robustness. In language tasks, adversarial training brings word-level robustness by …...
Enhancing Clinical BERT Embedding using a Biomedical Knowledge Base
AbstractDomain knowledge is important for building Natural Language Processing (NLP) systems for low-resource settings, such as in the clinical domain. In this paper, a novel joint training method is introduced …...
Federated Learning for Spoken Language Understanding
AbstractRecently, spoken language understanding (SLU) has attracted extensive research interests, and various SLU datasets have been proposed to promote the development. However, most of the existing methods focus on a …...
Fine-grained Information Status Classification Using Discourse Context-Aware BERT
AbstractPrevious work on bridging anaphora recognition (Hou et al., 2013) casts the problem as a subtask of learning fine-grained information status (IS). However, these systems heavily depend on many hand-crafted …...
Form2Seq : A Framework for Higher-Order Form Structure Extraction
AbstractDocument structure extraction has been a widely researched area for decades with recent works performing it as a semantic segmentation task over document images using fully-convolution networks. Such methods are …...
Habibi - a multi Dialect multi National Arabic Song Lyrics Corpus
AbstractThis paper introduces Habibi the first Arabic Song Lyrics corpus. The corpus comprises more than 30,000 Arabic song lyrics in 6 Arabic dialects for singers from 18 different Arabic countries. …...
Handling Entity Normalization with no Annotated Corpus: Weakly Supervised Methods Based on Distributional Representation and Ontological Information
AbstractEntity normalization (or entity linking) is an important subtask of information extraction that links entity mentions in text to categories or concepts in a reference vocabulary. Machine learning based normalization …...
Hierarchical Entity Typing via Multi-level Learning to Rank
AbstractWe propose a novel method for hierarchical entity classification that embraces ontological structure at both training and during prediction. At training, our novel multi-level learning-to-rank loss compares positive types against …...
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition
AbstractKnowledge of a disease includes information of various aspects of the disease, such as signs and symptoms, diagnosis and treatment. This disease knowledge is critical for many health-related and biomedical …...
Interpretable Multi-dataset Evaluation for Named Entity Recognition
AbstractWith the proliferation of models for natural language processing tasks, it is even harder to understand the differences between models and their relative merits. Simply looking at differences between holistic …...
Knowing What You Know: Calibrating Dialogue Belief State Distributions via Ensembles
AbstractThe ability to accurately track what happens during a conversation is essential for the performance of a dialogue system. Current state-of-the-art multi-domain dialogue state trackers achieve just over 55% accuracy …...
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling
AbstractPre-training models on vast quantities of unlabeled data has emerged as an effective approach to improving accuracy on many NLP tasks. On the other hand, traditional machine translation has a …...
Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment
AbstractExisting end-to-end dialog systems perform less effectively when data is scarce. To obtain an acceptable success in real-life online services with only a handful of training examples, both fast adaptability …...
Learning to Decouple Relations: Few-Shot Relation Classification with Entity-Guided Attention and Confusion-Aware Training
AbstractThis paper aims to enhance the few-shot relation classification especially for sentences that jointly describe multiple relations. Due to the fact that some relations usually keep high co-occurrence in the …...
LGPSolver - Solving Logic Grid Puzzles Automatically
AbstractLogic grid puzzle (LGP) is a type of word problem where the task is to solve a problem in logic. Constraints for the problem are given in the form of …...
LSF-ANIMAL: A Motion Capture Corpus in French Sign Language Designed for the Animation of Signing Avatars
AbstractSigning avatars allow deaf people to access information in their preferred language using an interactive visualization of the sign language spatio-temporal content. However, avatars are often procedurally animated, resulting in …...
Mapping Natural Language Instructions to Mobile UI Action Sequences
AbstractWe present a new problem: grounding natural language instructions to mobile user interface actions, and create three new datasets for it. For full task evaluation, we create PixelHelp, a corpus …...
Mitigating Gender Bias in Machine Translation with Target Gender Annotations
AbstractWhen translating “The secretary asked for details.” to a language with grammatical gender, it might be necessary to determine the gender of the subject “secretary”. If the sentence does not …...
MLEngineer at SemEval-2020 Task 7: BERT-Flair Based Humor Detection Model (BFHumor)
AbstractTask 7, Assessing the Funniness of Edited News Headlines, in the International Workshop SemEval2020 introduces two sub-tasks to predict the funniness values of edited news headlines from the Reddit website. …...
Modeling Evolution of Message Interaction for Rumor Resolution
AbstractPrevious work for rumor resolution concentrates on exploiting time-series characteristics or modeling topology structure separately. However, how local interactive pattern affects global information assemblage has not been explored. In this …...
MUTANT: A Training Paradigm for Out-of-Distribution Generalization in Visual Question Answering
AbstractWhile progress has been made on the visual question answering leaderboards, models often utilize spurious correlations and priors in datasets under the i.i.d. setting. As such, evaluation on out-of-distribution (OOD) …...
Neural RST-based Evaluation of Discourse Coherence
AbstractThis paper evaluates the utility of Rhetorical Structure Theory (RST) trees and relations in discourse coherence evaluation. We show that incorporating silver-standard RST features can increase accuracy when classifying coherence. …...
NeuReduce: Reducing Mixed Boolean-Arithmetic Expressions by Recurrent Neural Network
AbstractMixed Boolean-Arithmetic (MBA) expressions involve both arithmetic calculation (e.g.,plus, minus, multiply) and bitwise computation (e.g., and, or, negate, xor). MBA expressions have been widely applied in software obfuscation, transforming programs …...
Octa: Omissions and Conflicts in Target-Aspect Sentiment Analysis
AbstractSentiments in opinionated text are often determined by both aspects and target words (or targets). We observe that targets and aspects interrelate in subtle ways, often yielding conflicting sentiments. Thus, …...
Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning
AbstractFine-tuning of pre-trained transformer models has become the standard approach for solving common NLP tasks. Most of the existing approaches rely on a randomly initialized classifier on top of such …...
Predicting the Topical Stance and Political Leaning of Media using Tweets
AbstractDiscovering the stances of media outlets and influential people on current, debatable topics is important for social statisticians and policy makers. Many supervised solutions exist for determining viewpoints, but manually …...
Probabilistic Case-based Reasoning for Open-World Knowledge Graph Completion
AbstractA case-based reasoning (CBR) system solves a new problem by retrieving ‘cases’ that are similar to the given problem. If such a system can achieve high accuracy, it is appealing …...
Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Case
AbstractSemantic embeddings have advanced the state of the art for countless natural language processing tasks, and various extensions to multimodal domains, such as visual-semantic embeddings, have been proposed. While the …...
Programming in Natural Language with fuSE: Synthesizing Methods from Spoken Utterances Using Deep Natural Language Understanding
AbstractThe key to effortless end-user programming is natural language. We examine how to teach intelligent systems new functions, expressed in natural language. As a first step, we collected 3168 samples …...
PRover: Proof Generation for Interpretable Reasoning over Rules
AbstractRecent work by Clark et al. (2020) shows that transformers can act as “soft theorem provers” by answering questions over explicitly provided knowledge in natural language. In our work, we …...
Selective Question Answering under Domain Shift
AbstractTo avoid giving wrong answers, question answering (QA) models need to know when to abstain from answering. Moreover, users often ask questions that diverge from the model’s training data, making …...
Semantic Scaffolds for Pseudocode-to-Code Generation
AbstractWe propose a method for program generation based on semantic scaffolds, lightweight structures representing the high-level semantic and syntactic composition of a program. By first searching over plausible scaffolds then …...
Semi-Automatic Construction and Refinement of an Annotated Corpus for a Deep Learning Framework for Emotion Classification
AbstractIn the case of using a deep learning (machine learning) framework for emotion classification, one significant difficulty faced is the requirement of building a large, emotion corpus in which each …...
Sign Language Recognition with Transformer Networks
AbstractSign languages are complex languages. Research into them is ongoing, supported by large video corpora of which only small parts are annotated. Sign language recognition can be used to speed …...
SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness
AbstractModels that perform well on a training domain often fail to generalize to out-of-domain (OOD) examples. Data augmentation is a common method used to prevent overfitting and improve OOD generalization. …...
SSN_NLP at SemEval-2020 Task 7: Detecting Funniness Level Using Traditional Learning with Sentence Embeddings
AbstractAssessing the funniness of edited news headlines task deals with estimating the humorness in the headlines edited with micro-edits. This task has two sub-tasks in which one has to calculate …...
Synthetic Data for English Lexical Normalization: How Close Can We Get to Manually Annotated Data?
AbstractSocial media is a valuable data resource for various natural language processing (NLP) tasks. However, standard NLP tools were often designed with standard texts in mind, and their performance decreases …...
Target-Guided Structured Attention Network for Target-Dependent Sentiment Analysis
AbstractTarget-dependent sentiment analysis (TDSA) aims to classify the sentiment of a text towards a given target. The major challenge of this task lies in modeling the semantic relatedness between a …...
Team Oulu at SemEval-2020 Task 12: Multilingual Identification of Offensive Language, Type and Target of Twitter Post Using Translated Datasets
AbstractWith the proliferation of social media platforms, anonymous discussions together with easy online access, reports on offensive content have caused serious concern to both authorities and research communities. Although there …...
The role of context in neural pitch accent detection in English
AbstractProsody is a rich information source in natural language, serving as a marker for phenomena such as contrast. In order to make this information available to downstream tasks, we need …...
Towards Interpretable Clinical Diagnosis with Bayesian Network Ensembles Stacked on Entity-Aware CNNs
AbstractThe automatic text-based diagnosis remains a challenging task for clinical use because it requires appropriate balance between accuracy and interpretability. In this paper, we attempt to propose a solution by …...
Translationese as a Language in “Multilingual” NMT
AbstractMachine translation has an undesirable propensity to produce “translationese” artifacts, which can lead to higher BLEU scores while being liked less by human raters. Motivated by this, we model translationese …...
TRANSLIT: A Large-scale Name Transliteration Resource
AbstractTransliteration is the process of expressing a proper name from a source language in the characters of a target language (e.g. from Cyrillic to Latin characters). We present TRANSLIT, a …...
Two-level classification for dialogue act recognition in task-oriented dialogues
AbstractDialogue act classification becomes a complex task when dealing with fine-grain labels. Many applications require such level of labelling, typically automatic dialogue systems. We present in this paper a 2-level …...
Understanding Advertisements with BERT
AbstractWe consider a task based on CVPR 2018 challenge dataset on advertisement (Ad) understanding. The task involves detecting the viewer’s interpretation of an Ad image captured as text. Recent results …...
UniTuebingenCL at SemEval-2020 Task 7: Humor Detection in News Headlines
AbstractThis paper describes the work done by the team UniTuebingenCL for the SemEval 2020 Task 7: “Assessing the Funniness of Edited News Headlines”. We participated in both sub-tasks: sub-task A, …...
Unsupervised Morphological Paradigm Completion
AbstractWe propose the task of unsupervised morphological paradigm completion. Given only raw text and a lemma list, the task consists of generating the morphological paradigms, i.e., all inflected forms, of …...
Unsupervised Text Style Transfer with Padded Masked Language Models
AbstractWe propose Masker, an unsupervised text-editing method for style transfer. To tackle cases when no parallel source–target pairs are available, we train masked language models (MLMs) for both the source …...
Using Eye-tracking Data to Predict the Readability of Brazilian Portuguese Sentences in Single-task, Multi-task and Sequential Transfer Learning Approaches
AbstractSentence complexity assessment is a relatively new task in Natural Language Processing. One of its aims is to highlight in a text which sentences are more complex to support the …...
Weakly Supervised Subevent Knowledge Acquisition
AbstractSubevents elaborate an event and widely exist in event descriptions. Subevent knowledge is useful for discourse analysis and event-centric applications. Acknowledging the scarcity of subevent knowledge, we propose a weakly …...
YNU-oxz at SemEval-2020 Task 4: Commonsense Validation Using BERT with Bidirectional GRU
AbstractThis paper describes the system and results of our team participated in SemEval-2020 Task4: Commonsense Validation and Explanation (ComVE), which aim to distinguish meaningful natural language statements from unreasonable natural …...
Zero-Shot Transfer Learning with Synthesized Data for Multi-Domain Dialogue State Tracking
AbstractZero-shot transfer learning for multi-domain dialogue state tracking can allow us to handle new domains without incurring the high cost of data acquisition. This paper proposes new zero-short transfer learning …...
“Does it Matter When I Think You Are Lying?” Improving Deception Detection by Integrating Interlocutor’s Judgements in Conversations
It is well known that human is not good at de- ception detection because of a natural inclina- tion of truth-bias. However, during a conversa- tion, when an interlocutor (interrogator) …...
A Domain-Independent Holistic Approach to Deception Detection
AbstractThe deception in the text can be of different forms in different domains, including fake news, rumor tweets, and spam emails. Irrespective of the domain, the main intent of the …...
A Few Topical Tweets are Enough for Effective User Stance Detection
AbstractUser stance detection entails ascertaining the position of a user towards a target, such as an entity, topic, or claim. Recent work that employs unsupervised classification has shown that performing …...
ADEPT: An Adjective-Dependent Plausibility Task
AbstractA false contract is more likely to be rejected than a contract is, yet a false key is less likely than a key to open doors. While correctly interpreting and …...
Aligning Actions Across Recipe Graphs
AbstractRecipe texts are an idiosyncratic form of instructional language that pose unique challenges for automatic understanding. One challenge is that a cooking step in one recipe can be explained in …...
An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games
AbstractGuessing games are a prototypical instance of the “learning by interacting” paradigm. This work investigates how well an artificial agent can benefit from playing guessing games when later asked to …...
Application of Mix-Up Method in Document Classification Task Using BERT
AbstractThe mix-up method (Zhang et al., 2017), one of the methods for data augmentation, is known to be easy to implement and highly effective. Although the mix-up method is intended …...
Are NLP Models really able to Solve Simple Math Word Problems?
AbstractThe problem of designing NLP solvers for math word problems (MWP) has seen sustained research activity and steady gains in the test accuracy. Since existing solvers achieve high performance on …...
Automated Concatenation of Embeddings for Structured Prediction
AbstractPretrained contextualized embeddings are powerful word representations for structured prediction tasks. Recent work found that better word representations can be obtained by concatenating different types of embeddings. However, the selection …...
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA
AbstractRecent works have shown that supervised models often exploit data artifacts to achieve good test scores while their performance severely degrades on samples outside their training distribution. Contrast sets (Gardneret …...
AUTOSUMM: Automatic Model Creation for Text Summarization
AbstractRecent efforts to develop deep learning models for text generation tasks such as extractive and abstractive summarization have resulted in state-of-the-art performances on various datasets. However, obtaining the best model …...
AVA: an Automatic eValuation Approach for Question Answering Systems
AbstractWe introduce AVA, an automatic evaluation approach for Question Answering, which given a set of questions associated with Gold Standard answers (references), can estimate system Accuracy. AVA uses Transformer-based language …...
BDCN: Semantic Embedding Self-explanatory Breast Diagnostic Capsules Network
AbstractBuilding an interpretable AI diagnosis system for breast cancer is an important embodiment ofAI assisted medicine. Traditional breast cancer diagnosis methods based on machine learning areeasy to explain but the …...
Can Language Models be Biomedical Knowledge Bases?
AbstractPre-trained language models (LMs) have become ubiquitous in solving various natural language processing (NLP) tasks. There has been increasing interest in what knowledge these LMs contain and how we can …...
Can the Transformer Learn Nested Recursion with Symbol Masking?
We investigate if, given a simple symbol mask- ing strategy, self-attention models are capable of learning nested structures and generalise over their depth. We do so in the simplest set- …...
Certified Robustness to Word Substitution Attack with Differential Privacy
AbstractThe robustness and security of natural language processing (NLP) models are significantly important in real-world applications. In the context of text classification tasks, adversarial examples can be designed by substituting …...
Clustering-based Inference for Biomedical Entity Linking
AbstractDue to large number of entities in biomedical knowledge bases, only a small fraction of entities have corresponding labelled training data. This necessitates entity linking models which are able to …...
Communicative-Function-Based Sentence Classification for Construction of an Academic Formulaic Expression Database
AbstractFormulaic expressions (FEs), such as ‘in this paper, we propose’ are frequently used in scientific papers. FEs convey a communicative function (CF), i.e. ‘showing the aim of the paper’ in …...
Complementary Evidence Identification in Open-Domain Question Answering
AbstractThis paper proposes a new problem of complementary evidence identification for open-domain question answering (QA). The problem aims to efficiently find a small set of passages that covers full evidence …...
Construction and Evaluation of Japanese Sentence-BERT Models
Sentence-BERT is model which based on “Bidirectional Encoder Representations from Transformers” (BERT) for building sentence embedding. This model has abilities for se- mantic analysis similar to BERT; however, the processing …...
Construction of MBTI Personality Estimation Model Considering Emotional Information
The widespread use of social networking ser- vices (SNSs) such as Twitter and Facebook in recent years have rendered it easy to in- teract with various people all over the …...
CoSQA: 20,000+ Web Queries for Code Search and Question Answering
AbstractFinding codes given natural language query is beneficial to the productivity of software developers. Future progress towards better semantic matching between query and code requires richer supervised training resources. To …...
Cryptonite: A Cryptic Crossword Benchmark for Extreme Ambiguity in Language
AbstractCurrent NLP datasets targeting ambiguity can be solved by a native speaker with relative ease. We present Cryptonite, a large-scale dataset based on cryptic crosswords, which is both linguistically complex …...
Curriculum Learning Effectively Improves Low Data VQA
AbstractVisual question answering (VQA) models, in particular modular ones, are commonly trained on large-scale datasets to achieve state-of-the-art performance. However, such datasets are sometimes not available. Further, it has been …...
Discrete and Soft Prompting for Multilingual Models
AbstractIt has been shown for English that discrete and soft prompting perform strongly in few-shot learning with pretrained language models (PLMs). In this paper, we show that discrete and soft …...
Discussion Structure Prediction Based on a Two-step Method
AbstractConversations are often held in laboratories and companies. A summary is vital to grasp the content of a discussion for people who did not attend the discussion. If the summary …...
Domain-Aware Dependency Parsing for Questions
Parsing natural language questions in specific domains is crucial to a wide range of applica- tions from question-answering to dialog sys- tems. Pre-trained parsers are usually trained on corpora dominated …...
DuluthNLP at SemEval-2021 Task 7: Fine-Tuning RoBERTa Model for Humor Detection and Offense Rating
AbstractThis paper presents the DuluthNLP submission to Task 7 of the SemEval 2021 competition on Detecting and Rating Humor and Offense. In it, we explain the approach used to train …...
Elastic weight consolidation for better bias inoculation
AbstractThe biases present in training datasets have been shown to affect models for sentence pair classification tasks such as natural language inference (NLI) and fact verification. While fine-tuning models on …...
Explainable Multi-hop Verbal Reasoning Through Internal Monologue
AbstractMany state-of-the-art (SOTA) language models have achieved high accuracy on several multi-hop reasoning problems. However, these approaches tend to not be interpretable because they do not make the intermediate reasoning …...
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models
AbstractCommonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained …...
Exploring the Relationship Between Algorithm Performance, Vocabulary, and Run-Time in Text Classification
AbstractText classification is a significant branch of natural language processing, and has many applications including document classification and sentiment analysis. Unsurprisingly, those who do text classification are concerned with the …...
Fiction in Russian Translation: A Translationese Study
AbstractThis paper presents a translationese study based on the parallel data from the Russian National Corpus (RNC). We explored differences between literary texts originally authored in Russian and fiction translated …...
Finnish Dialect Identification: The Effect of Audio and Text
AbstractFinnish is a language with multiple dialects that not only differ from each other in terms of accent (pronunciation) but also in terms of morphological forms and lexical choice. We …...
FLiText: A Faster and Lighter Semi-Supervised Text Classification with Convolution Networks
AbstractIn natural language processing (NLP), state-of-the-art (SOTA) semi-supervised learning (SSL) frameworks have shown great performance on deep pre-trained language models such as BERT, and are expected to significantly reduce the …...
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data
AbstractEvent forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or …...
Graph-based Fake News Detection using a Summarization Technique
AbstractNowadays, fake news is spreading in various ways, and this fake information is causing a lot of social damages. Thus the need to detect fake information is increasing to prevent …...
HateCheck: Functional Tests for Hate Speech Detection Models
AbstractDetecting online hate is a difficult task that even state-of-the-art models struggle with. Typically, hate speech detection models are evaluated by measuring their performance on held-out test data using metrics …...
How to Adapt Your Pretrained Multilingual Model to 1600 Languages
AbstractPretrained multilingual models (PMMs) enable zero-shot learning via cross-lingual transfer, performing best for languages seen during pretraining. While methods exist to improve performance for unseen languages, they have almost exclusively …...
Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding
AbstractDomain classification is the fundamental task in natural language understanding (NLU), which often requires fast accommodation to new emerging domains. This constraint makes it impossible to retrain all previous domains, …...
Identifying Medical Self-Disclosure in Online Communities
AbstractSelf-disclosure in online health conversations may offer a host of benefits, including earlier detection and treatment of medical issues that may have otherwise gone unaddressed. However, research analyzing medical self-disclosure …...
ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and Explanation
AbstractAn automated system that could assist a judge in predicting the outcome of a case would help expedite the judicial process. For such a system to be practically useful, predictions …...
Improving Multimodal fusion via Mutual Dependency Maximisation
AbstractMultimodal sentiment analysis is a trending area of research, and multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, …...
Improving Neural Language Processing with Named Entities
AbstractPretraining-based neural network models have demonstrated state-of-the-art (SOTA) performances on natural language processing (NLP) tasks. The most frequently used sentence representation for neural-based NLP methods is a sequence of subwords …...
Improving Paraphrase Detection with the Adversarial Paraphrasing Task
AbstractIf two sentences have the same meaning, it should follow that they are equivalent in their inferential properties, i.e., each sentence should textually entail the other. However, many paraphrase datasets …...
Inducing Transformer’s Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks
AbstractSystematic compositionality is an essential mechanism in human language, allowing the recombination of known parts to create novel expressions. However, existing neural models have been shown to lack this basic …...
Instance-Based Neural Dependency Parsing
AbstractInterpretable rationales for model predictions are crucial in practical applications. We develop neural models that possess an interpretable inference process for dependency parsing. Our models adopt instance-based inference, where dependency …...
Learning to Find Translation of Grammar Patterns in Parallel Corpus
AbstractWe introduce a method for assisting English as Second Language (ESL) learners by providing translations of Collins COBUILD grammar patterns(GP) for a given word. In our approach, bilingual parallel corpus …...
Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography
AbstractTexts written in Old Literary Finnish represent the first literary work ever written in Finnish starting from the 16th century. There have been several projects in Finland that have digitized …...
Machine Translated Text Detection Through Text Similarity with Round-Trip Translation
AbstractTranslated texts have been used for malicious purposes, i.e., plagiarism or fake reviews. Existing detectors have been built around a specific translator (e.g., Google) but fail to detect a translated …...
MLEC-QA: A Chinese Multi-Choice Biomedical Question Answering Dataset
AbstractQuestion Answering (QA) has been successfully applied in scenarios of human-computer interaction such as chatbots and search engines. However, for the specific biomedical domain, QA systems are still immature due …...
Multi-modal Intent Classification for Assistive Robots with Large-scale Naturalistic Datasets
AbstractRecent years have brought a tremendous growth in assistive robots/prosthetics for people with partial or complete loss of upper limb control. These technologies aim to help the users with various …...
NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases
AbstractCodifying commonsense knowledge in machines is a longstanding goal of artificial intelligence. Recently, much progress toward this goal has been made with automatic knowledge base (KB) construction techniques. However, such …...
Neural Network Surgery: Injecting Data Patterns into Pre-trained Models with Minimal Instance-wise Side Effects
AbstractSide effects during neural network tuning are typically measured by overall accuracy changes. However, we find that even with similar overall accuracy, existing tuning methods result in non-negligible instance-wise side …...
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer
AbstractThis paper presents a technical report of our submission to the 4th task of SemEval-2021, titled: Reading Comprehension of Abstract Meaning. In this task, we want to predict the correct …...
Open Aspect Target Sentiment Classification with Natural Language Prompts
AbstractFor many business applications, we often seek to analyze sentiments associated with any arbitrary aspects of commercial products, despite having a very limited amount of labels or even without any …...
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them
AbstractOpen-domain Question Answering models that directly leverage question-answer (QA) pairs, such as closed-book QA (CBQA) models and QA-pair retrievers, show promise in terms of speed and memory compared with conventional …...
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World
AbstractWe propose PIGLeT: a model that learns physical commonsense knowledge through interaction, and then uses this knowledge to ground language. We factorize PIGLeT into a physical dynamics model, and a …...
Quick, get me a Dr. BERT: Automatic Grading of Evidence using Transfer Learning
AbstractWe describe our methods for automatically grading the level of clinical evidence in medical papers, as part of the ALTA 2021 shared task. We use a combination of transfer learning …...
Restoring and Mining the Records of the Joseon Dynasty via Neural Language Modeling and Machine Translation
AbstractUnderstanding voluminous historical records provides clues on the past in various aspects, such as social and political issues and even natural science facts. However, it is generally difficult to fully …...
Revisiting Negation in Neural Machine Translation
AbstractIn this paper, we evaluate the translation of negation both automatically and manually, in English–German (EN–DE) and English– Chinese (EN–ZH). We show that the ability of neural machine translation (NMT) …...
Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution
AbstractRecent studies have shown that deep neural network-based models are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural …...
SituatedQA: Incorporating Extra-Linguistic Contexts into QA
AbstractAnswers to the same question may change depending on the extra-linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an open-retrieval QA dataset …...
Softmax Tree: An Accurate, Fast Classifier When the Number of Classes Is Large
AbstractClassification problems having thousands or more classes naturally occur in NLP, for example language models or document classification. A softmax or one-vs-all classifier naturally handles many classes, but it is …...
Streaming Models for Joint Speech Recognition and Translation
AbstractUsing end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated …...
Stronger Baseline for Robust Results in Multimodal Sentiment Analysis
Significant progress in sentiment analysis and emotion recognition has been made recently, and there has also been an increase in the re- quirements for solving real-world problems. However, human language …...
Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification
AbstractGrowing concern with online misinformation has encouraged NLP research on fact verification. Since writers often base their assertions on structured data, we focus here on verifying textual statements given evidence …...
Syntax and Themes: How Context Free Grammar Rules and Semantic Word Association Influence Book Success
AbstractIn this paper, we attempt to improve upon the state-of-the-art in predicting a novel’s success by modeling the lexical semantic relationships of its contents. We created the largest dataset used …...
Synthetic Textual Features for the Large-Scale Detection of Basic-level Categories in English and Mandarin
AbstractBasic-level categories (BLC) are an important psycholinguistic concept introduced by Rosch et al. (1976); they are defined as the most inclusive categories for which a concrete mental image of the …...
Targeted Adversarial Training for Natural Language Understanding
AbstractWe present a simple yet effective Targeted Adversarial Training (TAT) algorithm to improve adversarial training for natural language understanding. The key idea is to introspect current mistakes and prioritize adversarial …...
TEMP: Taxonomy Expansion with Dynamic Margin Loss through Taxonomy-Paths
AbstractAs an essential form of knowledge representation, taxonomies are widely used in various downstream natural language processing tasks. However, with the continuously rising of new concepts, many existing taxonomies are …...
To POS Tag or Not to POS Tag: The Impact of POS Tags on Morphological Learning in Low-Resource Settings
AbstractPart-of-Speech (POS) tags are routinely included as features in many NLP tasks. However, the importance and usefulness of POS tags needs to be examined as NLP expands to low-resource languages …...
Towards More Fine-grained and Reliable NLP Performance Prediction
AbstractPerformance prediction, the task of estimating a system’s performance without performing experiments, allows us to reduce the experimental burden caused by the combinatorial explosion of different datasets, languages, tasks, and …...
TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graph
AbstractMulti-hop Question Answering (QA) is a challenging task because it requires precise reasoning with entity relations at every step towards the answer. The relations can be represented in terms of …...
Universal Semantic Tagging for English and Mandarin Chinese
AbstractUniversal Semantic Tagging aims to provide lightweight unified analysis for all languages at the word level. Though the proposed annotation scheme is conceptually promising, the feasibility is only examined in …...
UoR at SemEval-2021 Task 7: Utilizing Pre-trained DistilBERT Model and Multi-scale CNN for Humor Detection
AbstractHumour detection is an interesting but difficult task in NLP. Because humorous might not be obvious in text, it can be embedded into context, hide behind the literal meaning and …...
UPB at SemEval-2021 Task 7: Adversarial Multi-Task Learning for Detecting and Rating Humor and Offense
AbstractDetecting humor is a challenging task since words might share multiple valences and, depending on the context, the same words can be even used in offensive expressions. Neural network architectures …...
UserAdapter: Few-Shot User Learning in Sentiment Analysis
Adapting a model to a handful of personal- ized data is challenging, especially when it has gigantic parameters, such as a Transformer- based pretrained model. The standard way of fine-tuning …...
Value-Agnostic Conversational Semantic Parsing
AbstractConversational semantic parsers map user utterances to executable programs given dialogue histories composed of previous utterances, programs, and system responses. Existing parsers typically condition on rich representations of history that …...
ViVQA: Vietnamese Visual Question Answering
Visual question answering (VQA) is a hot topic that has recently drew the atten- tion of researchers from domains as di- verse as natural language processing and computer vision. In …...
ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning
AbstractThis paper presents our systems for the three Subtasks of SemEval Task4: Reading Comprehension of Abstract Meaning (ReCAM). We explain the algorithms used to learn our models and the process …...
‘Am I the Bad One’? Predicting the Moral Judgement of the Crowd Using Pre–trained Language Models
AbstractNatural language processing (NLP) has been shown to perform well in various tasks, such as answering questions, ascertaining natural language inference and anomaly detection. However, there are few NLP-related studies …...
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-Based Sentiment Analysis
AbstractAspect-based sentiment analysis (ABSA) is a fine-grained sentiment analysis task, which focuses on detecting the sentiment polarity towards the aspect in a sentence. However, it is always sensitive to the …...
A Corpus for Commonsense Inference in Story Cloze Test
AbstractThe Story Cloze Test (SCT) is designed for training and evaluating machine learning algorithms for narrative understanding and inferences. The SOTA models can achieve over 90% accuracy on predicting the …...
A Few-Shot Semantic Parser for Wizard-of-Oz Dialogues with the Precise ThingTalk Representation
AbstractPrevious attempts to build effective semantic parsers for Wizard-of-Oz (WOZ) conversations suffer from the difficulty in acquiring a high-quality, manually annotated training set. Approaches based only on dialogue synthesis are …...
A Novel Multi-Task Learning Approach for Context-Sensitive Compound Type Identification in Sanskrit
AbstractThe phenomenon of compounding is ubiquitous in Sanskrit. It serves for achieving brevity in expressing thoughts, while simultaneously enriching the lexical and structural formation of the language. In this work, …...
Accuracy meets Diversity in a News Recommender System
AbstractNews recommender systems face certain challenges. These challenges arise due to evolving users’ preferences over dynamically created news articles. The diversity is necessary for a news recommender system to expose …...
Addressing Limitations of Encoder-Decoder Based Approach to Text-to-SQL
AbstractMost attempts on Text-to-SQL task using encoder-decoder approach show a big problem of dramatic decline in performance for new databases. For the popular Spider dataset, despite models achieving 70% accuracy …...
AGILe: The First Lemmatizer for Ancient Greek Inscriptions
AbstractTo facilitate corpus searches by classicists as well as to reduce data sparsity when training models, we focus on the automatic lemmatization of ancient Greek inscriptions, which have not received …...
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages
AbstractPretrained multilingual models are able to perform cross-lingual transfer in a zero-shot setting, even for languages unseen during pretraining. However, prior work evaluating performance on unseen languages has largely been …...
An Augmented Benchmark Dataset for Geometric Question Answering through Dual Parallel Text Encoding
AbstractAutomatic math problem solving has attracted much attention of NLP researchers recently. However, most of the works focus on the solving of Math Word Problems (MWPs). In this paper, we …...
An Empirical Comparison of off-the-shelve Semantic Similarity methods for down-streaming Meeting Similarity
Automatic Minuting consists of automati- cally creating minutes from multiparty meet- ing transcripts. In this paper, we solve two rel- evant problems of this domain (1) given a pair of …...
An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels
AbstractPre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, …...
AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition
AbstractWe present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from …...
Automated Crossword Solving
AbstractWe present the Berkeley Crossword Solver, a state-of-the-art approach for automatically solving crossword puzzles. Our system works by generating answer candidates for each crossword clue using neural question answering models …...
Automatic Construction of an Annotated Corpus with Implicit Aspects
AbstractAspect-based sentiment analysis (ABSA) is a task that involves classifying the polarity of aspects of the products or services described in users’ reviews. Most previous work on ABSA has focused …...
Automatic Discrimination of Human and Neural Machine Translation: A Study with Multiple Pre-Trained Models and Longer Context
AbstractWe address the task of automatically distinguishing between human-translated (HT) and machine translated (MT) texts. Following recent work, we fine-tune pre-trained language models (LMs) to perform this task. Our work …...
BBQ: A hand-built bias benchmark for question answering
AbstractIt is well documented that NLP models learn social biases, but little work has been done on how these biases manifest in model outputs for applied tasks like question answering …...
Building Large-Scale Japanese Pronunciation-Annotated Corpora for Reading Heteronymous Logograms
AbstractAlthough screen readers enable visually impaired people to read written text via speech, the ambiguities in pronunciations of heteronyms cause wrong reading, which has a serious impact on the text …...
Can We Guide a Multi-Hop Reasoning Language Model to Incrementally Learn at Each Single-Hop?
AbstractDespite the success of state-of-the-art pre-trained language models (PLMs) on a series of multi-hop reasoning tasks, they still suffer from their limited abilities to transfer learning from simple to complex …...
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference
AbstractNatural Language Inference (NLI) datasets contain examples with highly ambiguous labels due to its subjectivity. Several recent efforts have been made to acknowledge and embrace the existence of ambiguity, and …...
Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label Graphs
AbstractRecent graph-based models for joint multiple intent detection and slot filling have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. …...
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks
AbstractQuantization, knowledge distillation, and magnitude pruning are among the most popular methods for neural network compression in NLP. Independently, these methods reduce model size and can accelerate inference, but their …...
Compositional generalization with a broad-coverage semantic parser
AbstractWe show how the AM parser, a compositional semantic parser (Groschwitz et al., 2018) can solve compositional generalization on the COGS dataset. It is the first semantic parser that achieves …...
Controlling Formality in Low-Resource NMT with Domain Adaptation and Re-Ranking: SLT-CDT-UoS at IWSLT2022
AbstractThis paper describes the SLT-CDT-UoS group’s submission to the first Special Task on Formality Control for Spoken Language Translation, part of the IWSLT 2022 Evaluation Campaign. Our efforts were split …...
ConvTextTM: An Explainable Convolutional Tsetlin Machine Framework for Text Classification
AbstractRecent advancements in natural language processing (NLP) have reshaped the industry, with powerful language models such as GPT-3 achieving superhuman performance on various tasks. However, the increasing complexity of such …...
Dataset Construction for Scientific-Document Writing Support by Extracting Related Work Section and Citations from PDF Papers
AbstractTo augment datasets used for scientific-document writing support research, we extract texts from “Related Work” sections and citation information in PDF-formatted papers published in English. The previous dataset was constructed …...
Deduplicating Training Data Makes Language Models Better
AbstractWe find that existing language modeling datasets contain many near-duplicate examples and long repetitive substrings. As a result, over 1% of the unprompted output of language models trained on these …...
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
AbstractGenerative commonsense reasoning (GCR) in natural language is to reason about the commonsense while generating coherent text. Recent years have seen a surge of interest in improving the generation quality …...
DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation
AbstractNatural language processing (NLP) algorithms have become very successful, but they still struggle when applied to out-of-distribution examples. In this paper we propose a controllable generation approach in order to …...
DuluthNLP at SemEval-2022 Task 7: Classifying Plausible Alternatives with Pre–trained ELECTRA
AbstractThis paper describes the DuluthNLP system that participated in Task 7 of SemEval-2022 on Identifying Plausible Clarifications of Implicit and Underspecified Phrases in Instructional Texts. Given an instructional text with …...
Evaluating the Performance of Transformer-based Language Models for Neuroatypical Language
AbstractDifficulties with social aspects of language are among the hallmarks of autism spectrum disorder (ASD). These communication differences are thought to contribute to the challenges that adults with ASD experience …...
Evaluation of HTR models without Ground Truth Material
AbstractThe evaluation of Handwritten Text Recognition (HTR) models during their development is straightforward: because HTR is a supervised problem, the usual data split into training, validation, and test data sets …...
Explainable Tsetlin Machine Framework for Fake News Detection with Credibility Score Assessment
AbstractThe proliferation of fake news, i.e., news intentionally spread for misinformation, poses a threat to individuals and society. Despite various fact-checking websites such as PolitiFact, robust detection techniques are required …...
Fine-tuning a Subtle Parsing Distinction Using a Probabilistic Decision Tree: the Case of Postnominal “that” in Noun Complement Clauses vs. Relative Clauses
In this paper we investigated two different meth- ods to parse relative and noun complement clauses in English and resorted to distinct tags for their corresponding that as a relative …...
Finnish Hate-Speech Detection on Social Media Using CNN and FinBERT
AbstractThere has been a lot of research in identifying hate posts from social media because of their detrimental effects on both individuals and society. The majority of this research has …...
Fixing Model Bugs with Natural Language Patches
AbstractCurrent approaches for fixing systematic problems in NLP models (e.g., regex patches, finetuning on more data) are either brittle, or labor-intensive and liable to shortcuts. In contrast, humans often provide …...
Generating Temporally-ordered Event Sequences via Event Optimal Transport
AbstractGenerating temporally-ordered event sequences in texts is important to natural language processing. Two emerging tasks in this direction are temporal event ordering (rearranging the set of events to correct order) …...
Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Filling
AbstractRecent joint multiple intent detection and slot filling models employ label embeddings to achieve the semantics-label interactions. However, they treat all labels and label embeddings as uncorrelated individuals, ignoring the …...
HRCA+: Advanced Multiple-choice Machine Reading Comprehension Method
AbstractMultiple-choice question answering (MCQA) for machine reading comprehension (MRC) is challenging. It requires a model to select a correct answer from several candidate options related to text passages or dialogue. …...
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation
AbstractThe multi-head self-attention mechanism of the transformer model has been thoroughly investigated recently. In one vein of study, researchers are interested in understanding why and how transformers work. In another …...
HW-TSC’s Submissions to the WMT22 Word-Level Auto Completion Task
AbstractThis paper presents the submissions of Huawei Translation Services Center (HW-TSC) to WMT 2022 Word-Level AutoCompletion Task. We propose an end-to-end autoregressive model with bi-context based on Transformer to solve …...
Image Retrieval from Contextual Descriptions
AbstractThe ability to integrate context, including perceptual and temporal cues, plays a pivotal role in grounding the meaning of a linguistic utterance. In order to measure to what extent current …...
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge
AbstractTo perform well on a machine reading comprehension (MRC) task, machine readers usually require commonsense knowledge that is not explicitly mentioned in the given documents. This paper aims to extract …...
Incremental Intent Detection for Medical Domain with Contrast Replay Networks
AbstractConventional approaches to medical intent detection require fixed pre-defined intent categories. However, due to the incessant emergence of new medical intents in the real world, such requirement is not practical. …...
InferES : A Natural Language Inference Corpus for Spanish Featuring Negation-Based Contrastive and Adversarial Examples
AbstractIn this paper we present InferES - an original corpus for Natural Language Inference (NLI) in European Spanish. We propose, implement, and analyze a variety of corpus-creating strategies utilizing expert …...
KaFSP: Knowledge-Aware Fuzzy Semantic Parsing for Conversational Question Answering over a Large-Scale Knowledge Base
AbstractIn this paper, we study two issues of semantic parsing approaches to conversational question answering over a large-scale knowledge base: (1) The actions defined in grammar are not sufficient to …...
Learning Cross-Lingual IR from an English Retriever
AbstractWe present DR.DECR (Dense Retrieval with Distillation-Enhanced Cross-Lingual Representation), a new cross-lingual information retrieval (CLIR) system trained using multi-stage knowledge distillation (KD). The teacher of DR.DECR relies on a highly …...
Legal Case Winning Party Prediction With Domain Specific Auxiliary Models
AbstractSifting through hundreds of old case documents to obtain information pertinent to the case in hand has been a major part of the legal profession for centuries. However, with the …...
Leveraging Wikipedia article evolution for promotional tone detection
AbstractDetecting biased language is useful for a variety of applications, such as identifying hyperpartisan news sources or flagging one-sided rhetoric. In this work we introduce WikiEvolve, a dataset for document-level …...
Lingua Custodia’s Participation at the WMT 2022 Word-Level Auto-completion Shared Task
AbstractThis paper presents Lingua Custodia’s submission to the WMT22 shared task on Word Level Auto-completion (WLAC). We consider two directions, namely German-English and English-German.The WLAC task in Neural Machine Translation …...
Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations
AbstractPre-trained language models (LMs) struggle with consistent reasoning; recently, prompting LMs to generate explanations that self-guide the inference has emerged as a promising direction to amend this. However, these approaches …...
Measuring Robustness for NLP
AbstractThe quality of Natural Language Processing (NLP) models is typically measured by the accuracy or error rate of a predefined test set. Because the evaluation and optimization of these measures …...
MetaPrompting: Learning to Learn Better Prompts
AbstractPrompting method is regarded as one of the crucial progress for few-shot nature language processing. Recent research on prompting moves from discrete tokens based “hard prompts” to continuous “soft prompts”, …...
Multimodal Pipeline for Collection of Misinformation Data from Telegram
AbstractThe paper presents the outcomes of AI-COVID19, our project aimed at better understanding of misinformation flow about COVID-19 across social media platforms. The specific focus of the study reported in …...
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text
AbstractWhile language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring …...
Novelty Detection in Community Question Answering Forums
Community Question Answering (CQA) fo- rums are a popular place for open-ended question-answers and discussions by the pub- lic. Popular question answering sites have become a one-stop solution for the …...
On the Robustness of Offensive Language Classifiers
AbstractSocial media platforms are deploying machine learning based offensive language classification systems to combat hateful, racist, and other forms of offensive speech at scale. However, despite their real-world deployment, we …...
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval
AbstractAligning parallel sentences in multilingual corpora is essential to curating data for downstream applications such as Machine Translation. In this work, we present OneAligner, an alignment model specially designed for …...
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining
AbstractDespite the success of multilingual sequence-to-sequence pretraining, most existing approaches rely on monolingual corpora and do not make use of the strong cross-lingual signal contained in parallel data. In this …...
PCR4ALL: A Comprehensive Evaluation Benchmark for Pronoun Coreference Resolution in English
AbstractPronoun Coreference Resolution (PCR) is the task of resolving pronominal expressions to all mentions they refer to. The correct resolution of pronouns typically involves the complex inference over both linguistic …...
Persian Natural Language Inference: A Meta-learning Approach
AbstractIncorporating information from other languages can improve the results of tasks in low-resource languages. A powerful method of building functional natural language processing systems for low-resource languages is to combine …...
Probing Multilingual Cognate Prediction Models
AbstractCharacter-based neural machine translation models have become the reference models for cognate prediction, a historical linguistics task. So far, all linguistic interpretations about latent information captured by such models have …...
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts
AbstractFine-tuning continuous prompts for target tasks has recently emerged as a compact alternative to full model fine-tuning. Motivated by these promising results, we investigate the feasibility of extracting a discrete …...
Prompt-Based Meta-Learning For Few-shot Text Classification
AbstractFew-shot Text Classification predicts the semantic label of a given text with a handful of supporting instances. Current meta-learning methods have achieved satisfying results in various few-shot situations. Still, they …...
ProtoTEx: Explaining Model Decisions with Prototype Tensors
AbstractWe present ProtoTEx, a novel white-box NLP classification architecture based on prototype networks (Li et al., 2018). ProtoTEx faithfully explains model decisions based on prototype tensors that encode latent clusters …...
Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval
AbstractCurrent state-of-the-art approaches to cross- modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. …...
SciNLI: A Corpus for Natural Language Inference on Scientific Text
AbstractExisting Natural Language Inference (NLI) datasets, while being instrumental in the advancement of Natural Language Understanding (NLU) research, are not related to scientific text. In this paper, we introduce SciNLI, …...
SCU-MESCLab at ROCLING-2022 Shared Task: Named Entity Recognition Using BERT Classifier
AbstractIn this study, named entity recognition is constructed and applied in the medical domain. Data is labeled in BIO format. For example, “muscle” would be labeled “B-BODY” and “I-BODY”, and …...
Selecting Stickers in Open-Domain Dialogue through Multitask Learning
AbstractWith the increasing popularity of online chatting, stickers are becoming important in our online communication. Selecting appropriate stickers in open-domain dialogue requires a comprehensive understanding of both dialogues and stickers, …...
Semantic Role Labelling for Dutch Law Texts
AbstractLegal texts are often difficult to interpret, and people who interpret them need to make choices about the interpretation. To improve transparency, the interpretation of a legal text can be …...
Sentiment Analysis on Twitter for the Major German Parties during the 2021 German Federal Election
We present the results of a project perform- ing sentiment analysis on tweets from Ger- man politicians and party accounts for the 2021 German federal election. We collected over 58,000 …...
SHIELD: Defending Textual Neural Networks against Multiple Black-Box Adversarial Attacks with Stochastic Multi-Expert Patcher
AbstractEven though several methods have proposed to defend textual neural network (NN) models against black-box adversarial attacks, they often defend against a specific text perturbation strategy and/or require re-training the …...
SLING: Sino Linguistic Evaluation of Large Language Models
AbstractTo understand what kinds of linguistic knowledge are encoded by pretrained Chinese language models (LMs), we introduce the benchmark of Sino LINGuistics (SLING), which consists of 38K minimal sentence pairs …...
SPACL: Shared-Private Architecture based on Contrastive Learning for Multi-domain Text Classification
Abstract“With the development of deep learning in recent years, text classification research has achieved remarkable results. However, text classification task often requires a large amount of annotated data, and data …...
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching
AbstractNatural language processing (NLP) models trained on people-generated data can be unreliable because, without any constraints, they can learn from spurious correlations that are not relevant to the task. We …...
SSN_MLRG1 at SemEval-2022 Task 10: Structured Sentiment Analysis using 2-layer BiLSTM
AbstractTask 10 in SemEval 2022 is a composite task which entails analysis of opinion tuples, and recognition and demarcation of their nature. In this paper, we will elaborate on how …...
Structured Pruning Learns Compact and Accurate Models
AbstractThe growing size of neural language models has led to increased attention in model compression. The two predominant approaches are pruning, which gradually removes weights from a pre-trained model, and …...
Table-based Fact Verification with Self-adaptive Mixture of Experts
AbstractThe table-based fact verification task has recently gained widespread attention and yet remains to be a very challenging problem. It inherently requires informative reasoning over natural language together with different …...
Text Classification Using a Graph Based on Relationships Between Documents
Text classification, which determines the genre of a document based on cues such as the co- occurrence of words and their frequency of occurrence, has been studied in various approaches …...
The Norwegian Dialect Corpus Treebank
AbstractThis paper presents the NDC Treebank of spoken Norwegian dialects in the Bokmål variety of Norwegian. It consists of dialect recordings made between 2006 and 2012 which have been digitised, …...
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline
AbstractSupersized pre-trained language models have pushed the accuracy of various natural language processing (NLP) tasks to a new state-of-the-art (SOTA). Rather than pursuing the reachless SOTA accuracy, more and more …...
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
AbstractThe task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive …...
UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression
AbstractGeometry problem solving is a well-recognized testbed for evaluating the high-level multi-modal reasoning capability of deep models. In most existing works, two main geometry problems: calculation and proving, are usually …...
Unsupervised Natural Language Inference Using PHL Triplet Generation
AbstractTransformer-based models achieve impressive performance on numerous Natural Language Inference (NLI) benchmarks when trained on respective training datasets. However, in certain cases, training samples may not be available or collecting …...
Using Convolution Neural Network with BERT for Stance Detection in Vietnamese
AbstractStance detection is the task of automatically eliciting stance information towards a specific claim made by a primary author. While most studies have been done for high-resource languages, this work …...
ViNLI: A Vietnamese Corpus for Studies on Open-Domain Natural Language Inference
AbstractOver a decade, the research field of computational linguistics has witnessed the growth of corpora and models for natural language inference (NLI) for rich-resource languages such as English and Chinese. …...
Vocabulary expansion of compound words for domain adaptation of BERT
Pretraining models such as BERT, have achieved high accuracy in various natu- ral language processing tasks by pretrain- ing on a large corpus and fine-tuning on downstream task data. However, …...
What Makes Instruction Learning Hard? An Investigation and a New Challenge in a Synthetic Environment
AbstractThe instruction learning paradigm—where a model learns to perform new tasks from task descriptions alone—has become popular in research on general-purpose models. The capabilities of large transformer models as instruction …...
“John is 50 years old, can his son be 65?” Evaluating NLP Models’ Understanding of Feasibility
AbstractIn current NLP research, large-scale language models and their abilities are widely being discussed. Some recent works have also found notable failures of these models. Often these failure examples involve …...
CAME: Confidence-guided Adaptive Memory Efficient Optimization
AbstractAdaptive gradient methods, such as Adam and LAMB, have demonstrated excellent performance in the training of large language models. Nevertheless, the need for adaptivity requires maintaining second-moment estimates of the …...
Clark Kent at SemEval-2023 Task 5: SVMs, Transformers, and Pixels for Clickbait Spoiling
AbstractIn this paper we present an analysis of our approaches for the 2023 SemEval-2023 Clickbait Challenge. We only participated in the sub-task aiming at identifying different clikcbait spoiling types comparing …...
Classifying COVID-19 Vaccine Narratives
AbstractVaccine hesitancy is widespread, despite the government’s information campaigns and the efforts of the World Health Organisation (WHO). Categorising the topics within vaccine-related narratives is crucial to understand the concerns …...
Combo of Thinking and Observing for Outside-Knowledge VQA
AbstractOutside-knowledge visual question answering is a challenging task that requires both the acquisition and the use of open-ended real-world knowledge. Some existing solutions draw external knowledge into the cross-modality space …...
Compact CNNs for End-to-End Keyword Spotting on Resource-Constrained Edge AI Devices
In this paper, we explore compact convolutional neural networks (CNNs) for end-to-end key- word spotting from raw audio to final recogni- tion results, without using traditional feature extraction based on …...
Controlling Learned Effects to Reduce Spurious Correlations in Text Classifiers
AbstractTo address the problem of NLP classifiers learning spurious correlations between training features and target labels, a common approach is to make the model’s predictions invariant to these features. However, …...
Data Augmentation for Fake Reviews Detection
AbstractIn this research, we studied the relationship between data augmentation and model accuracy for the task of fake review detection. We used data generation methods to augment two different fake …...
Data Augmentation for Radiology Report Simplification
AbstractThis work considers the development of a text simplification model to help patients better understand their radiology reports. This paper proposes a data augmentation approach to address the data scarcity …...
Data Curation Alone Can Stabilize In-context Learning
AbstractIn-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive …...
Delving Deeper into Cross-lingual Visual Question Answering
AbstractVisual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. …...
Do Androids Laugh at Electric Sheep? Humor “Understanding” Benchmarks from The New Yorker Caption Contest
AbstractLarge neural networks can now generate jokes, but do they really “understand” humor? We challenge AI models with three tasks derived from the New Yorker Cartoon Caption Contest: matching a …...
Document Flattening: Beyond Concatenating Context for Document-Level Neural Machine Translation
AbstractExisting work in document-level neural machine translation commonly concatenates several consecutive sentences as a pseudo-document, and then learns inter-sentential dependencies. This strategy limits the model’s ability to leverage information from …...
Early Discovery of Disappearing Entities in Microblogs
AbstractWe make decisions by reacting to changes in the real world, particularly the emergence and disappearance of impermanent entities such as restaurants, services, and events. Because we want to avoid …...
Evaluating Unsupervised Hierarchical Topic Models Using a Labeled Dataset
AbstractTopic modeling is a commonly used method for identifying and extracting topics from a corpus of documents. While several evaluation techniques, such as perplexity and topic coherence, have been developed …...
FLamE: Few-shot Learning from Natural Language Explanations
AbstractNatural language explanations have the potential to provide rich information that in principle guides model reasoning. Yet, recent work by Lampinen et al. has shown limited utility of natural language …...
From Stigma to Support: A Parallel Monolingual Corpus and NLP Approach for Neutralizing Mental Illness Bias
AbstractNegative attitudes and perceptions towards mental illness continue to be pervasive in our society. One of the factors contributing to and reinforcing this stigma is the usage of language that …...
Interpretable Math Word Problem Solution Generation via Step-by-step Planning
AbstractSolutions to math word problems (MWPs) with step-by-step explanations are valuable, especially in education, to help students better comprehend problem-solving strategies. Most existing approaches only focus on obtaining the final …...
LAMBADA: Backward Chaining for Automated Reasoning in Natural Language
AbstractRemarkable progress has been made on automated reasoning with natural text, by using Large Language Models (LLMs) and methods such as Chain-of-Thought prompting and Selection-Inference. These techniques search for proofs …...
Learning on Structured Documents for Conditional Question Answering
Abstract“Conditional question answering (CQA) is an important task in natural language processing thatinvolves answering questions that depend on specific conditions. CQA is crucial for domainsthat require the provision of personalized …...
Learning the Legibility of Visual Text Perturbations
AbstractMany adversarial attacks in NLP perturb text in puts to produce visually similar strings (‘ergo’, ‘εrgo’) which are legible to humans but degrade model performance. Although preserving legibility is a …...
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning
AbstractTwo-Tower Vision-Language (VL) models have shown promising improvements on various downstream VL tasks. Although the most advanced work improves performance by building bridges between encoders, it suffers from ineffective layer-by-layer …...
MISGENDERED: Limits of Large Language Models in Understanding Pronouns
AbstractContent Warning: This paper contains examples of misgendering and erasure that could be offensive and potentially triggering. Gender bias in language technologies has been widely studied, but research has mostly …...
PAED: Zero-Shot Persona Attribute Extraction in Dialogues
AbstractPersona attribute extraction is critical for personalized human-computer interaction. Dialogue is an important medium that communicates and delivers persona information. Although there is a public dataset for triplet-based persona attribute …...
Privacy-Preserving Domain Adaptation of Semantic Parsers
AbstractTask-oriented dialogue systems often assist users with personal or confidential matters. For this reason, the developers of such a system are generally prohibited from observing actual usage. So how can …...
Probabilistic Robustness for Data Filtering
AbstractWe introduce our probabilistic robustness rewarded data optimization (PRoDO) approach as a framework to enhance the model’s generalization power by selecting training data that optimizes our probabilistic robustness metrics. We …...
Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking
AbstractEvidence data for automated fact-checking (AFC) can be in multiple modalities such as text, tables, images, audio, or video. While there is increasing interest in using images for AFC, previous …...
Resolving Indirect Referring Expressions for Entity Selection
AbstractRecent advances in language modeling have enabled new conversational systems. In particular, it is often desirable for people to make choices among specified options when using such systems. We address …...
Stanford MLab at SemEval 2023 Task 7: Neural Methods for Clinical Trial Report NLI
AbstractWe present a system for natural language inference in breast cancer clinical trial reports, as framed by SemEval 2023 Task 7: Multi-evidence Natural Language Inference for Clinical Trial Data. In …...
SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains
AbstractPrompting pre-trained language models leads to promising results across natural language processing tasks but is less effective when applied in low-resource domains, due to the domain gap between the pre-training …...
TwiRGCN: Temporally Weighted Graph Convolution for Question Answering over Temporal Knowledge Graphs
AbstractRecent years have witnessed interest in Temporal Question Answering over Knowledge Graphs (TKGQA), resulting in the development of multiple methods. However, these are highly engineered, thereby limiting their generalizability, and …...
UAlberta at SemEval-2023 Task 1: Context Augmentation and Translation for Multilingual Visual Word Sense Disambiguation
AbstractWe describe the systems of the University of Alberta team for the SemEval-2023 Visual Word Sense Disambiguation (V-WSD) Task. We present a novel algorithm that leverages glosses retrieved from BabelNet, …...
Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Framework
AbstractAs large language models (LLMs) have become the norm in NLP, demonstrating good performance in generation and reasoning tasks, one of its most fatal disadvantages is the lack of factual …...
Walter Burns at SemEval-2023 Task 5: NLP-CIMAT - Leveraging Model Ensembles for Clickbait Spoiling
AbstractThis paper describes our participation in the Clickbait challenge at SemEval 2023. In this work, we address the Clickbait classification task using transformers models in an ensemble configuration. We tackle …...