Evaluation Results
Related Papers
Automatically generating hypertext in newspaper articles by computing semantic relatedness
We discuss an automatic method for the construction of hypertext links within and between newspaper articles. The method comprises three steps: determining the lexical chains in a text, building links …...
Hybrid Disambiguation of Prepositional Phrase Attachment and Interpretation
In this paper, a hybrid disambiguation method for the prepositional phrase (PP) attachment and interpretation problem is presented. 1 The data needed, semantic PP interpretation rules and an annotated corpus, …...
Framework and Results for the Spanish SENSEVAL
In this paper we describe the structure, organisa- tion and results of the SENSEVAL exercise for Span- ish. We present several design decisions we taked for the exercise, we describe …...
Generation for multilingual MT
AbstractThis paper presents an overview of the broad-coverage, application-independent natural language generation component of the NLP system being developed at Microsoft Research. It demonstrates how this component functions within a …...
Information-Based Machine Translation
This paper describes an approach to Machine Translation that places linguistic information at its foundation. The difficulty of translation from English to Japanese is illustrated with data that shows the …...
Senseval-3 logic forms: A system and possible improvements
Logic Forms, particular powerful logic representations presented in Moldovan and Rus (2001), are simple yet highly ef- fective. In this paper, the structure of Logic Forms and their generation from …...
Significance tests for the evaluation of ranking methods
This paper presents a statistical model that in- terprets the evaluation of ranking methods as a random experiment. This model predicts the variability of evaluation results, so that appro- priate …...
Labeled Pseudo-Projective Dependency Parsing with Support Vector Machines
We use SVM classifiers to predict the next action of a deterministic parser that builds labeled projective dependency graphs in an incremental fashion. Non-projective dependencies are captured indirectly by projectivizing …...
Automatic Assessment of Student Translations for Foreign Language Tutoring
This paper introduces the use of speech translation technology for a new type of voice-interactive Computer Aided Lan- guage Learning (CALL) application. We describe a computer game we have devel- …...
Finding document topics for improving topic segmentation
Topic segmentation and identification are of- ten tackled as separate problems whereas they are both part of topic analysis. In this article, we study how topic identification can help to …...
MaTrEx: the DCU machine translation system for IWSLT 2007
AbstractIn this paper, we give a description of the machine translation system developed at DCU that was used for our second participation in the evaluation campaign of the International Workshop …...
Large-Scale Verb Entailment Acquisition from the Web
Textual entailment recognition plays a fundamental role in tasks that require in- depth natural language understanding. In order to use entailment recognition tech- nologies for real-world applications, a large-scale entailment …...
The Spanish Resource Grammar
AbstractThis paper describes the Spanish Resource Grammar, an open-source multi-purpose broad-coverage precise grammar for Spanish. The grammar is implemented on the Linguistic Knowledge Builder (LKB) system, it is grounded in …...
A Grain of Salt for the WMT Manual Evaluation
The Workshop on Statistical Machine Translation (WMT) has become one of ACL’s flagship workshops, held annually since 2006. In addition to soliciting pa- pers from the research community, WMT also …...
Elliphant: Improved Automatic Detection of Zero Subjects and Impersonal Constructions in Spanish
In pro-drop languages, the detection of explicit subjects, zero subjects and non- referential impersonal constructions is cru- cial for anaphora and co-reference resolu- tion. While the identification of explicit and …...
A Non-Monotonic Arc-Eager Transition System for Dependency Parsing
Previous incremental parsers have used monotonic state transitions. However, transitions can be made to revise previous decisions quite naturally, based on further information. We show that a simple adjustment to …...
Acronym recognition and processing in 22 languages
We are presenting work on recognising acro- nyms of the form Long-Form (Short-Form) such as “International Monetary Fund (IMF)” in millions of news articles in twenty-two lan- guages, as part …...
A Language-independent Approach to Extracting Derivational Relations from an Inflectional Lexicon
AbstractIn this paper, we describe and evaluate an unsupervised method for acquiring pairs of lexical entries belonging to the same morphological family, i.e., derivationally related words, starting from a purely …...
Learning to Differentiate Better from Worse Translations
We present a pairwise learning-to-rank approach to machine translation evalua- tion that learns to differentiate better from worse translations in the context of a given reference. We integrate several layers …...
A Multilingual, Multi-style and Multi-granularity Dataset for Cross-language Textual Similarity Detection
AbstractIn this paper we describe our effort to create a dataset for the evaluation of cross-language textual similarity detection. We present preexisting corpora and their limits and we explain the …...
Automatic Corpus Extension for Data-driven Natural Language Generation
AbstractAs data-driven approaches started to make their way into the Natural Language Generation (NLG) domain, the need for automation of corpus building and extension became apparent. Corpus creation and extension …...
Managing Linguistic and Terminological Variation in a Medical Dialogue System
AbstractWe introduce a dialogue task between a virtual patient and a doctor where the dialogue system, playing the patient part in a simulated consultation, must reconcile a specialized level, to …...
EUDAMU at SemEval-2017 Task 11: Action Ranking and Type Matching for End-User Development
AbstractThe paper describes a system for end-user development using natural language. Our approach uses a ranking model to identify the actions to be executed followed by reference and parameter matching …...
Findings of the WMT 2017 Biomedical Translation Shared Task
Automatic translation of documents is an important task in many domains, in- cluding the biological and clinical do- mains. The second edition of the Biomed- ical Translation task in the …...
Duluth UROP at SemEval-2018 Task 2: Multilingual Emoji Prediction with Ensemble Learning and Oversampling
AbstractThis paper describes the Duluth UROP systems that participated in SemEval–2018 Task 2, Multilingual Emoji Prediction. We relied on a variety of ensembles made up of classifiers using Naive Bayes, …...
A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition
AbstractWe propose a morphologically informed model for named entity recognition, which is based on LSTM-CRF architecture and combines word embeddings, Bi-LSTM character embeddings, part-of-speech (POS) tags, and morphological information. While …...
A Spectral Method for Unsupervised Multi-Document Summarization
AbstractMulti-document summarization (MDS) aims at producing a good-quality summary for several related documents. In this paper, we propose a spectral-based hypothesis, which states that the goodness of summary candidate is …...
Detecting Harmful Memes and Their Targets
Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey politi- cal, psychological, and socio-cultural opinions. Although memes …...
Design and Evaluation of the Corpus of Everyday Japanese Conversation
AbstractWe have constructed the Corpus of Everyday Japanese Conversation (CEJC) and published it in March 2022. The CEJC is designed to contain various kinds of everyday conversations in a balanced …...
Developing and Evaluating a Dataset for How-to Tip Machine Reading at Scale
In this paper, we focus on the task of machine reading at scale within how-to tip machine reading comprehension (MRC). We propose a method for developing a context dataset using …...
Learning to Express in Knowledge-Grounded Conversation
AbstractGrounding dialogue generation by extra knowledge has shown great potentials towards building a system capable of replying with knowledgeable and engaging responses. Existing studies focus on how to synthesize a …...
Overview of the ROCLING 2022 Shared Task for Chinese Healthcare Named Entity Recognition
AbstractThis paper describes the ROCLING-2022 shared task for Chinese healthcare named entity recognition, including task description, data preparation, performance metrics, and evaluation results. Among ten registered teams, seven participating teams …...
Multilingual Multifaceted Understanding of Online News in Terms of Genre, Framing, and Persuasion Techniques
AbstractWe present a new multilingual multifacet dataset of news articles, each annotated for genre (objective news reporting vs. opinion vs. satire), framing (what key aspects are highlighted), and persuasion techniques …...
Socratic Question Generation: A Novel Dataset, Models, and Evaluation
AbstractSocratic questioning is a form of reflective inquiry often employed in education to encourage critical thinking in students, and to elicit awareness of beliefs and perspectives in a subject during …...