Evaluation Results

material ID: evaluationresults

Related Papers

Automatically generating hypertext in newspaper articles by computing semantic relatedness

Authors: nan

Publication: TIPSTER (1998)

DOI: nan

We discuss an automatic method for the construction of hypertext links within and between newspaper articles. The method comprises three steps: determining the lexical chains in a text, building links …...

41385

Hybrid Disambiguation of Prepositional Phrase Attachment and Interpretation

Authors: nan

Publication: TIPSTER (1999)

DOI: nan

In this paper, a hybrid disambiguation method for the prepositional phrase (PP) attachment and interpretation problem is presented. 1 The data needed, semantic PP interpretation rules and an annotated corpus, …...

43460

Framework and Results for the Spanish SENSEVAL

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

In this paper we describe the structure, organisa- tion and results of the SENSEVAL exercise for Span- ish. We present several design decisions we taked for the exercise, we describe …...

20124

Generation for multilingual MT

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

AbstractThis paper presents an overview of the broad-coverage, application-independent natural language generation component of the NLP system being developed at Microsoft Research. It demonstrates how this component functions within a …...

17177

Information-Based Machine Translation

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

This paper describes an approach to Machine Translation that places linguistic information at its foundation. The difficulty of translation from English to Japanese is illustrated with data that shows the …...

23980

Senseval-3 logic forms: A system and possible improvements

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

Logic Forms, particular powerful logic representations presented in Moldovan and Rus (2001), are simple yet highly ef- fective. In this paper, the structure of Logic Forms and their generation from …...

19649

Significance tests for the evaluation of ranking methods

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

This paper presents a statistical model that in- terprets the evaluation of ranking methods as a random experiment. This model predicts the variability of evaluation results, so that appro- priate …...

5802

Labeled Pseudo-Projective Dependency Parsing with Support Vector Machines

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

We use SVM classifiers to predict the next action of a deterministic parser that builds labeled projective dependency graphs in an incremental fashion. Non-projective dependencies are captured indirectly by projectivizing …...

42132

Automatic Assessment of Student Translations for Foreign Language Tutoring

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

This paper introduces the use of speech translation technology for a new type of voice-interactive Computer Aided Lan- guage Learning (CALL) application. We describe a computer game we have devel- …...

24092

Finding document topics for improving topic segmentation

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

Topic segmentation and identification are of- ten tackled as separate problems whereas they are both part of topic analysis. In this article, we study how topic identification can help to …...

36487

MaTrEx: the DCU machine translation system for IWSLT 2007

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

AbstractIn this paper, we give a description of the machine translation system developed at DCU that was used for our second participation in the evaluation campaign of the International Workshop …...

20496

Large-Scale Verb Entailment Acquisition from the Web

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

Textual entailment recognition plays a fundamental role in tasks that require in- depth natural language understanding. In order to use entailment recognition tech- nologies for real-world applications, a large-scale entailment …...

44305

The Spanish Resource Grammar

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractThis paper describes the Spanish Resource Grammar, an open-source multi-purpose broad-coverage precise grammar for Spanish. The grammar is implemented on the Linguistic Knowledge Builder (LKB) system, it is grounded in …...

7923

A Grain of Salt for the WMT Manual Evaluation

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

The Workshop on Statistical Machine Translation (WMT) has become one of ACL’s flagship workshops, held annually since 2006. In addition to soliciting pa- pers from the research community, WMT also …...

28280

Elliphant: Improved Automatic Detection of Zero Subjects and Impersonal Constructions in Spanish

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

In pro-drop languages, the detection of explicit subjects, zero subjects and non- referential impersonal constructions is cru- cial for anaphora and co-reference resolu- tion. While the identification of explicit and …...

43600

A Non-Monotonic Arc-Eager Transition System for Dependency Parsing

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

Previous incremental parsers have used monotonic state transitions. However, transitions can be made to revise previous decisions quite naturally, based on further information. We show that a simple adjustment to …...

42197

Acronym recognition and processing in 22 languages

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

We are presenting work on recognising acro- nyms of the form Long-Form (Short-Form) such as “International Monetary Fund (IMF)” in millions of news articles in twenty-two lan- guages, as part …...

29005

A Language-independent Approach to Extracting Derivational Relations from an Inflectional Lexicon

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

AbstractIn this paper, we describe and evaluate an unsupervised method for acquiring pairs of lexical entries belonging to the same morphological family, i.e., derivationally related words, starting from a purely …...

16673

Learning to Differentiate Better from Worse Translations

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

We present a pairwise learning-to-rank approach to machine translation evalua- tion that learns to differentiate better from worse translations in the context of a given reference. We integrate several layers …...

34767

A Multilingual, Multi-style and Multi-granularity Dataset for Cross-language Textual Similarity Detection

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractIn this paper we describe our effort to create a dataset for the evaluation of cross-language textual similarity detection. We present preexisting corpora and their limits and we explain the …...

14847

Automatic Corpus Extension for Data-driven Natural Language Generation

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractAs data-driven approaches started to make their way into the Natural Language Generation (NLG) domain, the need for automation of corpus building and extension became apparent. Corpus creation and extension …...

15084

Managing Linguistic and Terminological Variation in a Medical Dialogue System

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractWe introduce a dialogue task between a virtual patient and a doctor where the dialogue system, playing the patient part in a simulated consultation, must reconcile a specialized level, to …...

15285

EUDAMU at SemEval-2017 Task 11: Action Ranking and Type Matching for End-User Development

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThe paper describes a system for end-user development using natural language. Our approach uses a ranking model to identify the actions to be executed followed by reference and parameter matching …...

24313

Findings of the WMT 2017 Biomedical Translation Shared Task

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

Automatic translation of documents is an important task in many domains, in- cluding the biological and clinical do- mains. The second edition of the Biomed- ical Translation task in the …...

27991

Duluth UROP at SemEval-2018 Task 2: Multilingual Emoji Prediction with Ensemble Learning and Oversampling

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractThis paper describes the Duluth UROP systems that participated in SemEval–2018 Task 2, Multilingual Emoji Prediction. We relied on a variety of ensembles made up of classifiers using Naive Bayes, …...

26048

A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe propose a morphologically informed model for named entity recognition, which is based on LSTM-CRF architecture and combines word embeddings, Bi-LSTM character embeddings, part-of-speech (POS) tags, and morphological information. While …...

19690

A Spectral Method for Unsupervised Multi-Document Summarization

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractMulti-document summarization (MDS) aims at producing a good-quality summary for several related documents. In this paper, we propose a spectral-based hypothesis, which states that the goodness of summary candidate is …...

31193

Detecting Harmful Memes and Their Targets

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey politi- cal, psychological, and socio-cultural opinions. Although memes …...

33937

Design and Evaluation of the Corpus of Everyday Japanese Conversation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe have constructed the Corpus of Everyday Japanese Conversation (CEJC) and published it in March 2022. The CEJC is designed to contain various kinds of everyday conversations in a balanced …...

14588

Developing and Evaluating a Dataset for How-to Tip Machine Reading at Scale

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

In this paper, we focus on the task of machine reading at scale within how-to tip machine reading comprehension (MRC). We propose a method for developing a context dataset using …...

28832

Learning to Express in Knowledge-Grounded Conversation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractGrounding dialogue generation by extra knowledge has shown great potentials towards building a system capable of replying with knowledgeable and engaging responses. Existing studies focus on how to synthesize a …...

21243

Overview of the ROCLING 2022 Shared Task for Chinese Healthcare Named Entity Recognition

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper describes the ROCLING-2022 shared task for Chinese healthcare named entity recognition, including task description, data preparation, performance metrics, and evaluation results. Among ten registered teams, seven participating teams …...

990

Multilingual Multifaceted Understanding of Online News in Terms of Genre, Framing, and Persuasion Techniques

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWe present a new multilingual multifacet dataset of news articles, each annotated for genre (objective news reporting vs. opinion vs. satire), framing (what key aspects are highlighted), and persuasion techniques …...

38688

Socratic Question Generation: A Novel Dataset, Models, and Evaluation

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractSocratic questioning is a form of reflective inquiry often employed in education to encourage critical thinking in students, and to elicit awareness of beliefs and perspectives in a subject during …...

43076