Training Corpus

material ID: trainingcorpus

Related Papers

Probabilistic Tagging With Feature Structures

Authors: nan

Publication: TIPSTER (1994)

DOI: nan

The described tagger is b,'used on a hidden Markov model and uses tags composed of features such as part- of speech, gender, etc. 'l?he contextual probability of a tag (state …...

2497

Neural Networks in Chinese Lexical Classification

Authors: nan

Publication: TIPSTER (1996)

DOI: nan

Lexical attributes, like syntactic (part-of-speech) and semantic (semantic category) attributes, are in most cases, ambiguous in every languages. Automatic resolution of ambiguity of these attributes can be achieved using different …...

357

Recent Advances in HNC’s Context Vector Information Retrieval Technology

Authors: nan

Publication: TIPSTER (1996)

DOI: nan

Over the past few years, HNC has developed a neural network based, vector space approach to text retrieval. This approach, embodied in a system called MatchPlus, allows the user to …...

100

A Memory-Based Approach to Learning Shallow Natural Language Patterns

Authors: nan

Publication: TIPSTER (1998)

DOI: nan

Recognizing shallow linguistic patterns, such as ba- sic syntactic relationships between words, is a com~ mon task in applied natural language and text pro- (:essing. Tile common practice for approaching …...

6963

Headline Generation Based on Statistical Translation

Authors: nan

Publication: TIPSTER (2000)

DOI: nan

Extractive summarization techniques cannot generate document summaries shorter than a single sentence, some- thing that is often required. An ideal summarization system would under- stand each document and generate an …...

35355

Automatic Detection of Syllable Boundaries Combining the Advantages of Treebank and Bracketed Corpora Training

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

An approach to automatic detection of syllable boundaries is presented. We demonstrate the use of several manu- ally constructed grammars trained with a novel algorithm combining the advan- tages of …...

35228

Pronominal anaphora resolution in KANTOO English-to-Spanish machine translation system

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

AbstractWe describe the automatic resolution of pronominal anaphora using KANT Controlled English (KCE) and the KANTOO English-to-Spanish MT system. Our algorithm is based on a robust, syntax-based approach that applies …...

17135

Sentence boundary detection: a comparison of paradigms for improving MT quality

Authors: nan

Publication: TIPSTER (2001)

DOI: nan

AbstractThe reliable detection of sentence boundaries in running text is one of the first important steps in preparing an input document for translation. Although this is often neglected, it is …...

13248

A Trigger Language Model-based IR System

Authors: nan

Publication: TIPSTER (2004)

DOI: nan

Language model based IR system proposed in recent 5 years has introduced the language model approach in the speech recognition area into the IR community and improves the performance of …...

5877

Supervised and Unsupervised Learning for Sentence Compression

Authors: nan

Publication: TIPSTER (2005)

DOI: nan

In Statistics-Based Summarization - Step One: Sentence Compression, Knight and Marcu (Knight and Marcu, 2000) (K&M) present a noisy-channel model for sen- tence compression. The main difficulty in using this …...

36627

The Integration of Syntactic Parsing and Semantic Role Labeling

Authors: nan

Publication: TIPSTER (2005)

DOI: nan

This paper describes a system for the CoNLL-2005 Shared Task on Semantic Role Labeling. We trained two parsers with the training corpus in which the se- mantic argument information is …...

41547

Better Binarization for the CKY Parsing

Authors: nan

Publication: TIPSTER (2008)

DOI: nan

We present a study on how grammar binariza- tion empirically affects the efficiency of the CKY parsing. We argue that binarizations af- fect parsing efficiency primarily by affecting the number …...

44914

Lightly Supervised Transliteration for Machine Translation

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

We present a Hebrew to English transliter- ation method in the context of a machine translation system. Our method uses ma- chine learning to determine which terms are to be …...

43333

N-Gram-Based Statistical Machine Translation versus Syntax Augmented Machine Translation: Comparison and System Combination

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

In this paper we compare and contrast two approaches to Machine Translation (MT): the CMU-UKA Syntax Augmented Machine Translation system (SAMT) and UPC-TALP N-gram-based Statistical Ma- chine Translation (SMT). SAMT …...

43339

A Novel Statistical Pre-Processing Model for Rule-Based Machine Translation System

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

This paper introduces a new statistical pre- processing model for Rule-Based Machine Translation (RBMT) systems. We train a Statistical Machine Translation (SMT) system using monolingual corpora. This model can transform …...

3253

The Effect of Answer Patterns for Supervised Named Entity Recognition in Thai

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

. In this paper, we present Thai named entity recognition (NER) systems using supervised Conditional Random Fields (CRFs) with various answer patterns to find out whether different answer patterns would …...

18797

A good space: Lexical predictors in word space evaluation

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

AbstractVector space models benefit from using an outside corpus to train the model. It is, however, unclear what constitutes a good training corpus. We have investigated the effect on summary …...

13847

A Grammar-informed Corpus-based Sentence Database for Linguistic and Computational Studies

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

AbstractWe adopt the corpus-informed approach to example sentence selections for the construction of a reference grammar. In the process, a database containing sentences that are carefully selected by linguistic experts …...

13801

DAEDALUS at SemEval-2014 Task 9: Comparing Approaches for Sentiment Analysis in Twitter

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper describes our participation at SemEval- 2014 sentiment analysis task, in both contextual and message polarity classification. Our idea was to com- pare two different techniques for sentiment analysis. …...

22860

Automatic Generation of a Lexical Resource to support Semantic Role Labeling in Portuguese

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

This paper reports an approach to automatical- ly generate a lexical resource to support in- cremental semantic role labeling annotation in Portuguese. The data come from the corpus Propbank-Br (Propbank …...

26132

Automatic Corpus Extension for Data-driven Natural Language Generation

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractAs data-driven approaches started to make their way into the Natural Language Generation (NLG) domain, the need for automation of corpus building and extension became apparent. Corpus creation and extension …...

15084

Impact of Automatic Segmentation on the Quality, Productivity and Self-reported Post-editing Effort of Intralingual Subtitles

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractThis paper describes the evaluation methodology followed to measure the impact of using a machine learning algorithm to automatically segment intralingual subtitles. The segmentation quality, productivity and self-reported post-editing effort …...

15387

NLDS-UCSC at SemEval-2016 Task 6: A Semi-Supervised Approach to Detecting Stance in Tweets

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Stance classification aims to identify, for a particular issue under discussion, whether the speaker or author of a conversational turn has Pro (Favor) or Con (Against) stance on the is- …...

22518

Representing Verbs with Rich Contexts: an Evaluation on Verb Similarity

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Several studies on sentence processing sug- gest that the mental lexicon keeps track of the mutual expectations between words. Current DSMs, however, represent context words as separate features, thereby loosing …...

33521

Data selection for NMT using Infrequent n-gram Recovery

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractNeural Machine Translation (NMT) has achieved promising results comparable with Phrase-Based Statistical Machine Translation (PBSMT). However, to train a neural translation engine, much more powerful machines are required than those …...

2869

Evaluating the Stability of Embedding-based Word Similarities

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractWord embeddings are increasingly being used as a tool to study word associations in specific corpora. However, it is unclear whether such embeddings reflect enduring properties of language or if …...

27235

Examining the Tip of the Iceberg: A Data Set for Idiom Translation

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

Neural Machine Translation (NMT) has been widely used in recent years with significant improvements for many language pairs. Although state-of-the-art NMT systems are generating progressively better translations, idiom translation remains …...

17877

Finely Tuned, 2 Billion Token Based Word Embeddings for Portuguese

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

A distributional semantics model — also known as word embeddings — is a major asset for any language as the research results reported in the literature have consistently shown that …...

17650

Event Detection without Triggers

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThe goal of event detection (ED) is to detect the occurrences of events and categorize them. Previous work solved this task by recognizing and classifying event triggers, which is defined …...

22205

Quantity doesn’t buy quality syntax with neural language models

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractRecurrent neural networks can learn to predict upcoming words remarkably well on average; in syntactically complex contexts, however, they often assign unexpectedly high probabilities to ungrammatical words. We investigate to …...

8925

Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractCurrent state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. …...

37410

Do Neural Language Models Overcome Reporting Bias?

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractMining commonsense knowledge from corpora suffers from reporting bias, over-representing the rare at the expense of the trivial (Gordon and Van Durme, 2013). We study to what extent pre-trained language …...

3770

Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractA sequence-to-sequence (seq2seq) learning with neural networks empirically shows to be an effective framework for grammatical error correction (GEC), which takes a sentence with errors as input and outputs the …...

30603

Semantic Structural Decomposition for Neural Machine Translation

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractBuilding on recent advances in semantic parsing and text simplification, we investigate the use of semantic splitting of the source sentence as preprocessing for machine translation. We experiment with a …...

25356

Predicting Informativeness of Semantic Triples

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractMany automatic semantic relation extraction tools extract subject-predicate-object triples from unstructured text. However, a large quantity of these triples merely represent background knowledge. We explore using full texts of biomedical …...

20214

Development of a Benchmark Corpus to Support Entity Recognition in Job Descriptions

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe present the development of a benchmark suite consisting of an annotation schema, training corpus and baseline model for Entity Recognition (ER) in job descriptions, published under a Creative Commons …...

16263

Sartipi-Sedighin at SemEval-2023 Task 2: Fine-grained Named Entity Recognition with Pre-trained Contextual Language Models and Data Augmentation from Wikipedia

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractThis paper presents the system developed by the Sartipi-Sedighin team for SemEval 2023 Task 2, which is a shared task focused on multilingual complex named entity recognition (NER), or MultiCoNER …...

24891