Pearson Correlation

metric ID: pearsoncorrelation

Related Papers

Feature-Based Method for Document Alignment in Comparable News Corpora

Authors: nan

Publication: TIPSTER (2009)

DOI: nan

In this paper, we present a feature-based me- thod to align documents with similar content across two sets of bilingual comparable cor- pora from daily news texts. We evaluate the …...

43257

Computing and Evaluating Syntactic Complexity Features for Automated Scoring of Spontaneous Non-Native Speech

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

This paper focuses on identifying, extracting and evaluating features related to syntactic complexity of spontaneous spoken responses as part of an effort to expand the current feature set of an …...

36359

Goodness: A Method for Measuring Machine Translation Confidence

Authors: nan

Publication: TIPSTER (2011)

DOI: nan

State-of-the-art statistical machine translation (MT) systems have made significant progress towards producing user-acceptable translation output. However, there is still no efficient way for MT systems to inform users which words …...

36410

FCC: Three Approaches for Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

In this paper we describe the three approaches we submitted to the Semantic Textual Similar- ity task of SemEval 2012. The first approach considers to calculate the semantic similar- ity …...

26241

SemEval-2012 Task 6: A Pilot on Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

Semantic Textual Similarity (STS) measures the degree of semantic equivalence between two texts. This paper presents the results of the STS pilot task in Semeval. The training data contained 2000 …...

26282

Weiwei: A Simple Unsupervised Latent Semantics based Approach for Sentence Similarity

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

The Semantic Textual Similarity (STS) shared task (Agirre et al., 2012) computes the degree of semantic equivalence between two sen- tences.1 We show that a simple unsupervised latent semantics based …...

26247

SSMT:A Machine Translation Evaluation View To Paragraph-to-Sentence Semantic Similarity

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper presents the system SSMT measuring the semantic similarity between a paragraph and a sentence submitted to the SemEval 2014 task3: Cross-level Se- mantic Similarity. The special difficulty of …...

22729

UoW: NLP techniques developed at the University of Wolverhampton for Semantic Similarity and Textual Entailment

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper presents the system submit- ted by University of Wolverhampton for SemEval-2014 task 1. We proposed a ma- chine learning approach which is based on features extracted using Typed …...

22662

AMRITA_CEN@SemEval-2015: Paraphrase Detection for Twitter using Unsupervised Feature Learning with Recursive Autoencoders

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

We explore using recursive autoencoders for SemEval 2015 Task 1: Paraphrase and Seman- tic Similarity in Twitter. Our paraphrase de- tection system makes use of phrase-structure parse tree embeddings that …...

22818

Computing Semantic Text Similarity Using Rich Features

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Semantic text similarity (STS) is an essential problem in many Natural Language Pro- cessing tasks, which has drawn a considerable amount of attention by research community in recent years. In …...

19283

Improving Evaluation of Machine Translation Quality Estimation

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Quality estimation evaluation commonly takes the form of measurement of the error that exists between predictions and gold standard labels for a particular test set of translations. Issues can arise …...

7535

ROB: Using Semantic Meaning to Recognize Paraphrases

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Paraphrase recognition is the task of iden- tifying whether two pieces of natural lan- guage represent similar meanings. This pa- per describes a system participating in the shared task 1 …...

22820

UQeResearch: Semantic Textual Similarity Quantification

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

This paper presents an approach for estimat- ing the Semantic Textual Similarity of full English sentences as specified in Shared Task 2 of SemEval-2015. The semantic similarity of sentence pairs …...

22810

GWU NLP at SemEval-2016 Shared Task 1: Matrix Factorization for Crosslingual STS

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

We present a matrix factorization model for learning cross-lingual representations for sentences. Using sentence-aligned corpora, the proposed model learns distributed repre- sentations by factoring the given data into language-dependent factors …...

22484

ISCAS_NLP at SemEval-2016 Task 1: Sentence Similarity Based on Support Vector Regression using Multiple Features

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

This paper describes our system developed for English Monolingual subtask (STS Core) of SemEval-2016 Task 1: “Semantic Textual Similarity: A Unified Framework for Seman- tic Processing and Evaluation”. We measure …...

22487

SimiHawk at SemEval-2016 Task 1: A Deep Ensemble System for Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

This paper describes the SimiHawk system submission from UMass Lowell for the core Semantic Textual Similarity task at SemEval- 2016. We built four systems: a small feature- based system that …...

22471

Task-Oriented Intrinsic Evaluation of Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractSemantic Textual Similarity (STS) is a foundational NLP task and can be used in a wide range of tasks. To determine the STS of two texts, hundreds of different STS …...

4606

UWB at SemEval-2016 Task 1: Semantic Textual Similarity using Lexical, Syntactic, and Semantic Information

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

We present our UWB system for Seman- tic Textual Similarity (STS) task at SemEval 2016. Given two sentences, the system esti- mates the degree of their semantic similarity. We use …...

22497

ECNU at SemEval-2017 Task 1: Leverage Kernel-based Traditional NLP features and Neural Networks to Build a Universal Model for Multilingual and Cross-lingual Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractTo address semantic similarity on multilingual and cross-lingual sentences, we firstly translate other foreign languages into English, and then feed our monolingual English system with various interactive features. Our system …...

25363

LIM-LIG at SemEval-2017 Task1: Enhancing the Semantic Similarity for Arabic Sentences with Vectors Weighting

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis article describes our proposed system named LIM-LIG. This system is designed for SemEval 2017 Task1: Semantic Textual Similarity (Track1). LIM-LIG proposes an innovative enhancement to word embedding-based model devoted …...

25374

Pushing the Limits of Translation Quality Estimation

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractTranslation quality estimation is a task of growing importance in NLP, due to its potential to reduce post-editing human effort in disruptive ways. However, this potential is currently limited by …...

27260

QLUT at SemEval-2017 Task 1: Semantic Textual Similarity Based on Word Embeddings

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper reports the details of our submissions in the task 1 of SemEval 2017. This task aims at assessing the semantic textual similarity of two sentences or texts. We …...

25371

QLUT at SemEval-2017 Task 2: Word Similarity Based on Word Embedding and Knowledge Base

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper shows the details of our system submissions in the task 2 of SemEval 2017. We take part in the subtask 1 of this task, which is an English …...

25357

UdL at SemEval-2017 Task 1: Semantic Textual Similarity Estimation of English Sentence Pairs Using Regression Model over Pairwise Features

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractThis paper describes the model UdL we proposed to solve the semantic textual similarity task of SemEval 2017 workshop. The track we participated in was estimating the semantics relatedness of …...

25381

CrystalFeel at SemEval-2018 Task 1: Understanding and Detecting Emotion Intensity using Affective Lexicons

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractWhile sentiment and emotion analysis has received a considerable amount of research attention, the notion of understanding and detecting the intensity of emotions is relatively less explored. This paper describes …...

26091

How emotional are you? Neural Architectures for Emotion Intensity Prediction in Microblogs

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractSocial media based micro-blogging sites like Twitter have become a common source of real-time information (impacting organizations and their strategies, and are used for expressing emotions and opinions. Automated analysis …...

5271

MOCCA: Measure of Confidence for Corpus Analysis - Automatic Reliability Check of Transcript and Automatic Segmentation

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

The production of speech corpora typically involves manual labor to verify and correct the output of automatic transcription/segmentation processes. This study investigates the possibility of speeding up this correction process …...

17739

THU_NGN at SemEval-2018 Task 1: Fine-grained Tweet Sentiment Intensity Analysis with Attention CNN-LSTM

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractTraditional sentiment analysis approaches mainly focus on classifying the sentiment polarities or emotion categories of texts. However, they can’t exploit the sentiment intensity information. Therefore, the SemEval-2018 Task 1 is …...

26094

Embedding Imputation with Grounded Language Information

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractDue to the ubiquitous use of embeddings as input representations for a wide range of natural language tasks, imputation of embeddings for rare and unseen words is a critical problem …...

39636

GRADE: Automatic Graph-Enhanced Coherence Metric for Evaluating Open-Domain Dialogue Systems

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractAutomatically evaluating dialogue coherence is a challenging but high-demand ability for developing high-quality open-domain dialogue systems. However, current evaluation metrics consider only surface features or utterance-level semantics, without explicitly considering …...

29706

Speakers Fill Lexical Semantic Gaps with Context

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractLexical ambiguity is widespread in language, allowing for the reuse of economical word forms and therefore making language more efficient. If ambiguous words cannot be disambiguated from context, however, this …...

30425

A Prompt-independent and Interpretable Automated Essay Scoring Method for Chinese Second Language Writing

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractWith the increasing popularity of learning Chinese as a second language (L2) the development of an automatic essay scoring (AES) method specially for Chinese L2 essays has become animportant task. …...

3591

cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe main contribution of this paper is to fine-tune transformer-based language models pre-trained on several text corpora, some being general (E.g., Wikipedia, BooksCorpus), some being the corpora from which the …...

25624

Ensemble Fine-tuned mBERT for Translation Quality Estimation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractQuality Estimation (QE) is an important component of the machine translation workflow as it assesses the quality of the translated output without consulting reference translations. In this paper, we discuss …...

27703

IAPUCP at SemEval-2021 Task 1: Stacking Fine-Tuned Transformers is Almost All You Need for Lexical Complexity Prediction

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper describes our submission to SemEval-2021 Task 1: predicting the complexity score for single words. Our model leverages standard morphosyntactic and frequency-based features that proved helpful for Complex Word …...

25778

LangResearchLab NC at SemEval-2021 Task 1: Linguistic Feature Based Modelling for Lexical Complexity

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe present work aims at assigning a complexity score between 0 and 1 to a target word or phrase in a given sentence. For each Single Word Target, a Random …...

25782

Manchester Metropolitan at SemEval-2021 Task 1: Convolutional Networks for Complex Word Identification

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractWe present two convolutional neural networks for predicting the complexity of words and phrases in context on a continuous scale. Both models utilize word and character embeddings alongside lexical features …...

25656

Multilingual Machine Translation Evaluation Metrics Fine-tuned on Pseudo-Negative Examples for WMT 2021 Metrics Task

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThis paper describes our submission to the WMT2021 shared metrics task. Our metric is operative to segment-level and system-level translations. Our belief toward a better metric is to detect a …...

27686

Readability and Linearity

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

This paper investigates automatic assessments of text readability for second language learn- ers. The goodness of text readability as- sessment methods has been evaluated using the correlation coefficients between their …...

29335

BL.Research at SemEval-2022 Task 8: Using various Semantic Information to evaluate document-level Semantic Textual Similarity

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThis paper presents our system for document-level semantic textual similarity (STS) evaluation at SemEval-2022 Task 8: “Multilingual News Article Similarity”. The semantic information used is obtained by using different semantic …...

25005

Impact of Distance Measures on Urdu Document Clustering

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

Document Clustering aims to group similar documents based on the distance among them. A wide range of distance measures are available in the literature, and selecting an appropriate distance function …...

28839

Noisy Label Regularisation for Textual Regression

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractTraining with noisy labelled data is known to be detrimental to model performance, especially for high-capacity neural network models in low-resource domains. Our experiments suggest that standard regularisation strategies, such …...

3638

UZH_CLyp at SemEval-2023 Task 9: Head-First Fine-Tuning and ChatGPT Data Generation for Cross-Lingual Learning in Tweet Intimacy Prediction

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractThis paper describes the submission of UZH_CLyp for the SemEval 2023 Task 9 “Multilingual Tweet Intimacy Analysis. We achieved second-best results in all 10 languages according to the official Pearson’s …...

24830