Внутренняя оценка
Related Papers
Going Beyond AER: An Extensive Analysis of Word Alignments and Their Impact on MT
This paper presents an extensive evalua- tion of five different alignments and in- vestigates their impact on the correspond- ing MT system output. We introduce new measures for intrinsic evaluations …...
Generating Fine-Grained Reviews of Songs from Album Reviews
Music Recommendation Systems often recommend individual songs, as opposed to entire albums. The challenge is to gen- erate reviews for each song, since only full album reviews are available on-line. …...
Evaluating language understanding accuracy with respect to objective outcomes in a dialogue system
It is not always clear how the differences in intrinsic evaluation metrics for a parser or classifier will affect the performance of the system that uses it. We investigate the …...
Intrinsic Subspace Evaluation of Word Embedding Representations
We introduce a new methodology for in- trinsic evaluation of word representations. Specifically, we identify four fundamen- tal criteria based on the characteristics of natural language that pose difficulties to …...
Modeling topic dependencies in semantically coherent text spans with copulas
AbstractThe exchangeability assumption in topic models like Latent Dirichlet Allocation (LDA) often results in inferring inconsistent topics for the words of text spans like noun-phrases, which are usually expected to …...
Task-Oriented Intrinsic Evaluation of Semantic Textual Similarity
AbstractSemantic Textual Similarity (STS) is a foundational NLP task and can be used in a wide range of tasks. To determine the STS of two texts, hundreds of different STS …...
Denoising Neural Machine Translation Training with Trusted Data and Online Data Selection
AbstractMeasuring domain relevance of data and identifying or selecting well-fit domain data for machine translation (MT) is a well-studied topic, but denoising is not yet. Denoising is concerned with a …...
Uncovering Divergent Linguistic Information in Word Embeddings with Lessons for Intrinsic and Extrinsic Evaluation
AbstractFollowing the recent success of word embeddings, it has been argued that there is no such thing as an ideal representation for words, as different models tend to capture divergent …...
What’s in Your Embedding, And How It Predicts Task Performance
AbstractAttempts to find a single technique for general-purpose intrinsic evaluation of word embeddings have so far not been successful. We present a new approach based on scaled-up qualitative analysis of …...
Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings
AbstractContextualized representations (e.g. ELMo, BERT) have become the default pretrained representations for downstream NLP applications. In some settings, this transition has rendered their static embedding predecessors (e.g. Word2Vec, GloVe) obsolete. …...
Word Embedding Evaluation for Sinhala
AbstractThis paper presents the first ever comprehensive evaluation of different types of word embeddings for Sinhala language. Three standard word embedding models, namely, Word2Vec (both Skipgram and CBOW), FastText, and …...
Generating An Optimal Interview Question Plan Using A Knowledge Graph And Integer Linear Programming
AbstractGiven the diversity of the candidates and complexity of job requirements, and since interviewing is an inherently subjective process, it is an important task to ensure consistent, uniform, efficient and …...