Эталонные задачи

task ID: benchmarktasks

Related Papers

Alignment-Based Compositional Semantics for Instruction Following

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

This paper describes an alignment-based model for interpreting natural language in- structions in context. We approach in- struction following as a search over plans, scoring sequences of actions conditioned on …...

34587

Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractThe recent tremendous success of unsupervised word embeddings in a multitude of applications raises the obvious question if similar methods could be derived to improve embeddings (i.e. semantic representations) of …...

22326

Contextual Embeddings: When Are They Worth It?

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractWe study the settings for which deep contextual embeddings (e.g., BERT) give large improvements in performance relative to classic pretrained embeddings (e.g., GloVe), and an even simpler baseline—random word embeddings—focusing …...

37988

Towards Better Context-aware Lexical Semantics:Adjusting Contextualized Representations through Static Anchors

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractOne of the most powerful features of contextualized models is their dynamic embeddings for words in context, leading to state-of-the-art representations for context-aware lexical semantics. In this paper, we present …...

30424

SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractNext generation task-oriented dialog systems need to understand conversational contexts with their perceived surroundings, to effectively help users in the real-world multimodal environment. Existing task-oriented dialog datasets aimed towards virtual …...

31704

TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractIn order to deeply understand the capability of pretrained language models in text generation and conduct a diagnostic evaluation, we propose TGEA, an error-annotated dataset with multiple benchmark tasks for …...

8173

COIN – an Inexpensive and Strong Baseline for Predicting Out of Vocabulary Word Embeddings

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractSocial media is the ultimate challenge for many natural language processing tools. The constant emergence of linguistic constructs challenge even the most sophisticated NLP tools. Predicting word embeddings for out …...

4866