Глубокие нейронные сети
Related Papers
Design Challenges for Entity Linking
AbstractRecent research on entity linking (EL) has introduced a plethora of promising techniques, ranging from deep neural networks to joint inference. But despite numerous papers there is surprisingly little understanding …...
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Methods of deep neural networks (DNNs) have recently demonstrated superior perfor- mance on a number of natural language pro- cessing tasks. However, in most previous work, the models are learned …...
A Machine Learning based Music Retrieval and Recommendation System
AbstractIn this paper, we present a music retrieval and recommendation system using machine learning techniques. We propose a query by humming system for music retrieval that uses deep neural networks …...
CDE-IIITH at SemEval-2016 Task 12: Extraction of Temporal Information from Clinical documents using Machine Learning techniques
In this paper, we demonstrate our approach for identification of events, time expressions and temporal relations among them. This work was carried out as part of SemEval-2016 Challenge Task 12: …...
Chinese Zero Pronoun Resolution with Deep Neural Networks
While unsupervised anaphoric zero pro- noun (AZP) resolvers have recently been shown to rival their supervised counter- parts in performance, it is relatively diffi- cult to scale them up to …...
CNN- and LSTM-based Claim Classification in Online User Comments
AbstractWhen processing arguments in online user interactive discourse, it is often necessary to determine their bases of support. In this paper, we describe a supervised approach, based on deep neural …...
Deep Neural Networks with Massive Learned Knowledge
Regulating deep neural networks (DNNs) with human structured knowledge has shown to be of great benefit for improved accuracy and in- terpretability. We develop a general frame- work that enables …...
Harnessing Deep Neural Networks with Logic Rules
Combining deep neural networks with structured logic rules is desirable to harness flexibility and reduce uninterpretability of the neural models. We propose a general framework capable of enhancing various types …...
Learning Robust Representations of Text
Deep neural networks have achieved remark- able results across many language processing tasks, however these methods are highly sen- sitive to noise and adversarial attacks. We present a regularization based …...
Leverage Financial News to Predict Stock Price Movements Using Word Embeddings and Deep Neural Networks
Financial news contains useful information on public companies and the market. In this pa- per we apply the popular word embedding methods and deep neural networks to lever- age financial …...
Weakly-supervised text-to-speech alignment confidence measure
AbstractThis work proposes a new confidence measure for evaluating text-to-speech alignment systems outputs, which is a key component for many applications, such as semi-automatic corpus anonymization, lips syncing, film dubbing, …...
An Insight Extraction System on BioMedical Literature with Deep Neural Networks
AbstractMining biomedical text offers an opportunity to automatically discover important facts and infer associations among them. As new scientific findings appear across a large collection of biomedical publications, our aim …...
Classifying Frames at the Sentence Level in News Articles
AbstractPrevious approaches to generic frame classification analyze frames at the document level. Here, we propose a supervised based approach based on deep neural networks and distributional representations for classifying frames …...
Deep Learning in Semantic Kernel Spaces
AbstractKernel methods enable the direct usage of structured representations of textual data during language learning and inference tasks. Expressive kernels, such as Tree Kernels, achieve excellent performance in NLP. On …...
Deep Neural Machine Translation with Linear Associative Unit
AbstractDeep Neural Networks (DNNs) have provably enhanced the state-of-the-art Neural Machine Translation (NMT) with its capability in modeling complex functions and capturing complex linguistic structures. However NMT with deep architecture …...
FuRongWang at SemEval-2017 Task 3: Deep Neural Networks for Selecting Relevant Answers in Community Question Answering
AbstractWe describes deep neural networks frameworks in this paper to address the community question answering (cQA) ranking task (SemEval-2017 task 3). Convolutional neural networks and bi-directional long-short term memory networks …...
Structural Embedding of Syntactic Trees for Machine Comprehension
AbstractDeep neural networks for machine comprehension typically utilizes only word or character embeddings without explicitly taking advantage of structured linguistic information such as constituency trees and dependency trees. In this …...
Which is the Effective Way for Gaokao: Information Retrieval or Neural Networks?
AbstractAs one of the most important test of China, Gaokao is designed to be difficult enough to distinguish the excellent high school students. In this work, we detailed the Gaokao …...
A Survey on Recent Advances in Named Entity Recognition from Deep Learning models
AbstractNamed Entity Recognition (NER) is a key component in NLP systems for question answering, information retrieval, relation extraction, etc. NER systems have been studied and developed widely for decades, but …...
Creating New Language and Voice Components for the Updated MaryTTS Text-to-Speech Synthesis Platform
We present a new workflow to create components for the MaryTTS text-to-speech synthesis platform, which is popular with researchers and developers, extending it to support new languages and custom synthetic …...
Exploratory Neural Relation Classification for Domain Knowledge Acquisition
AbstractThe state-of-the-art methods for relation classification are primarily based on deep neural net- works. This kind of supervised learning method suffers from not only limited training data, but also the …...
How emotional are you? Neural Architectures for Emotion Intensity Prediction in Microblogs
AbstractSocial media based micro-blogging sites like Twitter have become a common source of real-time information (impacting organizations and their strategies, and are used for expressing emotions and opinions. Automated analysis …...
Neural Relation Classification with Text Descriptions
AbstractRelation classification is an important task in natural language processing fields. State-of-the-art methods usually concentrate on building deep neural networks based classification models on the training data in which the …...
Portable, layer-wise task performance monitoring for NLP models
AbstractThere is a long-standing interest in understanding the internal behavior of neural networks. Deep neural architectures for natural language processing (NLP) are often accompanied by explanations for their effectiveness, from …...
An Effective Label Noise Model for DNN Text Classification
AbstractBecause large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models …...
Comparing Automated Methods to Detect Explicit Content in Song Lyrics
AbstractThe Parental Advisory Label (PAL) is a warning label that is placed on audio recordings in recognition of profanity or inappropriate references, with the intention of alerting parents of material …...
End-to-End Sequential Metaphor Identification Inspired by Linguistic Theories
AbstractEnd-to-end training with Deep Neural Networks (DNN) is a currently popular method for metaphor identification. However, standard sequence tagging models do not explicitly take advantage of linguistic theories of metaphor …...
How Large a Vocabulary Does Text Classification Need? A Variational Approach to Vocabulary Selection
AbstractWith the rapid development in deep learning, deep neural networks have been widely adopted in many real-life natural language applications. Under deep neural networks, a pre-defined vocabulary is required to …...
Restoring ancient text using deep learning: a case study on Greek epigraphy
AbstractAncient History relies on disciplines such as Epigraphy, the study of ancient inscribed texts, for evidence of the recorded past. However, these texts, “inscriptions”, are often damaged over the centuries, …...
Searching for Effective Neural Extractive Summarization: What Works and What’s Next
AbstractThe recent years have seen remarkable success in the use of deep neural networks on text summarization. However, there is no clear understanding of why they perform so well, or …...
Topics to Avoid: Demoting Latent Confounds in Text Classification
AbstractDespite impressive performance on many text classification tasks, deep neural networks tend to learn frequent superficial patterns that are specific to the training data and do not always generalize well. …...
Interactive Key-Value Memory-augmented Attention for Image Paragraph Captioning
AbstractImage paragraph captioning (IPC) aims to generate a fine-grained paragraph to describe the visual content of an image. Significant progress has been made by deep neural networks, in which the …...
Interpretation of NLP models through input marginalization
AbstractTo demystify the “black box” property of deep neural networks for natural language processing (NLP), several methods have been proposed to interpret their predictions by measuring the change in prediction …...
Knowledge Graph Embedding with Atrous Convolution and Residual Learning
AbstractKnowledge graph embedding is an important task and it will benefit lots of downstream applications. Currently, deep neural networks based methods achieve state-of-the-art performance. However, most of these existing methods …...
Learning Efficient Task-Specific Meta-Embeddings with Word Prisms
AbstractWord embeddings are trained to predict word cooccurrence statistics, which leads them to possess different lexical properties (syntactic, semantic, etc.) depending on the notion of context defined at training time. …...
RethinkCWS: Is Chinese Word Segmentation a Solved Task?
AbstractThe performance of the Chinese Word Segmentation (CWS) systems has gradually reached a plateau with the rapid development of deep neural networks, especially the successful use of large pre-trained models. …...
Towards Accurate and Consistent Evaluation: A Dataset for Distantly-Supervised Relation Extraction
AbstractIn recent years, distantly-supervised relation extraction has achieved a certain success by using deep neural networks. Distant Supervision (DS) can automatically generate large-scale annotated data by aligning entity pairs from …...
Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications
AbstractDeep neural networks have become the standard approach to building reliable Natural Language Processing (NLP) applications, ranging from Neural Machine Translation (NMT) to dialogue systems. However, improving accuracy by increasing …...
When and Who? Conversation Transition Based on Bot-Agent Symbiosis Learning Network
AbstractIn online customer service applications, multiple chatbots that are specialized in various topics are typically developed separately and are then merged with other human agents to a single platform, presenting …...
基於端對端模型化技術之語音文件摘要 (Spoken Document Summarization Using End-to-End Modeling Techniques)
This thesis set to explore novel and effective end-to-end extractive methods for spoken document summarization. To this end, we propose a neural summarization approach leveraging a hierarchical modeling structure with …...
Defense against Synonym Substitution-based Adversarial Attacks via Dirichlet Neighborhood Ensemble
AbstractAlthough deep neural networks have achieved prominent performance on many NLP tasks, they are vulnerable to adversarial examples. We propose Dirichlet Neighborhood Ensemble (DNE), a randomized method for training a …...
Enhanced Metaphor Detection via Incorporation of External Knowledge Based on Linguistic Theories
Recently, deep neural networks (DNNs) have achieved great success in semantically chal- lenging NLP tasks, yet it remains unclear whether DNN models can capture composi- tional meanings, those aspects of …...
Improving Low-Resource Named Entity Recognition via Label-Aware Data Augmentation and Curriculum Denoising
AbstractDeep neural networks have achieved state-of-the-art performances on named entity recognition(NER) with sufficient training data while they perform poorly in low-resource scenarios due to data scarcity. To solve this problem …...
On the Calibration and Uncertainty of Neural Learning to Rank Models for Conversational Search
AbstractAccording to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when …...
Psycholinguistic Tripartite Graph Network for Personality Detection
AbstractMost of the recent work on personality detection from online posts adopts multifarious deep neural networks to represent the posts and builds predictive models in a data-driven manner, without the …...
RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
AbstractBackdoor attacks, which maliciously control a well-trained model’s outputs of the instances with specific triggers, are recently shown to be serious threats to the safety of reusing deep neural networks …...
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates
AbstractBehavior of deep neural networks can be inconsistent between different versions. Regressions during model update are a common cause of concern that often over-weigh the benefits in accuracy or efficiency …...
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention
AbstractNatural language processing techniques have demonstrated promising results in keyphrase generation. However, one of the major challenges in neural keyphrase generation is processing long documents using deep neural networks. Generally, …...
A Simple Model for Distantly Supervised Relation Extraction
AbstractDistantly supervised relation extraction is challenging due to the noise within data. Recent methods focus on exploiting bag representations based on deep neural networks with complex de-noising scheme to achieve …...
Analytic Automated Essay Scoring Based on Deep Neural Networks Integrating Multidimensional Item Response Theory
AbstractEssay exams have been attracting attention as a way of measuring the higher-order abilities of examinees, but they have two major drawbacks in that grading them is expensive and raises …...
Chinese Couplet Generation with Syntactic Information
AbstractChinese couplet generation aims to generate a pair of clauses (usually generating a subsequent clause given an antecedent one) with certain rules (e.g., morphological and syntactical symmetry) adhered and has …...
Combining Feature and Instance Attribution to Detect Artifacts
AbstractTraining the deep neural networks that dominate NLP requires large datasets. These are often collected automatically or via crowdsourcing, and may exhibit systematic biases or annotation artifacts. By the latter …...
Context-based Virtual Adversarial Training for Text Classification with Noisy Labels
AbstractDeep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization unfortunately leads to performance degradation. Recently, virtual adversarial training (VAT) …...
MarSan at SemEval-2022 Task 6: iSarcasm Detection via T5 and Sequence Learners
AbstractThe paper describes SemEval-2022’s shared task “Intended Sarcasm Detection in English and Arabic.” This task includes English and Arabic tweets with sarcasm and non-sarcasm samples and irony speech labels. The …...
UPER: Boosting Multi-Document Summarization with an Unsupervised Prompt-based Extractor
AbstractMulti-Document Summarization (MDS) commonly employs the 2-stage extract-then-abstract paradigm, which first extracts a relatively short meta-document, then feeds it into the deep neural networks to generate an abstract. Previous work …...
ViNLI: A Vietnamese Corpus for Studies on Open-Domain Natural Language Inference
AbstractOver a decade, the research field of computational linguistics has witnessed the growth of corpora and models for natural language inference (NLI) for rich-resource languages such as English and Chinese. …...
Word Sense Disambiguation with Knowledge-Enhanced and Local Self-Attention-based Extractive Sense Comprehension
AbstractWord sense disambiguation (WSD), identifying the most suitable meaning of ambiguous words in the given contexts according to a predefined sense inventory, is one of the most classical and challenging …...
FeelingBlue: A Corpus for Understanding the Emotional Connotation of Color in Context
AbstractWhile the link between color and emotion has been widely studied, how context-based changes in color impact the intensity of perceived emotions is not well understood. In this work, we …...
Local Interpretation of Transformer Based on Linear Decomposition
AbstractIn recent years, deep neural networks (DNNs) have achieved state-of-the-art performance on a wide range of tasks. However, limitations in interpretability have hindered their applications in the real world. This …...