Табиғи тілдерді өңдеу
Related Papers
A Heuristic Approach to Natural Language Processing
This paper is concerned with the design of a processor capable of formalizing English language descriptions of problems in the sententlal calculus. The emphasis is on the design of a …...
Hierarchical Meaning Representation and Analysis of Natural Language Documents
This paper attempts to systematize natural language analysis process by (I) use of a partitioned semantic network formalism as the meaning representation and (2) stepwise translation based on Montague Grammar. …...
A Parsing Architecture Based on Distributed Memory Machines
The paper begins by defining a class of distributed memory machines which have useful properties as retrieval and filtering devices. These memory mechanisms store large numbers of associations on a …...
Another Look at Nominal Compounds
We present a progress report on our research on nominal compounds (NC's). Recent approaches to this probiem in linguistics and natural ianguage processing (NLP) are reviewed and criticized. We argue …...
Automatic Construction of Discourse Representation Structures
Kamp's Discourse Representation Theory is a major breakthrough regarding the systematic translation of natural language discourse into logical form. We have therefore chosen to marry the User Specialty Languages System, …...
From HOPE en I’ESPERANCE On the Role of Computational Neurolinguistics in Cross-Language Studies
Computational neurolinguistics (CN) is an approach to computational linguistics which in- cludes neurally-motivated constraints in the design of models of natural language processing. Furthermore, the knowledge representations in- cluded in …...
NAtural Language driven Image Generation
In this paper the experience made through the development of a NAtural Language driven Image Generation is discussed. This system is able to imagine a static scene described by means …...
Semantic Rule Based Text Generation
This paper presents a semantically oriented, rule based method for single sentence text generation and discusses its implementation in the Kafka generator. This generator is part of the XCALIBUR natural …...
Syntactic and Semantic Parsability
This paper surveys some issues that arise in the study of the syntax and semantics of natural languages (NL's) and have potential relevance to the automatic recognition, parsing, and translation …...
Transforming English Interfaces to Other Natural Languages: An Experiment With Portuguese
Nowadays it is common the construction of English understanding systems (interfaces) that soo- ner or later one has to re-use, adapting and conve~ ting them to other natural languages. This …...
A Compression Technique for Arabic Dictionaries: The Affix Analysis
In every application that concerns the automatic processing of natural language, the problem of the dictionary size is posed. In this paper , we propose a compression dictionary al~orithm based …...
A Logical Formalism for the Representation of Determiners
Determiners play an important role in conveying the meaning of an utterance, but they have often been disregarded, perhaps because it seemed more i~portant to devise methods to grasp the …...
A Word Database for Natural Language Processing
: The paper describes the design of a fair sized lexi- cal database that is to be used with a natural language based expert system with German as the language …...
DCKR – Knowledge Representation in Prolog and Its Application to Natural Language Processing
: Semantic processing is one of the important tasks for natural language processing. Basic to semantic processing is descriptions of lexical items. The most frequently used form of description of …...
Out of the Laboratory: A Case Study with the IRUS Natural Language Interface
As part of DARPA's Strategic Computing Program, we have moved a large natural language system out of the laboratory. This involved: o Delivery of knowledge acquisition software to the Naval …...
Recovering Implicit Information
This paper describes the SDC PUNDIT, (Prolog UNDerstands Integrated Text), system for processing natural language messages. 1 PUNDIT , written in Prolog, is a highly modular system consisting of distinct …...
SAGE - a Sentence Parsing and Generation System
s: SAG~ (Sentence Analysis and GEneration system) is an operational parsing and generating system. It is used as a Natural Language Frontend for Esprit project Eeteam-316, whose purpose is to …...
Unification Categorial Grammar: A Concise, Extendable Grammar for Natural Language Processing
ion is required to construct the appropriate flmctor expressions in semantics. By contrast, the...
Chart Parsing of Stochastic Spoken Language Models
Performance in speech recognition systems has progressed to the point where it is now realistic to begin integrating speech with natural language systems to produce spoken language systems. Two factors …...
Portability in the Janus Natural Language Interface
Although natural language technology has achieved a high degree of domain independence through separating domain-independent modules from domain-dependent knowledge bases, portability, as measured by effort to move from one application …...
TINA: A Probabilistic Syntactic Parser for Speech Understanding Systems
A new natural language system, TINA, has been developed for applications involving speech understanding tasks, which integrates key ideas from context free grammars, Augmented Transition Networks (ATN's) [1], and Lexical …...
The translation of constitutent structure grammars into connectionist networks
: Description of a connectionist implementation of an Earley parser. 1....
A Textual processor to handle ATIS queries
This paper describes the initial development of a natural language text processor, as the first step in an INRS dialogue-by-voice system. The eventual system will accept natural, spontaneous speech from …...
An Architecture Sketch of Eurotra-II
AbstractThis paper outlines a new architecture for a NLP/MT development environment for the EUROTRA project, which will be fully operational in the 1993-94 time frame. The proposed architecture provides a …...
Augmented Role Filling Capabilities for Semantic Interpretation of Spoken Language
This paper describes recent work on the Unisys ATIS Spo- ken Language System, and reports benchmark results on nat- ural language, spoken language, and speech recognition. We describe enhancements to …...
Automatic Acquisition of Subcategorization Frames from Tagged Text
This paper describes an implemented program that takes a tagged text corpus and generates a partial list of the subcategorization frames in wtfich each verb occurs. The completeness of the …...
Parsing the Voyager Domain Using Pearl
This paper* describes a .al, ural language p~rsi.g algorithm &)r un- resu'icl,ed I,ext which uses a probabilhq-hased scoring funct,iow I,o se- le(:l, I,he "besC: parse of ~/ sent,enos acc:ording t,c~ …...
Lexical Disambiguation using Simulated Annealing
The resolution of lexical ambiguity is important for most natural language process- ing tasks, and a range of computational techniques have been proposed for its solu- tion. None of these …...
Parsing Agglutinative Word Structures and Its Application to Spelling Checking for Turkish
Most of tile research on parsing natnral [allguages has beetl concerned with I",nglish, or wil, h other languages nlOrl)hologically similar Io English. Parsing agglntinat.ive word st, ructures ha.s altracted relatively …...
Towards Developing Reusable NLP Dictionaries
Development of reusahle dictionaries for NI,P applications requires a carefully designed lexi- cological framework, a lexical acquisition strat- egy, an integrated development toolbox, and facilities to generate dictionaries for client …...
Knowledge extraction from machine-readable dictionaries: an evaluation
AbstractMachine-readable versions of everyday dictionaries have been seen as a likely source of information for use in natural language processing because they contain an enormous amount of lexical and semantic …...
Memory-based lexical acquisition and processing
AbstractCurrent approaches to computational lexicology in language technology are knowledge-based (competence-oriented) and try to abstract away from specific formalisms, domains, and applications. This results in severe complexity, acquisition and reusability …...
Typed feature formalisms as a common basis for linguistic specification
AbstractTyped feature formalisms (TFF) play an increasingly important role in NLP and, in particular, in MT. Many of these systems are inspired by Pollard and Sag’s work on Head-Driven Phrase …...
Encoding standards for large text resources: The Text Encoding Initiative
. The Text Encoding Initiative (TEl) is an international project established in 1988 to develop guidelines for the preparation and interchange of electronic texts for research, and to satisfy a …...
Non-directionality and Self-Assessment in an Example-based System Using Genetic Algorithms
We show the application of an optimisation technique to natural language processing: genetic algorithms, thanks to the definition of a data structure called board and a formal distance. The system …...
Restructuring Tagged Corpora with Morpheme Adjustment Rules
Toshihisa Tashiro Noriyoshi Uratani Tsuyoshi Morimoto ATR Interpreting Telecommunications Research Labor~tories 2-2 tIikaridai, Seika-cho, Soraku-gun, Kyoto 619-02, JAPAN {tashiro,uratani,morimoto} ~itl.at r.co.jp A part-of-speech tagged corpus is a very hnportant knowledge …...
An Implementation of a Multilingual Regular Expression Segmentor for Ordinary and Morphologically Rich Lexical Tokens
Lexical pattern matching and text extraction is an essential component of many Natural Language Processing applications. Following the language hierarchy first conceived by Chomsky, it is commonly accepted that simple …...
Recursion Problems in Concatenation : A Case of Korean Morphology
Without properly constraining recursions in generation, no language system can effectively operate. This is especially so with morphological generation, for each well-formed word must be finite in length and is …...
A Mandarin Voice Organizer Based on a Template-Matching Speech Recognizer
On the observation of current available voice organizers, all of them accept only voice commands or word-based commands. Using natural spoken language to operate organizer is still a difficult problem. …...
Cross-Serial Dependencies Are Not Hard to Process
Cross-serial dependencies in Dutdl and Swiss-German are the only known extra- context fi'ee natural language syntactic phenonmna. Psycholinguistie evidence suggests cross-serial orderings tend to be easier to process t, lmn …...
Markov random field based English Part-Of-Speech tagging system
Probabilistic models have been widely used for natural language processing. Part-of-speech tagging, which assigns the most likely tag to each word in a given sentence, is one. of tire problems …...
Underspecified Japanese Semantics in a Machine Translation System
Semantic representations which are underspecified with respect to, for example, scope, have recently attracted much attention. Most research in this area has focused on treating English language phenomena in a …...
Unsupervised Learning of a Rule-based Spanish Part of Speech Tagger
This I)at)cr d(~scrihcs a, SI);ulish l'arl.-ol: Speech (I'()S) l~a.gger which al,i)lies aad extends Ih'ill's a, lguril;hn~ for 'u,.super- vised learuing of ruh',- based l, aggcrs (llrill, 1995). First, we discuss …...
QuickSet: Multimodal Interaction for Simulation Set-up and Control
This paper presents a novel multimodal system applied to the setup and control of distributed interactive simulations. We have developed the QuickSet prototype, a pen/voice system running on a hand-held …...
A Layered Approach to NLP-Based Information Retrieval
A layered approach to information retrieval permits the inclusion of multiple search en- gines as well as nmltiple databases, with a natural language layer to convert English queries for use …...
A Memory-Based Approach to Learning Shallow Natural Language Patterns
Recognizing shallow linguistic patterns, such as ba- sic syntactic relationships between words, is a com~ mon task in applied natural language and text pro- (:essing. Tile common practice for approaching …...
Automatic Acquisition of Language Model based on Head-Dependent Relation between Words
Language modeling is to associate a sequence of words with a priori probability, which is a key part of many natural language applications such as speech recognition and statisticM lna- …...
Experiments with Learning Parsing Heuristics
Any large language processing software relies in its operation on heuristic decisions concerning the strategy of processing. These decisions are usually "hard-wired" into the software in the form of hand- …...
Meaning Representation and Meaning Instantiation for Chinese Nominals
The goal of this paper is to explicate the nature of Chinese nominal semantics, and to create a paradigm for nominal semantics in general that will be useful for natural …...
Robust Interaction through Partial Interpretation and Dialogue Management
In this paper we present results on developing ro- bust natural language interfaces by combining shal- low and partial interpretation with dialogue manage- ment. The key issue is to reduce …...
White Page Construction from Web Pages for Finding People on the Internet
This paper proposes a method to extract proper names and their associated information from web pages for Internet/Intranet users automatically. The information extracted from World Wide Web documents includes proper …...
Automatic Translation Template Acquisition Based on Bilingual Structure Alignment
Knowledge acquisition is a bottleneck in machine translation and many NLP tasks. A method for automatically acquiring translation templates from bilingual corpora is proposed in this paper. Bilingual sentence pairs …...
A Chart-Parsing Algorithm for Efficient Semantic Analysis
In some contexts, well-formed natural language cannot be expected as input to information or communication systems. In these contexts, the use of grammar-independent input (sequences of uninflected semantic units like …...
Automatic Linguistic Analysis for Language Teachers: The Case of Zeros
This paper presents the Natural Language Processing-based linguistic analysis tool that we have developed for Japanese as a Second Language teachers. This program, Zero De- tector (ZD), aims to promote …...
Detecting Errors in Corpora Using Support Vector Machines
While the corpus-based research relies on hu- man annotated corpora, it is often said that a non-negligible amount of errors remain even in frequently used corpora such as Penn Treebank. …...
Unknown Word Extraction for Chinese Documents
There is no blank to mark word boundaries in Chinese text. As a result, identifying words is difficult, because of segmentation ambiguities and occurrences of unknown words. Conventionally unknown words …...
Automatic Pronominal Anaphora Resolution in English Texts
Anaphora is a common phenomenon in discourses as well as an important research issue in the applications of natural language processing. In this paper, the anaphora resolution is achieved by …...
A Language Independent Method for Question Classification
Previous works on question classification are based on complex natural language process- ing techniques: named entity extractors, parsers, chunkers, etc. While these ap- proaches have proven to be effective they …...
Improved Word Alignment Using a Symmetric Lexicon Model
Word-aligned bilingual corpora are an important knowledge source for many tasks in natural language processing. We improve the well-known IBM alignment models, as well as the Hidden-Markov alignment model using …...
Improving Statistical Machine Translation in the Medical Domain using the Unified Medical Language system
Texts from the medical domain are an important task for natural language processing. This paper investigates the usefulness of a large medical database (the Unified Medical Language System) for the …...
Learning theories from text
In this paper we describe a method of automati- cally learning domain theories from parsed cor- pora of sentences from the relevant domain and use FSA techniques for the graphical …...
Partially Distribution-Free Learning of Regular Languages from Positive Samples
Regular languages are widely used in NLP to- day in spite of their shortcomings. Efficient algorithms that can reliably learn these lan- guages, and which must in realistic applications only …...
Representing Verbal Semantics with Diagrams - An Adaptation of the UML for Lexical Semantics
The paper presents a new way of accounting for the meaning of verbs in natural languages, using a diagrammatic notation based on the Unified Modeling Language (UML). We will introduce …...
Why Nitpicking Works: Evidence for Occam’s Razor in Error Correctors
Empirical experience and observations have shown us when powerful and highly tunable classifiers such as maximum en- tropy classifiers, boosting and SVMs are applied to language processing tasks, it is …...
A Hierarchical Bayesian Language Model Based On Pitman-Yor Processes
We propose a new hierarchical Bayesian n-gram model of natural languages. Our model makes use of a generalization of the commonly used Dirichlet distributions called Pitman-Yor processes which pro- duce …...
Automatic Classification of Verbs in Biomedical Texts
Lexical classes, when tailored to the appli- cation and domain in question, can provide an effective means to deal with a num- ber of natural language processing (NLP) tasks. While …...
Constructing A Chinese Chat Language Corpus with A Two-Stage Incremental Annotation Approach
AbstractChat language refers to the special human language widely used in the community of digital network chat. As chat language holds anomalous characteristics in forming words, phrases, and non-alphabetical characters, …...
Highly Constrained Unification Grammars
Unification grammars are widely accepted as an expressive means for describing the structure of natural languages. In gen- eral, the recognition problem is undecid- able for unification grammars. Even with …...
Phoneme-to-Text Transcription System with an Infinite Vocabulary
The noisy channel model approach is suc- cessfully applied to various natural lan- guage processing tasks. Currently the main research focus of this approach is adaptation methods, how to capture …...
Le rôle des métriques d’évaluation dans le processus de recherche en TAL [The role of evaluation metrics in the NLP research process]
. Research in natural language processing (NLP) has both scientific and technological dimensions. In both cases, it is necessary to evaluate the implemented systems in order to assess the success …...
“Penser global, agir local” : Les coordinations antithétiques dans une grammaire de construction multi-dimensionnelle [“Thinking global, acting local”: Antonym coordinations in a multidimensional construction grammar]
. The aim of this paper is to present a description of antonym constructions, which is integrated in a formal grammar of spontanous french in order to allow its use …...
Automatic Generation of Parallel Treebanks
The need for syntactically annotated data for use in natural language processing has increased dramatically in recent years. This is true especially for parallel treebanks, of which very few exist. …...
Metric Learning for Synonym Acquisition
The distance or similarity metric plays an important role in many natural language processing (NLP) tasks. Previous stud- ies have demonstrated the effectiveness of a number of metrics such as …...
Using Hidden Markov Random Fields to Combine Distributional and Pattern-Based Word Clustering
Word clustering is a conventional and im- portant NLP task, and the literature has suggested two kinds of approaches to this problem. One is based on the distribu- tional similarity …...
Valentino: A Tool for Valence Shifting of Natural Language Texts
AbstractIn this paper a first implementation of a tool for valence shifting of natural language texts, named Valentino (VALENced Text INOculator), is presented. Valentino can modify existing textual expressions towards …...
Integrating sentence- and word-level error identification for disfluency correction
While speaking spontaneously, speakers often make errors such as self-correction or false starts which interfere with the successful application of natural language processing techniques like summarization and machine translation to …...
Résolution de métonymie des entités nommées : proposition d’une méthode hybride [Metonymy resolution for named entities: an hybrid approach]
. Named Entity metonymy resolution is a challenging natural langage processing task, which has been recently subject to a growing interest. In this paper, we describe the method we have …...
Similitude entre les sens d’usage d’un terme dans un réseau lexical [Similarity between term senses in a lexical network]
: Typed lexical relations between terms are indispensable for the tasks realized in NLP, but collecting lexical information is a difficult process. Indeed, when done manually, it requires the competence …...
A General Purpose FrameNet-based Shallow Semantic Parser
AbstractIn this paper we present a new FrameNet-based Shallow Semantic Parser. Shallow Semantic Parsing has been a popular Natural Language Processing task since the 2004 and 2005 CoNLL Shared Task …...
A Language Approach to Modeling Human Behaviors
AbstractThe modeling of human behavior becomes more and more important due to the increasing popularity of context-aware computing and people-centric mobile applications. Inspired by the principle of action-as-language, we propose …...
A Random Graph Walk based Approach to Computing Semantic Relatedness Using Knowledge from Wikipedia
AbstractDetermining semantic relatedness between words or concepts is a fundamental process to many Natural Language Processing applications. Approaches for this task typically make use of knowledge resources such as WordNet …...
A Recursive Treatment of Collocations
AbstractThis article discusses the treatment of collocations in the context of a long-term project on the development of multilingual NLP tools. Besides classical two-word collocations, we will focus on the …...
A Twin-Candidate Based Approach for Event Pronoun Resolution using Composite Kernel
Event Anaphora Resolution is an important task for cascaded event template extraction and other NLP study. In this paper, we provide a first systematic study of resolving pronouns to their …...
Acquiring Reliable Predicate-argument Structures from Raw Corpora for Case Frame Compilation
AbstractWe present a method for acquiring reliable predicate-argument structures from raw corpora for automatic compilation of case frames. Such lexicon compilation requires highly reliable predicate-argument structures to practically contribute to …...
An Associative Concept Dictionary for Verbs and its Application to Elliptical Word Estimation
AbstractNatural language processing technology has developed remarkably, but it is still difficult for computers to understand contextual meanings as humans do. The purpose of our work has been to construct …...
Annotating Event Mentions in Text with Modality, Focus, and Source Information
AbstractMany natural language processing tasks, including information extraction, question answering and recognizing textual entailment, require analysis of the polarity, focus of polarity, tense, aspect, mood and source of the event …...
Bringing Active Learning to Life
Active learning has been applied to dif- ferent NLP tasks, with the aim of limit- ing the amount of time and cost for human annotation. Most studies on active learn- …...
Building a Web Corpus of Czech
AbstractLarge corpora are essential to modern methods of computational linguistics and natural language processing. In this paper, we describe an ongoing project whose aim is to build a largest corpus …...
Cross-Corpus Textual Entailment for Sublanguage Analysis in Epidemic Intelligence
AbstractTextual entailment has been recognized as a generic task that captures major semantic inference needs across many natural language processing applications. However, to date, textual entailment has not been considered …...
Cultural Aspects of Spatiotemporal Analysis in Multilingual Applications
AbstractIn this paper we want to point out some issues arising when a natural language processing task involves several languages (like multi- lingual, multidocument summarization and the machine translation aspects …...
Cultural Heritage: Knowledge Extraction from Web Documents
AbstractThis article presents the use of NLP techniques (text mining, text analysis) to develop specific tools that allow to create linguistic resources related to the cultural heritage domain. The aim …...
Efficient Statement Identification for Automatic Market Forecasting
Strategic business decision making in- volves the analysis of market forecasts. Today, the identification and aggregation of relevant market statements is done by human experts, often by analyzing doc- uments …...
English-Spanish Large Statistical Dictionary of Inflectional Forms
AbstractThe paper presents an approach for constructing a weighted bilingual dictionary of inflectional forms using as input data a traditional bilingual dictionary, and not parallel corpora. An algorithm is developed …...
Entity Mention Detection using a Combination of Redundancy-Driven Classifiers
AbstractWe present an experimental framework for Entity Mention Detection in which two different classifiers are combined to exploit Data Redundancy attained through the annotation of a large text corpus, as …...
Evaluating Complex Semantic Artifacts
AbstractEvaluating complex Natural Language Processing (NLP) systems can prove extremely difficult. In many cases, the best one can do is to evaluate these systems indirectly, by looking at the impact …...
Exploring variation across biomedical subdomains
Previous research has demonstrated the importance of handling differences be- tween domains such as “newswire” and “biomedicine” when porting NLP systems from one domain to another. In this paper we …...
Extracting Lexico-conceptual Knowledge for Developing Persian WordNet
AbstractSemantic lexicons and lexical ontologies are some major resources in natural language processing. Developing such resources are time consuming tasks for which some automatic methods are proposed. This paper describes …...
Fine-grained Linguistic Evaluation of Question Answering Systems
AbstractQuestion answering systems are complex systems using natural language processing. Some evaluation campaigns are organized to evaluate such systems in order to propose a classification of systems based on final …...
FreeLing 2.1: Five Years of Open-source Language Processing Tools
AbstractFreeLing is an open-source multilingual language processing library providing a wide range of language analyzers for several languages. It offers text processing and language annotation facilities to natural language processing …...
Investigating the cross-linguistic potential of VerbNet-style classification
Verb classes which integrate a wide range of linguistic properties (Levin, 1993) have proved useful for natural language pro- cessing (NLP) applications. However, the real-world use of these classes has …...
Learning to Mine Definitions from Slovene Structured and Unstructured Knowledge-Rich Resources
AbstractThe paper presents an innovative approach to extract Slovene definition candidates from domain-specific corpora using morphosyntactic patterns, automatic terminology recognition and semantic tagging with wordnet senses. First, a classification model …...
LIMA : A Multilingual Framework for Linguistic Analysis and Linguistic Resources Development and Evaluation
AbstractThe increasing amount of available textual information makes necessary the use of Natural Language Processing (NLP) tools. These tools have to be used on large collections of documents in different …...
Linking Korean Words with an Ontology
AbstractThe need for ontologies has increased in computer science or information science recently. Especially, NLP systems such as information retrieval, machine translation, etc. require ontologies whose concepts are connected to …...
Meaning Representation: From Continuity to Discreteness
AbstractThis paper presents a geometric approach to meaning representation within the framework of continuous mathematics. Meaning representation is a central issue in Natural Language Processing, in particular for tasks like …...
NLGbAse: A Free Linguistic Resource for Natural Language Processing Systems
AbstractAvailability of labeled language resources, such as annotated corpora and domain dependent labeled language resources is crucial for experiments in the field of Natural Language Processing. Most often, due to …...
Paraphrasing with Search Engine Query Logs
This paper proposes a method that extracts paraphrases from search engine query logs. The method first extracts paraphrase query-title pairs based on an assumption that a search query and its …...
PolNet — Polish WordNet: Data and Tools
AbstractThis paper presents the PolNet-Polish WordNet project which aims at building a linguistically oriented ontology for Polish compatible with other WordNet projects such as Princeton WordNet, EuroWordNet and other similarly …...
Processing and Extracting Data from Dicionário Aberto
AbstractSynonyms dictionaries are useful resources for natural language processing. Unfortunately their availability in digital format is limited, as publishing companies do not release their dictionaries in open digital formats. Dicionário-Aberto …...
Saturnalia: A Latin-Catalan Parallel Corpus for Statistical MT
AbstractCurrently, a great effort is being carried out in the digitalisation of large historical document collections for preservation purposes. The documents in these collections are usually written in ancient languages, …...
STeP-1: A Set of Fundamental Tools for Persian Text Processing
AbstractMany NLP applications need fundamental tools to convert the input text into appropriate form or format and extract the primary linguistic knowledge of words and sentences. These tools perform segmentation …...
The Architecture of FunGramKB
AbstractNatural language understanding systems require a knowledge base provided with conceptual representations reflecting the structure of human beings cognitive system. Although surface semantics can be sufficient in some other systems, …...
The Cambridge Cookie-Theft Corpus: A Corpus of Directed and Spontaneous Speech of Brain-Damaged Patients and Healthy Individuals
AbstractInvestigating differences in linguistic usage between individuals who have suffered brain injury (hereafter patients) and those who havent can yield a number of benefits. It provides a better understanding about …...
The Database of Catalan Adjectives
AbstractWe present the Database of Catalan Adjectives (DCA), a database with 2,296 adjective lemmata enriched with morphological, syntactic and semantic information. This set of adjectives has been collected from a …...
Top-Performing Robust Constituency Parsing of Portuguese: Freely Available in as Many Ways as you Can Get it
AbstractIn this paper we present LX-Parser, a probabilistic, robust constituency parser for Portuguese. This parser achieves ca. 88% f-score in the labeled bracketing task, thus reaching a state-of-the-art performance score …...
Towards an Integrated Architecture for Composite Language Services and Multiple Linguistic Processing Components
AbstractWeb services are increasingly being used in the natural language processing community as a way to increase the interoperability amongst language resources. This paper extends our previous work on integrating …...
Using Dialogue Corpora to Extend Information Extraction Patterns for Natural Language Understanding of Dialogue
AbstractThis paper examines how Natural Language Process (NLP) resources and online dialogue corpora can be used to extend coverage of Information Extraction (IE) templates in a Spoken Dialogue system. IE …...
Using High-Quality Resources in NLP: The Valency Dictionary of English as a Resource for Left-Associative Grammars
AbstractIn Natural Language Processing (NLP), the quality of a system depends to a great extent on the quality of the linguistic resources it uses. One area where precise information is …...
A Comparison and Improvement of Online Learning Algorithms for Sequence Labeling
Sequence labeling models like conditional random fields have been successfully applied in a variety of NLP tasks. However, as the size of label set and dataset grows, the learning speed …...
A Computational Cognitive Model for Semantic Sub-Network Extraction from Natural Language Queries
Semantic query sub-network is the representation of a natural language query as a graph of semantically connected words. Such sub-networks can be identified as sub-graphs in larger ontologies like DBpedia …...
A Light Weight Stemmer in Kokborok
Started from the very beginning, Stemming has been playing significant roles in several Natural Language Processing Applications such as information retrieval (IR), machine translation (MT), morph analysis and deciding the …...
Automatic Detection of Point of View Differences in Wikipedia
We investigate differences in point of view (POV) between two objective documents, where one is describing the subject matter in a more positive/negative way than the other, and present an …...
English-to-Traditional Chinese Cross-lingual Link Discovery in Articles with Wikipedia Corpus
In this paper, we design a processing flow to produce linked data in articles, providing anchor- based term’s additional information and related terms in different languages (English to Chi- nese). …...
Entends-tu mes attitudes ? Perception de la prosodie des affects sociaux en chinois Mandarin (Do you hear my attitudes? Perception of Mandarin Chinese social affects’ prosody) [in French]
_______________________________________________________________________________________________ Do you hear my attitudes? Do you hear my attitudes? Do you hear my attitudes? Do you hear my attitudes? PPPPerception of Mandarin Chinese social affects erception of Mandarin …...
Identifying Urdu Complex Predication via Bigram Extraction
A problem that crops up repeatedly in shallow and deep syntactic parsing approaches to South Asian languages like Urdu/Hindi is the proper treatment of complex predications. Problems for the NLP …...
Inducing Crosslingual Distributed Representations of Words
Distributed representations of words have proven extremely useful in numerous natural lan- guage processing tasks. Their appeal is that they can help alleviate data sparsity problems common to supervised learning. …...
Modeling the Complexity of Manual Annotation Tasks: a Grid of Analysis
Manual corpus annotation is getting widely used in Natural Language Processing (NLP). While being recognized as a difficult task, no in-depth analysis of its complexity has been performed yet. We …...
Multi-View AdaBoost for Multilingual Subjectivity Analysis
Subjectivity analysis has received increasing attention in natural language processing field. Most of the subjectivity analysis works however are conducted on single languages. In this paper, we propose to perform …...
Recognizing Personal Characteristics of Readers using Eye-Movements and Text Features
In the present work we raise the hypothesis that eye-movements when reading texts reveal task performance, as measured by the level of understanding of the reader. With the objective of …...
Semi-supervised Representation Learning for Domain Adaptation using Dynamic Dependency Networks
Recently, various unsupervised representation learning approaches have been investigated to produce augmenting features for natural language processing systems in the open-domain learning scenarios. In this paper, we propose a dynamic …...
Tibetan Base Noun Phrase Identification Framework Based on Chinese-Tibetan Sentence Aligned Corpus
This paper presents an identification framework for extracting Tibetan base noun phrase (NP). The framework includes two phases. In the first phase, Chinese base NPs are extracted from all Chinese …...
Using Argumentative Zones for Extractive Summarization of Scientific Articles
Information structure, i.e the way speakers construct sentences to present new information in the context of old, can capture rich linguistic information about the discourse structure of scientific documents. Information …...
Evaluer et améliorer une ressource distributionnelle: protocole d’annotation de liens sémantiques en contexte [Evaluating and improving a distributional resource: protocol for in-context annotation of semantic links]
. Using distributional analysis methods to compute semantic proximity links between words has become commonplace in NLP. This paper focuses on the issues of evaluating a dis- tributional resource. We …...
Grouping of terms based on linguistic and semantic regularities in a cross-lingual context (Groupement de termes basé sur des régularités linguistiques et sémantiques dans un contexte cross-langue) [in French]
Grouping of terms based on linguistic and semantic regularities in a cross-lingual context We propose to exploit the Natural Language Processing methods dedicated to terminology structuring independently in two languages …...
Les apports du TAL à la lisibilité du français langue étrangère [Contributions of NLP to the readability of French as a foreign language]
. This paper presents a set of experiments aiming to (1) assess the contribution of NLP to the specific issue of the readability of texts for French as a foreign …...
A Probabilistic Model for Learning Multi-Prototype Word Embeddings
Distributed word representations have been widely used and proven to be useful in quite a few natural language processing and text mining tasks. Most of existing word embedding models aim …...
Automatic Discovery of Adposition Typology
Natural languages (NL) can be classified as prepositional or postpositional based on the order of the noun phrase and the adposition. Categorizing a language by its adposition typology helps in …...
Deep-Syntactic Parsing
“Deep-syntactic” dependency structures that capture the argumentative, attributive and coordi- native relations between full words of a sentence have a great potential for a number of NLP- applications. The abstraction …...
Generating Acrostics via Paraphrasing and Heuristic Search
We consider the problem of automatically paraphrasing a text in order to find an equivalent text that contains a given acrostic. A text contains an acrostic, if the first letters …...
MEANS : une approche sémantique pour la recherche de réponses aux questions médicales [MEANS: a semantic approach to medical question answering]
. We present a medical question answering approach, called MEANS. This approach relies on natural language processing techniques to extract medical entities and relations from the user questions and medical …...
Minimally Supervised Classification to Semantic Categories using Automatically Acquired Symmetric Patterns
Classifying nouns into semantic categories (e.g., animals, food) is an important line of research in both cognitive science and natural language processing. We present a minimally supervised model for noun …...
Part of Speech Tagging for French Social Media Data
In the context of Social Media Analytics, Natural Language Processing tools face new chal- lenges on on-line conversational text, such as microblogs, chat, or text messages, because of the specificity …...
Towards an open-domain conversational system fully based on natural language processing
This paper proposes an architecture for an open-domain conversational system and evaluates an implemented system. The proposed architecture is fully composed of modules based on natu- ral language processing techniques. …...
Uncertainty Detection in Hungarian Texts
Uncertainty detection is essential for many NLP applications. For instance, in information re- trieval, it is of primary importance to distinguish among factual, negated and uncertain informa- tion. Current research …...
Using Spreading Activation to Evaluate and Improve Ontologies
In this paper, we explore the relationship between the human-encoded semantics of ontologies and their application to natural language processing (NLP) tasks, such as word-sense disambig- uation (WSD), for which …...
Gabriel G. Bès, linguiste empiriste [Gabriel G. Bès, an empiricist linguist]
. This article presents the work of Gabriel G. Bès, with extends from the 60s to the 2000s, from structuralism to industrial language analysis. The work of Gabriel G. Bès …...
La non-commutativité comme argument linguistique : modéliser la notion de phase dans un cadre logique [The non-commutativity as a linguistic argument: modeling phase in a logical framework]
. One of the recurring questions in natural language processing is the models’s ability to account for the reality of language ability. Chomsky’s Generative Theory and Minimalism are interested in …...
Automated speech-unit delimitation in spoken learner English
AbstractIn order to apply computational linguistic analyses and pass information to downstream applications, transcriptions of speech obtained via automatic speech recognition (ASR) need to be divided into smaller meaningful units, …...
Automatic Prediction of Linguistic Decline in Writings of Subjects with Degenerative Dementia
Given the limited success of medication in re- versing the effects of Alzheimer’s and other dementias, a lot of the neuroscience research has been focused on early detection, in order …...
Better call Saul: Flexible Programming for Learning and Inference in NLP
AbstractWe present a novel way for designing complex joint inference and learning models using Saul (Kordjamshidi et al., 2015), a recently-introduced declarative learning-based programming language (DeLBP). We enrich Saul with …...
Design of an Input Method for Taiwanese Hokkien using Unsupervized Word Segmentation for Language Modeling
This paper presents the challenges and the methodology followed in the design of a new Input Method (IME) for the Taiwanese (Hokkien) language. We first describe the context, the motivations …...
English-Chinese Knowledge Base Translation with Neural Network
AbstractKnowledge base (KB) such as Freebase plays an important role for many natural language processing tasks. English knowledge base is obviously larger and of higher quality than low resource language …...
Extending WordNet with Fine-Grained Collocational Information via Supervised Distributional Learning
AbstractWordNet is probably the best known lexical resource in Natural Language Processing. While it is widely regarded as a high quality repository of concepts and semantic relations, updating and extending …...
Extraction of Keywords of Novelties From Patent Claims
AbstractThere are growing needs for patent analysis using Natural Language Processing (NLP)-based approaches. Although NLP-based approaches can extract various information from patents, there are very few approaches proposed to extract …...
Fast Gated Neural Domain Adaptation: Language Model as a Case Study
AbstractNeural network training has been shown to be advantageous in many natural language processing applications, such as language modelling or machine translation. In this paper, we describe in detail a …...
Improving historical spelling normalization with bi-directional LSTMs and multi-task learning
AbstractNatural-language processing of historical documents is complicated by the abundance of variant spellings and lack of annotated data. A common approach is to normalize the spelling of historical words to …...
Keystroke dynamics as signal for shallow syntactic parsing
AbstractKeystroke dynamics have been extensively used in psycholinguistic and writing research to gain insights into cognitive processing. But do keystroke logs contain actual signal that can be used to learn …...
Knowledge-Driven Event Embedding for Stock Prediction
AbstractRepresenting structured events as vectors in continuous space offers a new way for defining dense features for natural language processing (NLP) applications. Prior work has proposed effective methods to learn …...
Semantically Motivated Hebrew Verb-Noun Multi-Word Expressions Identification
AbstractIdentification of Multi-Word Expressions (MWEs) lies at the heart of many natural language processing applications. In this research, we deal with a particular type of Hebrew MWEs, Verb-Noun MWEs (VN-MWEs), …...
Semi-supervised Word Sense Disambiguation with Neural Models
AbstractDetermining the intended sense of words in text – word sense disambiguation (WSD) – is a long-standing problem in natural language processing. Recently, researchers have shown promising results using word …...
Splitting compounds with ngrams
AbstractCompound words with unmarked word boundaries are problematic for many tasks in NLP and computational linguistics, including information extraction, machine translation, and syllabification. This paper introduces a simple, proof-of-concept language …...
Task-Oriented Intrinsic Evaluation of Semantic Textual Similarity
AbstractSemantic Textual Similarity (STS) is a foundational NLP task and can be used in a wide range of tasks. To determine the STS of two texts, hundreds of different STS …...
Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling
AbstractRecurrent Neural Network (RNN) is one of the most popular architectures used in Natural Language Processsing (NLP) tasks because its recurrent structure is very suitable to process variable-length text. RNN …...
Un Verbenet du français [A Verbnet for French]
. VerbNet is a lexical resource for English verbs that has proven useful for NLP thanks to its high lexical and syntactic coverage and its systematic coding of thematic roles. …...
A Survey on Open Information Extraction
AbstractWe provide a detailed overview of the various approaches that were proposed to date to solve the task of Open Information Extraction. We present the major challenges that such systems …...
Adaptive Learning of Local Semantic and Global Structure Representations for Text Classification
AbstractRepresentation learning is a key issue for most Natural Language Processing (NLP) tasks. Most existing representation models either learn little structure information or just rely on pre-defined structures, leading to …...
Adversarial Feature Adaptation for Cross-lingual Relation Classification
AbstractRelation Classification aims to classify the semantic relationship between two marked entities in a given sentence. It plays a vital role in a variety of natural language processing applications. Most …...
An Empirical Investigation of Error Types in Vietnamese Parsing
AbstractSyntactic parsing plays a crucial role in improving the quality of natural language processing tasks. Although there have been several research projects on syntactic parsing in Vietnamese, the parsing quality …...
Automated Fact Checking: Task Formulations, Methods and Future Directions
AbstractThe recently increased focus on misinformation has stimulated research in fact checking, the task of assessing the truthfulness of a claim. Research in automating this task has been conducted in …...
Automated Scoring: Beyond Natural Language Processing
AbstractIn this position paper, we argue that building operational automated scoring systems is a task that has disciplinary complexity above and beyond standard competitive shared tasks which usually involve applying …...
Automatically Extracting Qualia Relations for the Rich Event Ontology
AbstractCommonsense, real-world knowledge about the events that entities or “things in the world” are typically involved in, as well as part-whole relationships, is valuable for allowing computational systems to draw …...
Binarized LSTM Language Model
AbstractLong short-term memory (LSTM) language model (LM) has been widely investigated for automatic speech recognition (ASR) and natural language processing (NLP). Although excellent performance is obtained for large vocabulary tasks, …...
Bringing replication and reproduction together with generalisability in NLP: Three reproduction studies for Target Dependent Sentiment Analysis
AbstractLack of repeatability and generalisability are two significant threats to continuing scientific development in Natural Language Processing. Language models and learning methods are so complex that scientific conference papers no …...
Challenges and Opportunities of Applying Natural Language Processing in Business Process Management
AbstractThe Business Process Management (BPM) field focuses in the coordination of labor so that organizational processes are smoothly executed in a way that products and services are properly delivered. At …...
Challenges of language technologies for the indigenous languages of the Americas
AbstractIndigenous languages of the American continent are highly diverse. However, they have received little attention from the technological perspective. In this paper, we review the research, the digital resources and …...
Diachronic word embeddings and semantic shifts: a survey
AbstractRecent years have witnessed a surge of publications aimed at tracing temporal changes in lexical semantics using distributional methods, particularly prediction-based word embedding models. However, this vein of research lacks …...
Exploiting Syntactic Structures for Humor Recognition
AbstractHumor recognition is an interesting and challenging task in natural language processing. This paper proposes to exploit syntactic structure features to enhance humor recognition. Our method achieves significant improvements compared …...
Indigenous language technologies in Canada: Assessment, challenges, and successes
AbstractIn this article, we discuss which text, speech, and image technologies have been developed, and would be feasible to develop, for the approximately 60 Indigenous languages spoken in Canada. In …...
iParaphrasing: Extracting Visually Grounded Paraphrases via an Image
AbstractA paraphrase is a restatement of the meaning of a text in other words. Paraphrases have been studied to enhance the performance of many natural language processing tasks. In this …...
Learning What to Share: Leaky Multi-Task Network for Text Classification
AbstractNeural network based multi-task learning has achieved great success on many NLP problems, which focuses on sharing knowledge among tasks by linking some layers to enhance the performance. However, most …...
Learning Word Meta-Embeddings by Autoencoding
AbstractDistributed word embeddings have shown superior performances in numerous Natural Language Processing (NLP) tasks. However, their performances vary significantly across different tasks, implying that the word embeddings learnt by those …...
Les méthodes « apprendre à chercher » en traitement automatique des langues : un état de l’art [A survey of learning-to-search techniques in Natural Language Processing]
. Structured prediction lies at the heart of modern Natural language Processing (NLP). In this paper, we study a specific family of structured learning algorithms, loosely refered to as “Learning-to-search” …...
Low-resource Cross-lingual Event Type Detection via Distant Supervision with Minimal Effort
AbstractThe use of machine learning for NLP generally requires resources for training. Tasks performed in a low-resource language usually rely on labeled data in another, typically resource-rich, language. However, there …...
Measuring Innovation in Speech and Language Processing Publications.
The goal of this paper is to propose measures of innovation through the study of publications in the field of speech and language processing. It is based on the NLP4NLP …...
Pattern-revising Enhanced Simple Question Answering over Knowledge Bases
AbstractQuestion Answering over Knowledge Bases (KB-QA), which automatically answer natural language questions based on the facts contained by a knowledge base, is one of the most important natural language processing …...
Profiling Medical Journal Articles Using a Gene Ontology Semantic Tagger
In many areas of academic publishing, there is an explosion of literature, and sub-division of fields into subfields, leading to stove-piping where sub-communities of expertise become disconnected from each other. …...
SGM: Sequence Generation Model for Multi-label Classification
AbstractMulti-label classification is an important yet challenging task in natural language processing. It is more complex than single-label classification in that the labels tend to be correlated. Existing methods tend …...
Sliced Recurrent Neural Networks
AbstractRecurrent neural networks have achieved great success in many NLP tasks. However, they have difficulty in parallelization because of the recurrent structure, so it takes much time to train RNNs. …...
Task-oriented Word Embedding for Text Classification
AbstractDistributed word representation plays a pivotal role in various natural language processing tasks. In spite of its success, most existing methods only consider contextual information, which is suboptimal when used …...
Using J-K-fold Cross Validation To Reduce Variance When Tuning NLP Models
AbstractK-fold cross validation (CV) is a popular method for estimating the true performance of machine learning models, allowing model selection and parameter tuning. However, the very process of CV requires …...
Weather Forecast Voice System
This paper introduces Weather Voice System applied to information commands-responses system through Public Switched Telephone Network (PSTN). Being able to understand users' voice commands, our system would assist them during …...
輔助建立混合性系統之自然語言處理系統深度評估平台 — 以評估依存關係分析器為例 (The Platform providing NLP System Deep Comparative Evaluation and Auxiliary Information for Hybrid NLP System Building: Trial on Dependency Parser Evaluation) [In Chinese]
This platform includes two main concepts. One, provide multifaceted and deep evaluation for users of Natural Language Processing (NLP) System (such as Syntaxnet or CoreNLP), to help them choose the …...
A Benchmark Dataset for Learning to Intervene in Online Hate Speech
AbstractCountering online hate speech is a critical yet challenging task, but one which can be aided by the use of Natural Language Processing (NLP) techniques. Previous research has primarily focused …...
A Robust Self-Learning Framework for Cross-Lingual Text Classification
AbstractBased on massive amounts of data, recent pretrained contextual representation models have made significant strides in advancing a number of different English NLP tasks. However, for other languages, relevant training …...
A Topic Augmented Text Generation Model: Joint Learning of Semantics and Structural Features
AbstractText generation is among the most fundamental tasks in natural language processing. In this paper, we propose a text generation model that learns semantics and structural features simultaneously. This model …...
Complaint Analysis and Classification for Economic and Food Safety
AbstractGovernmental institutions are employing artificial intelligence techniques to deal with their specific problems and exploit their huge amounts of both structured and unstructured information. In particular, natural language processing and …...
Deep learning contextual models for prediction of sport event outcome from sportsman’s interviews
AbstractThis paper presents an approach for prediction of results for sport events. Usually the sport forecasting approaches are based on structured data. We test the hypothesis that the sports results …...
Enhancing Dialogue Symptom Diagnosis with Global Attention and Symptom Graph
AbstractSymptom diagnosis is a challenging yet profound problem in natural language processing. Most previous research focus on investigating the standard electronic medical records for symptom diagnosis, while the dialogues between …...
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer
AbstractFormality text style transfer plays an important role in various NLP applications, such as non-native speaker assistants and child education. Early studies normalize informal sentences with rules, before statistical and …...
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition
AbstractIn this paper, we study differentiable neural architecture search (NAS) methods for natural language processing. In particular, we improve differentiable architecture search by removing the softmax-local constraint. Also, we apply …...
Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations
AbstractContextualized word representations are able to give different representations for the same word in different contexts, and they have been shown to be effective in downstream natural language processing tasks, …...
Learning Latent Parameters without Human Response Patterns: Item Response Theory with Artificial Crowds
AbstractIncorporating Item Response Theory (IRT) into NLP tasks can provide valuable information about model performance and behavior. Traditionally, IRT models are learned using human response pattern (RP) data, presenting a …...
Learning to Ask for Conversational Machine Learning
AbstractNatural language has recently been explored as a new medium of supervision for training machine learning models. Here, we explore learning classification tasks using language in a conversational setting – …...
Modeling Conversation Structure and Temporal Dynamics for Jointly Predicting Rumor Stance and Veracity
AbstractAutomatically verifying rumorous information has become an important and challenging task in natural language processing and social media analytics. Previous studies reveal that people’s stances towards rumorous messages can provide …...
On Efficient Retrieval of Top Similarity Vectors
AbstractRetrieval of relevant vectors produced by representation learning critically influences the efficiency in natural language processing (NLP) tasks. In this paper, we demonstrate an efficient method for searching vectors via …...
Sequential Learning of Convolutional Features for Effective Text Classification
AbstractText classification has been one of the major problems in natural language processing. With the advent of deep learning, convolutional neural network (CNN) has been a popular solution to this …...
Split or Merge: Which is Better for Unsupervised RST Parsing?
AbstractRhetorical Structure Theory (RST) parsing is crucial for many downstream NLP tasks that require a discourse structure for a text. Most of the previous RST parsers have been based on …...
Telling the Whole Story: A Manually Annotated Chinese Dataset for the Analysis of Humor in Jokes
AbstractHumor plays important role in human communication, which makes it important problem for natural language processing. Prior work on the analysis of humor focuses on whether text is humorous or …...
Text-based inference of moral sentiment change
AbstractWe present a text-based framework for investigating moral sentiment change of the public via longitudinal corpora. Our framework is based on the premise that language use can inform people’s moral …...
Transductive Learning of Neural Language Models for Syntactic and Semantic Analysis
AbstractIn transductive learning, an unlabeled test set is used for model training. Although this setting deviates from the common assumption of a completely unseen test set, it is applicable in …...
Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling
AbstractContextualized word embeddings such as ELMo and BERT provide a foundation for strong performance across a wide range of natural language processing tasks by pretraining on large corpora of unlabeled …...
A Learning-Exploring Method to Generate Diverse Paraphrases with Multi-Objective Deep Reinforcement Learning
AbstractParaphrase generation (PG) is of great importance to many downstream tasks in natural language processing. Diversity is an essential nature to PG for enhancing generalization capability and robustness of downstream …...
A Representation Learning Approach to Animal Biodiversity Conservation
AbstractGenerating knowledge from natural language data has aided in solving many artificial intelligence problems. Vector representations of words have been the driving force behind the majority of natural language processing …...
A Review of Dataset and Labeling Methods for Causality Extraction
AbstractCausality represents the most important kind of correlation between events. Extracting causali-ty from text has become a promising hot topic in NLP. However, there is no mature research systems and …...
A Sentence Cloze Dataset for Chinese Machine Reading Comprehension
AbstractOwing to the continuous efforts by the Chinese NLP community, more and more Chinese machine reading comprehension datasets become available. To add diversity in this area, in this paper, we …...
A Survey of Automatic Personality Detection from Texts
AbstractPersonality profiling has long been used in psychology to predict life outcomes. Recently, automatic detection of personality traits from written messages has gained significant attention in computational linguistics and natural …...
A Survey of the State of Explainable AI for Natural Language Processing
AbstractRecent years have seen important advances in the quality of state-of-the-art models, but this has come at the expense of models becoming less interpretable. This survey presents an overview of …...
A Survey of Unsupervised Dependency Parsing
AbstractSyntactic dependency parsing is an important task in natural language processing. Unsupervised dependency parsing aims to learn a dependency parser from sentences that have no annotation of their correct parse …...
AMR Quality Rating with a Lightweight CNN
AbstractStructured semantic sentence representations such as Abstract Meaning Representations (AMRs) are potentially useful in various NLP tasks. However, the quality of automatic parses can vary greatly and jeopardizes their usefulness. …...
An empirical analysis of existing systems and datasets toward general simple question answering
AbstractIn this paper, we evaluate the progress of our field toward solving simple factoid questions over a knowledge base, a practically important problem in natural language interface to database. As …...
Attention Word Embedding
AbstractWord embedding models learn semantically rich vector representations of words and are widely used to initialize natural processing language (NLP) models. The popular continuous bag-of-words (CBOW) model of word2vec learns …...
Autoregressive Affective Language Forecasting: A Self-Supervised Task
AbstractHuman natural language is mentioned at a specific point in time while human emotions change over time. While much work has established a strong link between language use and emotional …...
BERT-based Cohesion Analysis of Japanese Texts
AbstractThe meaning of natural language text is supported by cohesion among various kinds of entities, including coreference relations, predicate-argument structures, and bridging anaphora relations. However, predicate-argument structures for nominal predicates …...
Biased TextRank: Unsupervised Graph-Based Content Extraction
AbstractWe introduce Biased TextRank, a graph-based content extraction method inspired by the popular TextRank algorithm that ranks text spans according to their importance for language processing tasks and according to …...
comp-syn: Perceptually Grounded Word Embeddings with Color
AbstractPopular approaches to natural language processing create word embeddings based on textual co-occurrence patterns, but often ignore embodied, sensory aspects of language. Here, we introduce the Python package comp-syn, which …...
Continual Lifelong Learning in Natural Language Processing: A Survey
AbstractContinual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new …...
Creation of Corpus and analysis in Code-Mixed Kannada-English Twitter data for Emotion Prediction
AbstractEmotion prediction is a critical task in the field of Natural Language Processing (NLP). There has been a significant amount of work done in emotion prediction for resource-rich languages. There …...
Definition Frames: Using Definitions for Hybrid Concept Representations
AbstractAdvances in word representations have shown tremendous improvements in downstream NLP tasks, but lack semantic interpretability. In this paper, we introduce Definition Frames (DF), a matrix distributed representation extracted from …...
End-to-End Emotion-Cause Pair Extraction with Graph Convolutional Network
AbstractEmotion-cause pair extraction (ECPE), which aims at simultaneously extracting emotion-cause pairs that express emotions and their corresponding causes in a document, plays a vital role in understanding natural languages. Considering …...
Evaluating Sentence Segmentation in Different Datasets of Neuropsychological Language Tests in Brazilian Portuguese
AbstractAutomatic analysis of connected speech by natural language processing techniques is a promising direction for diagnosing cognitive impairments. However, some difficulties still remain: the time required for manual narrative transcription …...
Exploring End-to-End Differentiable Natural Logic Modeling
AbstractWe explore end-to-end trained differentiable models that integrate natural logic with neural networks, aiming to keep the backbone of natural language reasoning based on the natural logic formalism while introducing …...
Exploring the Language of Data
AbstractWe set out to uncover the unique grammatical properties of an important yet so far under-researched type of natural language text: that of short labels typically found within structured datasets. …...
Financial Sentiment Analysis: An Investigation into Common Mistakes and Silver Bullets
AbstractThe recent dominance of machine learning-based natural language processing methods has fostered the culture of overemphasizing model accuracies rather than studying the reasons behind their errors. Interpretability, however, is a …...
Flight of the PEGASUS? Comparing Transformers on Few-shot and Zero-shot Multi-document Abstractive Summarization
AbstractRecent work has shown that pre-trained Transformers obtain remarkable performance on many natural language processing tasks including automatic summarization. However, most work has focused on (relatively) data-rich single-document summarization settings. …...
From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
AbstractAdversarial attacks are label-preserving modifications to inputs of machine learning classifiers designed to fool machines but not humans. Natural Language Processing (NLP) has mostly focused on high-level attack scenarios such …...
Generating Equation by Utilizing Operators : GEO model
AbstractMath word problem solving is an emerging research topic in Natural Language Processing. Recently, to address the math word problem-solving task, researchers have applied the encoder-decoder architecture, which is mainly …...
HateGAN: Adversarial Generative-Based Data Augmentation for Hate Speech Detection
AbstractAcademia and industry have developed machine learning and natural language processing models to detect online hate speech automatically. However, most of these existing methods adopt a supervised approach that heavily …...
Hierarchical Bi-Directional Self-Attention Networks for Paper Review Rating Recommendation
AbstractReview rating prediction of text reviews is a rapidly growing technology with a wide range of applications in natural language processing. However, most existing methods either use hand-crafted features or …...
Improving Context Modeling in Neural Topic Segmentation
AbstractTopic segmentation is critical in key NLP tasks and recent works favor highly effective neural supervised approaches. However, current neural solutions are arguably limited in how they model context. In …...
Intermediate Self-supervised Learning for Machine Translation Quality Estimation
AbstractPre-training sentence encoders is effective in many natural language processing tasks including machine translation (MT) quality estimation (QE), due partly to the scarcity of annotated QE data required for supervised …...
KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi
AbstractRecent progress in text classification has been focused on high-resource languages such as English and Chinese. For low-resource languages, amongst them most African languages, the lack of well-annotated data and …...
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus
AbstractLarge text corpora are increasingly important for a wide variety of Natural Language Processing (NLP) tasks, and automatic language identification (LangID) is a core technology needed to collect such datasets …...
Learning to Prune Dependency Trees with Rethinking for Neural Relation Extraction
AbstractDependency trees have been shown to be effective in capturing long-range relations between target entities. Nevertheless, how to selectively emphasize target-relevant information and remove irrelevant content from the tree is …...
Leveraging Multilingual Resources for Language Invariant Sentiment Analysis
AbstractSentiment analysis is a widely researched NLP problem with state-of-the-art solutions capable of attaining human-like accuracies for various languages. However, these methods rely heavily on large amounts of labeled data …...
Mining Crowdsourcing Problems from Discussion Forums of Workers
AbstractCrowdsourcing is used in academia and industry to solve tasks that are easy for humans but hard for computers, in natural language processing mostly to annotate data. The quality of …...
Neural Unsupervised Domain Adaptation in NLP—A Survey
AbstractDeep neural networks excel at learning from labeled data and achieve state-of-the-art results on a wide array of Natural Language Processing tasks. In contrast, learning from unlabeled data, especially under …...
Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Case
AbstractSemantic embeddings have advanced the state of the art for countless natural language processing tasks, and various extensions to multimodal domains, such as visual-semantic embeddings, have been proposed. While the …...
Project MAIA: Multilingual AI Agent Assistant
AbstractThis paper presents the Multilingual Artificial Intelligence Agent Assistant (MAIA), a project led by Unbabel with the collaboration of CMU, INESC-ID and IT Lisbon. MAIA will employ cutting-edge machine learning …...
Regrexit or not Regrexit: Aspect-based Sentiment Analysis in Polarized Contexts
AbstractEmotion analysis in polarized contexts represents a challenge for Natural Language Processing modeling. As a step in the aforementioned direction, we present a methodology to extend the task of Aspect-based …...
RoBERT – A Romanian BERT Model
AbstractDeep pre-trained language models tend to become ubiquitous in the field of Natural Language Processing (NLP). These models learn contextualized representations by using a huge amount of unlabeled text data …...
Schema Aware Semantic Reasoning for Interpreting Natural Language Queries in Enterprise Settings
AbstractNatural Language Query interfaces allow the end-users to access the desired information without the need to know any specialized query language, data storage, or schema details. Even with the recent …...
Sentence Matching with Syntax- and Semantics-Aware BERT
AbstractSentence matching aims to identify the special relationship between two sentences, and plays a key role in many natural language processing tasks. However, previous studies mainly focused on exploiting either …...
Summarize before Aggregate: A Global-to-local Heterogeneous Graph Inference Network for Conversational Emotion Recognition
AbstractConversational Emotion Recognition (CER) is a crucial task in Natural Language Processing (NLP) with wide applications. Prior works in CER generally focus on modeling emotion influences solely with utterance-level features, …...
The Semantic Features and Cognitive Concepts of Mang2 ‘Busy’: A Corpus-Based Study
The issue of preservation and revitalization of the indigenous languages is gaining attention from the public in recent days. Developing NLP techniques related to the indigenous languages will help to …...
Translation vs. Dialogue: A Comparative Analysis of Sequence-to-Sequence Modeling
AbstractUnderstanding neural models is a major topic of interest in the deep learning community. In this paper, we propose to interpret a general neural model comparatively. Specifically, we study the …...
Two-Step Classification using Recasted Data for Low Resource Settings
AbstractAn NLP model’s ability to reason should be independent of language. Previous works utilize Natural Language Inference (NLI) to understand the reasoning ability of models, mostly focusing on high resource …...
Using Eye-tracking Data to Predict the Readability of Brazilian Portuguese Sentences in Single-task, Multi-task and Sequential Transfer Learning Approaches
AbstractSentence complexity assessment is a relatively new task in Natural Language Processing. One of its aims is to highlight in a text which sentences are more complex to support the …...
Word Embedding Binarization with Semantic Information Preservation
AbstractWith growing applications of Machine Learning in daily lives Natural Language Processing (NLP) has emerged as a heavily researched area. Finding its applications in tasks ranging from simple Q/A chatbots …...
A BERT-based Siamese-structured Retrieval Model
AbstractDue to the development of deep learning, the natural language processing tasks have made great progresses by leveraging the bidirectional encoder representations from Transformers (BERT). The goal of information retrieval …...
A Study on Contextualized Language Modeling for Machine Reading Comprehension
AbstractWith the recent breakthrough of deep learning technologies, research on machine reading comprehension (MRC) has attracted much attention and found its versatile applications in many use cases. MRC is an …...
A Survey of Approaches to Automatic Question Generation:from 2019 to Early 2021
AbstractTo provide analysis of recent researches of automatic question generation from text,we surveyed 9 papers between 2019 to early 2021, retrieved from Paper with Code(PwC). Our research follows the survey …...
A unified approach to sentence segmentation of punctuated text in many languages
AbstractThe sentence is a fundamental unit of text processing. Yet sentences in the wild are commonly encountered not in isolation, but unsegmented within larger paragraphs and documents. Therefore, the first …...
Anonymisation Models for Text Data: State of the art, Challenges and Future Directions
AbstractThis position paper investigates the problem of automated text anonymisation, which is a prerequisite for secure sharing of documents containing sensitive information about individuals. We summarise the key concepts behind …...
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models
AbstractPre-trained language models (PLMs) have achieved great success in natural language processing. Most of PLMs follow the default setting of architecture hyper-parameters (e.g., the hidden dimension is a quarter of …...
Better than Average: Paired Evaluation of NLP systems
AbstractEvaluation in NLP is usually done by comparing the scores of competing systems independently averaged over a common set of test instances. In this work, we question the use of …...
Continual Few-Shot Learning for Text Classification
AbstractNatural Language Processing (NLP) is increasingly relying on general end-to-end systems that need to handle many different linguistic phenomena and nuances. For example, a Natural Language Inference (NLI) system has …...
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
AbstractSentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various …...
Defense against Synonym Substitution-based Adversarial Attacks via Dirichlet Neighborhood Ensemble
AbstractAlthough deep neural networks have achieved prominent performance on many NLP tasks, they are vulnerable to adversarial examples. We propose Dirichlet Neighborhood Ensemble (DNE), a randomized method for training a …...
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
AbstractPre-trained Language Models (PLMs) have shown superior performance on various downstream Natural Language Processing (NLP) tasks. However, conventional pre-training objectives do not explicitly model relational facts in text, which are …...
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards?
AbstractLeaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and …...
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis
AbstractWhile state-of-the-art NLP models have been achieving the excellent performance of a wide range of tasks in recent years, important questions are being raised about their robustness and their underlying …...
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences
AbstractWe describe an efficient hierarchical method to compute attention in the Transformer architecture. The proposed attention mechanism exploits a matrix structure similar to the Hierarchical Matrix (H-Matrix) developed by the …...
Including Signed Languages in Natural Language Processing
AbstractSigned languages are the primary means of communication for many deaf and hard of hearing individuals. Since signed languages exhibit all the fundamental linguistic properties of natural language, we believe …...
Intrinsic Bias Metrics Do Not Correlate with Application Bias
AbstractNatural Language Processing (NLP) systems learn harmful societal biases that cause them to amplify inequality as they are deployed in more and more situations. To guide efforts at debiasing these …...
Label-Specific Dual Graph Neural Network for Multi-Label Text Classification
AbstractMulti-label text classification is one of the fundamental tasks in natural language processing. Previous studies have difficulties to distinguish similar labels well because they learn the same document representations for …...
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation
AbstractThe advent of large pre-trained language models has given rise to rapid progress in the field of Natural Language Processing (NLP). While the performance of these models on standard benchmarks …...
Measuring Fine-Grained Domain Relevance of Terms: A Hierarchical Core-Fringe Approach
AbstractWe propose to measure fine-grained domain relevance– the degree that a term is relevant to a broad (e.g., computer science) or narrow (e.g., deep learning) domain. Such measurement is crucial …...
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
AbstractPre-trained language models have been applied to various NLP tasks with considerable performance gains. However, the large model sizes, together with the long inference time, limit the deployment of such …...
Multi-hop Graph Convolutional Network with High-order Chebyshev Approximation for Text Reasoning
AbstractGraph convolutional network (GCN) has become popular in various natural language processing (NLP) tasks with its superiority in long-term and non-consecutive word interactions. However, existing single-hop graph reasoning in GCN …...
Open-domain clarification question generation without question examples
AbstractAn overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of uncertainty, humans engage …...
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models
AbstractWhile counterfactual examples are useful for analysis and training of NLP models, current generation methods either rely on manual labor to create very few counterfactuals, or only instantiate limited types …...
Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy Policies
AbstractOrganisations disclose their privacy practices by posting privacy policies on their websites. Even though internet users often care about their digital privacy, they usually do not read privacy policies, since …...
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates
AbstractBehavior of deep neural networks can be inconsistent between different versions. Regressions during model update are a common cause of concern that often over-weigh the benefits in accuracy or efficiency …...
Rethinking Stealthiness of Backdoor Attack against NLP Models
AbstractRecent researches have shown that large natural language processing (NLP) models are vulnerable to a kind of security threat called the Backdoor Attack. Backdoor attacked models can achieve good performance …...
The Art of Abstention: Selective Prediction and Error Regularization for Natural Language Processing
AbstractIn selective prediction, a classifier is allowed to abstain from making predictions on low-confidence examples. Though this setting is interesting and important, selective prediction has rarely been examined in natural …...
The Importance of Modeling Social Factors of Language: Theory and Practice
AbstractNatural language processing (NLP) applications are now more powerful and ubiquitous than ever before. With rapidly developing (neural) models and ever-more available data, current NLP models have access to more …...
To POS Tag or Not to POS Tag: The Impact of POS Tags on Morphological Learning in Low-Resource Settings
AbstractPart-of-Speech (POS) tags are routinely included as features in many NLP tasks. However, the importance and usefulness of POS tags needs to be examined as NLP expands to low-resource languages …...
Towards a balanced annotated Low Saxon dataset for diachronic investigation of dialectal variation
We describe a new annotated dataset for Low Saxon with the intention to complement ex- isting corpora. This corpus covers the period from the 15th to the 21st century and …...
A Case Study on the Importance of Named Entities in a Machine Translation Pipeline for Customer Support Content
AbstractThis paper describes the research developed at Unbabel, a Portuguese Machine-translation start-up, that combines MT with human post-edition and focuses strictly on customer service content. We aim to contribute to …...
A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck
AbstractEvent argument extraction (EAE) aims to extract arguments with given roles from texts, which have been widely studied in natural language processing. Most previous works have achieved good performance in …...
A Survey in Automatic Irony Processing: Linguistic, Cognitive, and Multi-X Perspectives
AbstractIrony is a ubiquitous figurative language in daily communication. Previously, many researchers have approached irony from linguistic, cognitive science, and computational aspects. Recently, some progress have been witnessed in automatic …...
A Survey of Automatic Text Summarization Using Graph Neural Networks
AbstractAlthough automatic text summarization (ATS) has been researched for several decades, the application of graph neural networks (GNNs) to this task started relatively recently. In this survey we provide an …...
Adaptive Feature Discrimination and Denoising for Asymmetric Text Matching
AbstractAsymmetric text matching has becoming increasingly indispensable for many downstream tasks (e.g., IR and NLP). Here, asymmetry means that the documents involved for matching hold different amounts of information, e.g., …...
An Empirical Study on Cross-X Transfer for Legal Judgment Prediction
AbstractCross-lingual transfer learning has proven useful in a variety of Natural Language (NLP) tasks, but it is understudied in the context of legal NLP, and not at all in Legal …...
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations
AbstractData augmentation techniques have been proven useful in many applications in NLP fields. Most augmentations are task-specific, and cannot be used as a general-purpose tool. In our work, we present …...
Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling
AbstractNatural Language Processing (NLP) has become increasingly utilized to provide adaptivity in educational applications. However, recent research has highlighted a variety of biases in pre-trained language models. While existing studies …...
BRCC and SentiBahasaRojak: The First Bahasa Rojak Corpus for Pretraining and Sentiment Analysis Dataset
AbstractCode-mixing refers to the mixed use of multiple languages. It is prevalent in multilingual societies and is also one of the most challenging natural language processing tasks. In this paper, …...
Can Data Diversity Enhance Learning Generalization?
AbstractThis paper introduces our Diversity Advanced Actor-Critic reinforcement learning (A2C) framework (DAAC) to improve the generalization and accuracy of Natural Language Processing (NLP). We show that the diversification of training …...
CoFiF Plus: A French Financial Narrative Summarisation Corpus
AbstractNatural Language Processing is increasingly being applied in the finance and business industry to analyse the text of many different types of financial documents. Given the increasing growth of firms …...
COIN – an Inexpensive and Strong Baseline for Predicting Out of Vocabulary Word Embeddings
AbstractSocial media is the ultimate challenge for many natural language processing tools. The constant emergence of linguistic constructs challenge even the most sophisticated NLP tools. Predicting word embeddings for out …...
ConIsI: A Contrastive Framework with Inter-sentence Interaction for Self-supervised Sentence Representation
Abstract“Learning sentence representation is a fundamental task in natural language processing and has been studied extensively. Recently, many works have obtained high-quality sentence representation based on contrastive learning from pre-trained …...
CSL: A Large-scale Chinese Scientific Literature Dataset
AbstractScientific literature serves as a high-quality corpus, supporting a lot of Natural Language Processing (NLP) research. However, existing datasets are centered around the English language, which restricts the development of …...
DeepSPIN: Deep Structured Prediction for Natural Language Processing
AbstractDeepSPIN is a research project funded by the European Research Council (ERC) whose goal is to develop new neural structured prediction methods, models, and algorithms for improving the quality, interpretability, …...
Document-level Event Factuality Identification via Machine Reading Comprehension Frameworks with Transfer Learning
AbstractDocument-level Event Factuality Identification (DEFI) predicts the factuality of a specific event based on a document from which the event can be derived, which is a fundamental and crucial task …...
EMBEDDIA project: Cross-Lingual Embeddings for Less- Represented Languages in European News Media
AbstractEMBEDDIA project developed a range of resources and methods for less-resourced EU languages, focusing on applications for media industry, including keyword extraction, comment moderation and article generation....
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation
AbstractLarge-scale pretrained language models have led to significant improvements in Natural Language Processing. Unfortunately, they come at the cost of high computational and storage requirements that complicate their deployment on …...
Exploring Label Hierarchy in a Generative Way for Hierarchical Text Classification
AbstractHierarchical Text Classification (HTC), which aims to predict text labels organized in hierarchical space, is a significant task lacking in investigation in natural language processing. Existing methods usually encode the …...
Fast-Paced Improvements to Named Entity Handling for Neural Machine Translation
AbstractIn this work, we propose a Named Entity handling approach to improve translation quality within an existing Natural Language Processing (NLP) pipeline without modifying the Neural Machine Translation (NMT) component. …...
HeterGraphLongSum: Heterogeneous Graph Neural Network with Passage Aggregation for Extractive Long Document Summarization
AbstractGraph Neural Network (GNN)-based models have proven effective in various Natural Language Processing (NLP) tasks in recent years. Specifically, in the case of the Extractive Document Summarization (EDS) task, modeling …...
Keyphrase Prediction from Video Transcripts: New Dataset and Directions
AbstractKeyphrase Prediction (KP) is an established NLP task, aiming to yield representative phrases to summarize the main content of a given document. Despite major progress in recent years, existing works …...
Legal Case Winning Party Prediction With Domain Specific Auxiliary Models
AbstractSifting through hundreds of old case documents to obtain information pertinent to the case in hand has been a major part of the legal profession for centuries. However, with the …...
Measuring Robustness for NLP
AbstractThe quality of Natural Language Processing (NLP) models is typically measured by the accuracy or error rate of a predefined test set. Because the evaluation and optimization of these measures …...
NCU1415 at ROCLING 2022 Shared Task: A light-weight transformer-based approach for Biomedical Name Entity Recognition
AbstractName Entity Recognition (NER) is a very important and basic task in traditional NLP tasks. In the biomedical field, NER tasks have been widely used in various products developed by …...
Persian Natural Language Inference: A Meta-learning Approach
AbstractIncorporating information from other languages can improve the results of tasks in low-resource languages. A powerful method of building functional natural language processing systems for low-resource languages is to combine …...
Psychology-guided Controllable Story Generation
AbstractControllable story generation is a challenging task in the field of NLP, which has attracted increasing research interest in recent years. However, most existing works generate a whole story conditioned …...
Re-contextualizing Fairness in NLP: The Case of India
AbstractRecent research has revealed undesirable biases in NLP data and models. However, these efforts focus of social disparities in West, and are not directly portable to other geo-cultural contexts. In …...
Re-Examining FactBank: Predicting the Author’s Presentation of Factuality
AbstractWe present a corrected version of a subset of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training …...
Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect
AbstractText-to-SQL has attracted attention from both the natural language processing and database communities because of its ability to convert the semantics in natural language into SQL queries and its practical …...
SAPGraph: Structure-aware Extractive Summarization for Scientific Papers with Heterogeneous Graph
AbstractScientific paper summarization is always challenging in Natural Language Processing (NLP) since it is hard to collect summaries from such long and complicated text. We observe that previous works tend …...
Systematic Analysis of Image Schemas in Natural Language through Explainable Multilingual Neural Language Processing
AbstractIn embodied cognition, physical experiences are believed to shape abstract cognition, such as natural language and reasoning. Image schemas were introduced as spatio-temporal cognitive building blocks that capture these recurring …...
Systematic Inequalities in Language Technology Performance across the World’s Languages
AbstractNatural language processing (NLP) systems have become a central technology in communication, education, medicine, artificial intelligence, and many other domains of research and development. While the performance of NLP methods …...
TCM-SD: A Benchmark for Probing Syndrome Differentiation via Natural Language Processing
Abstract“Traditional Chinese Medicine (TCM) is a natural, safe, and effective therapy that has spread and been applied worldwide. The unique TCM diagnosis and treatment system requires a comprehensive analysis of …...
Token and Head Adaptive Transformers for Efficient Natural Language Processing
AbstractWhile pre-trained language models like BERT have achieved impressive results on various natural language processing tasks, deploying them on resource-restricted devices is challenging due to their intensive computational cost and …...
Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gender
AbstractThe world of pronouns is changing – from a closed word class with few members to an open set of terms to reflect identities. However, Natural Language Processing (NLP) barely …...
Who did what to Whom? Language models and humans respond diversely to features affecting argument hierarchy construction
AbstractPre-trained transformer-based language models have achieved state-of-the-art performance in many areas of NLP. It is still an open question whether the models are capable of integrating syntax and semantics in …...
Analyzing ChatGPT’s Mathematical Deficiencies: Insights and Contributions
In this study, we assess ChatGPT, OpenAI’s latest conversational chatbot and large lan- guage model (LLM), on its performance in elementary-grade arithmetic and logic prob- lems. Despite its impressive coherence …...
CHED: A Cross-Historical Dataset with a Logical Event Schema for Classical Chinese Event Detection
Abstract“Event detection (ED) is a crucial area of natural language processing that automates the extrac-tion of specific event types from large-scale text, and studying historical ED in classical Chinesetexts helps …...
Evaluating Interfaced LLM Bias
In this research, we comprehensively ana- lyze the potential biases inherent in Large Language Model, utilizing meticulously cu- rated input data to ascertain the extent to which such data sway …...
Exploiting large pre-trained models for low-resource neural machine translation
AbstractPre-trained models have drastically changed the field of natural language processing by providing a way to leverage large-scale language representations to various tasks. Some pre-trained models offer general-purpose representations, while …...
Exploring Accurate and Generic Simile Knowledge from Pre-trained Language Models
Abstract“A simile is an important linguistic phenomenon in daily communication and an important taskin natural language processing (NLP). In recent years, pre-trained language models (PLMs) haveachieved great success in NLP …...
Exploring the Landscape of Natural Language Processing Research
AbstractAs an efficient approach to understand, generate, and process natural language texts, research in natural language processing (NLP) has exhibited a rapid spread and wide adoption in recent years. Given …...
Learning on Structured Documents for Conditional Question Answering
Abstract“Conditional question answering (CQA) is an important task in natural language processing thatinvolves answering questions that depend on specific conditions. CQA is crucial for domainsthat require the provision of personalized …...
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages
AbstractNatural language processing (NLP) has a significant impact on society via technologies such as machine translation and search engines. Despite its success, NLP technology is only widely available for high-resource …...