Ұзынформер
Related Papers
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding
Scientific document understanding is challeng- ing as the data is highly domain specific and diverse. However, datasets for tasks with scien- tific text require expensive manual annotation and tend to …...
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer
AbstractThis paper presents a technical report of our submission to the 4th task of SemEval-2021, titled: Reading Comprehension of Abstract Meaning. In this task, we want to predict the correct …...
NLQuAD: A Non-Factoid Long Question Answering Data Set
AbstractWe introduce NLQuAD, the first data set with baseline methods for non-factoid long question answering, a task requiring document-level language understanding. In contrast to existing span detection question answering data …...
What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition
AbstractDialog acts can be interpreted as the atomic units of a conversation, more fine-grained than utterances, characterized by a specific communicative function. The ability to structure a conversational transcript as …...
‘Am I the Bad One’? Predicting the Moral Judgement of the Crowd Using Pre–trained Language Models
AbstractNatural language processing (NLP) has been shown to perform well in various tasks, such as answering questions, ascertaining natural language inference and anomaly detection. However, there are few NLP-related studies …...
Simple Local Attentions Remain Competitive for Long-Context Tasks
AbstractMany NLP tasks require processing long contexts beyond the length limit of pretrained models. In order to scale these models to longer text sequences, many efficient long-range attention variants have …...
Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study
AbstractText classification is an area of research which has been studied over the years in Natural Language Processing (NLP). Adapting NLP to multiple domains has introduced many new challenges for …...
Team JUSTR00 at SemEval-2023 Task 3: Transformers for News Articles Classification
AbstractThe SemEval-2023 Task 3 competition offers participants a multi-lingual dataset with three schemes one for each subtask. The competition challenges participants to construct machine learning systems that can categorize news …...
The NLP Task Effectiveness of Long-Range Transformers
AbstractTransformer models cannot easily scale to long sequences due to their O(Nˆ2) time and space complexity. This has led to Transformer variants seeking to lower computational complexity, such as Longformer …...
Viettel-AI at SemEval-2023 Task 6: Legal Document Understanding with Longformer for Court Judgment Prediction with Explanation
AbstractCourt Judgement Prediction with Explanation (CJPE) is a task in the field of legal analysis and evaluation, which involves predicting the outcome of a court case based on the available …...