Dialect Identification
Related Papers
Word-Based Dialect Identification with Georeferenced Rules
We present a novel approach for (written) di- alect identification based on the discrimina- tive potential of entire words. We generate Swiss German dialect words from a Standard German lexicon …...
AIDA2: A Hybrid Approach for Token and Sentence Level Dialect Identification in Arabic
In this paper, we present a hybrid approach for performing token and sentence levels Dialect Identification in Arabic. Specifi- cally we try to identify whether each to- ken in a …...
A Computational Perspective on the Romanian Dialects
AbstractIn this paper we conduct an initial study on the dialects of Romanian. We analyze the differences between Romanian and its dialects using the Swadesh list. We analyze the predictive …...
Evaluating Unsupervised Dutch Word Embeddings as a Linguistic Resource
AbstractWord embeddings have recently seen a strong increase in interest as a result of strong performance gains on a variety of tasks. However, most of this research also underlined the …...
Shami: A Corpus of Levantine Arabic Dialects
Modern Standard Arabic (MSA) is the official language used in education and media across the Arab world both in writing and formal speech. However, in daily communication several dialects depending …...
The MADAR Arabic Dialect Corpus and Lexicon
In this paper, we present two resources that were created as part of the Multi Arabic Dialect Applications and Resources (MADAR) project. The first is a large parallel corpus of …...
CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing
AbstractWe present CAMeL Tools, a collection of open-source tools for Arabic natural language processing in Python. CAMeL Tools currently provides utilities for pre-processing, morphological modeling, Dialect Identification, Named Entity Recognition …...
Habibi - a multi Dialect multi National Arabic Song Lyrics Corpus
AbstractThis paper introduces Habibi the first Arabic Song Lyrics corpus. The corpus comprises more than 30,000 Arabic song lyrics in 6 Arabic dialects for singers from 18 different Arabic countries. …...
Unsupervised Deep Language and Dialect Identification for Short Texts
AbstractAutomatic Language Identification (LI) or Dialect Identification (DI) of short texts of closely related languages or dialects, is one of the primary steps in many natural language processing pipelines. Language …...
Distilling the Knowledge of Romanian BERTs Using Multiple Teachers
AbstractRunning large-scale pre-trained language models in computationally constrained environments remains a challenging problem yet to be addressed, while transfer learning from these models has become prevalent in Natural Language Processing …...