Team JUST at the MADAR Shared Task on Arabic Fine-Grained Dialect Identification

Abstract

In this paper, we describe our team’s effort on the MADAR Shared Task on Arabic Fine-Grained Dialect Identification. The task requires building a system capable of differentiating between 25 different Arabic dialects in addition to MSA. Our approach is simple. After preprocessing the data, we use Data Augmentation (DA) to enlarge the training data six times. We then build a language model and extract n-gram word-level and character-level TF-IDF features and feed them into an MNB classifier. Despite its simplicity, the resulting model performs really well producing the 4th highest F-measure and region-level accuracy and the 5th highest precision, recall, city-level accuracy and country-level accuracy among the participating teams.

Publication
Proceedings of the Fourth Arabic Natural Language Processing Workshop
Ali Fadel
Ali Fadel
Machine Learning Engineer II

Software engineer interested in problem solving and machine learning based solutions, likes to create content and teach others.

Related