Please use this identifier to cite or link to this item: http://hdl.handle.net/20.500.11889/5888
Title: Diacritic-Based Matching of Arabic Words
Authors: Jarrar, Mustafa
Zaraket, Fadi
Asia, Rami
Amayreh, Hamzeh
Keywords: Natural language processing (Computer science)
Phonology, Arabic - Data processing
Grammar, Arabic - Phonology
Language resources
Computational linguistics
Diacritics
Disambiguation
Ambiguity - Data processing
Issue Date: Dec-2018
Publisher: ACM
Citation: Mustafa Jarrar, Fadi Zaraket, Rami Asia, Hamzeh Amayreh: Diacritic-Based Matching of Arabic Words. ACM Asian and Low-Resource Language Information Processing. Volume 18, No 2, Pages(10:1--10:21), ACM, December 2018. ISSN 2375-4699.
Series/Report no.: Vol. 18, No 2;
Abstract: Words in Arabic consist of letters and short vowel symbols called diacritics inscribed atop regular letters. Changing diacritics may change the syntax and semantics of a word; turning it into another. This results in difficulties when comparing words based solely on string matching. Typically, Arabic NLP applications resort to morphological analysis to battle ambiguity originating from this and other challenges. In this paper, we introduce three alternative algorithms to compare two words with possibly different diacritics. We propose the Subsume knowledge-based algorithm, the Imply rule-based algorithm, and the Alike machine- learning based algorithm. We evaluated the soundness, completeness and accuracy of the algorithms against a large dataset of 86,886 word pairs. Our evaluation shows that the accuracy of Subsume (100%), Imply (99.32%), and Alike (99.53%). Although accurate, Subsume was able to judge only 75% of the data. Both Subsume and Imply are sound, while Alike is not. We demonstrate the utility of the algorithms using a real-life use case in lemma disambiguation and in linking hundreds of Arabic dictionaries.
URI: http://hdl.handle.net/20.500.11889/5888
ISSN: 2375-4699
Appears in Collections:Fulltext Publications

Files in This Item:
File Description SizeFormat 
JZAA18.pdfArticle5.98 MBAdobe PDFView/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.