Title

Diacritic Recognition Performance in Arabic ASR

Document Type

Conference Proceeding

Publication Title

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Abstract

In Arabic text, most vowels are encoded in the form of diacritics that are often omitted, so most speech corpora and ASR models are undiacritized. Text-based diacritization has previously been used to preprocess the input or post-processs ASR hypotheses. It is generally believed that input diacritization degrades ASR quality, but no systematic evaluation of ASR diacritization performance has been conducted to date. We experimentally clarify whether input diacritiztation indeed degrades ASR quality and compare ASR diacritization with text-based diacritization. We fine-tune pre-trained ASR models on transcribed speech with different diacritization conditions: manual, automatic, and no diacritization. We isolate diacritic recognition performance from the overall ASR performance using coverage and precision metrics. We find that ASR diacritization significantly outperforms text-based diacritization, particularly when the ASR model is fine-tuned with manually diacritized transcripts. © 2023 International Speech Communication Association. All rights reserved.

First Page

361

Last Page

365

DOI

10.21437/Interspeech.2023-2344

Publication Date

8-2023

Keywords

Speech communication, Arabic speech recognition, Arabic texts, Automatic diacritization, Condition, Performance, Preprocess, Speech corpora, Systematic evaluation, Speech recognition

Comments

Green Open Access

Access available on ISCA Archive

Share

COinS