Stemmer and phonotactic rules to improve n-gram tagger-based indonesian phonemicization

Suyanto Suyanto,Andi Sunyoto,Rezza Nafi Ismail,Ema Rachmawati,Warih Maharani

DOI: https://doi.org/10.1016/j.jksuci.2021.01.006

2021-01-01

Abstract:A phonemicization or grapheme-to-phoneme conversion (G2P) is a process of converting a word into its pronunciation. It is one of the essential components in speech synthesis, speech recognition, and natural language processing. The deep learning (DL)-based state-of-the-art G2P model generally gives low phoneme error rate (PER) as well as word error rate (WER) for high-resource languages, such as English and European, but not for low-resource languages. Therefore, some conventional machine learning (ML)-based G2P models incorporated with specific linguistic knowledge are preferable for low-resource languages. However, these models are poor for several low-resource languages because of various issues. For instance, an Indonesian G2P model works well for roots but gives a high PER for derivatives. Most errors come from the ambiguities of some roots and derivative words containing four prefixes: <span class="math"><math>〈</math></span>ber<span class="math"><math>〉,〈</math></span>meng<span class="math"><math>〉,〈</math></span>peng<span class="math"><math>〉</math></span>, and <span class="math"><math>〈</math></span>ter<span class="math"><math>〉</math></span>. In this research, an Indonesian G2P model based on <em>n</em>-gram combined with stemmer and phonotactic rules (NGTSP) is proposed to solve those problems. An investigation based on 5-fold cross-validation, using 50 k Indonesian words, informs that the proposed NGTSP gives a much lower PER of 0.78% than the state-of-the-art Transformer-based G2P model (1.14%). Besides, it also provides a much faster processing time.