Implementation of Convolutional Neural Network with VGG-16 Architecture in Digital Hiragana Handwriting Image Recognition

Abstract

The number of Japanese language learners in Indonesia ranks second at 711,732 people. Hiragana is the first letter to be learned, especially at the beginner level and is usually learned before Katakana and Kanji. Some characters in Hiragana have similar main forms such as nu (ぬ) and me (め), ne (ね) and wa (わ), thus adding complexity to the recognition process. Like previous research that created a Hiragana pronunciation learning application and previous research that was an English writing learning application, allowing people to learn on their own, by applying CNN (Convolutional Neural Network) to recognize written characters, researchers were inspired to apply this in learning to write Hiragana letters. Therefore, researchers created a digital Hiragana handwriting recognition model using the VGG-16 CNN Architecture method so that the model created can later be used in a Hiragana learning application for writing. This study used a dataset in the form of digital Hiragana handwriting images totaling 1518 data with 33 data for each label (46 types of letters). The hyperparameters used in this study to train the model were 5 epochs, a batch size of 32, the Adam Optimizer, and a Learning rate of 0.001. Based on the test results with the aforementioned parameters, the Accuracy value was 98.55%, Precision was 98.91%, Recall was 98.55%, and the F1-Score was 98.51%.