The Deep Learning-based Intelligent System for Extracting Information from e-KTP

This research implements an Intelligent Information System for Text Recognition on Indonesian Identity Cards (eKTP) based on Deep Learning architecture. The aim of this research is to develop a system capable of accurately and efficiently detecting and recognizing text on e-KTP images. The first phase of this research involves selecting ideal images from the e-KTP dataset. Subsequently, pre-processing is conducted to crop the image sides and merge them with background images to create a more diverse dataset and obtain the e-KTP image masks as training data. After selecting the ideal images, the total training data amounts to 144 images. The U-Net architecture is chosen as the deep learning method for image segmentation in this research, while for text detection and recognition, two neural networks, CRAFT and TRBA (TPS-ResNet-BiLSTM-Attention), are employed. The testing, based on accuracy values, Dice coefficients, and IoU for the segmentation process, results in a U-Net model accuracy of 99.52%. Text detection and recognition follow confidence values.